LiteLLM
OSS proxy that normalizes 100+ LLMs to the OpenAI format. Add routing, fallbacks, caching, and cost tracking in one layer.
Martian
Martian is a model routing layer that sits between your app and LLM providers, automatically routing each request to the most capable model within your budget. It provides cost optimization, automatic fallbacks, and quality guarantees without changing your code.