LiteLLM alternatives
5 substitutes · 5 in routing · 0 adjacent
The short answer
5 tools on this index are recorded as a substitute for LiteLLM. 2 of these run the same way you already deploy LiteLLM (self-hosted), and 1 is permissively licensed, so it does not change what you can ship. All of them sit in Routing & Gateways, so the choice is a real one rather than a category change. There is no overall winner here: which one is right depends on traffic shape, operational budget and how much of LiteLLM you have already built around.
By Lattice editorial · Comparison reviewed · method
Better than this page
- LiteLLM vs Portkey vs Cloudflare AI GatewayLLM gateways compared on provider coverage, caching, where the data goes and whether the routing logic is yours or theirs.
- Gateway vs guardrails vs evals: what to build firstA gateway, a guardrail layer and an eval suite compete for the same first week of work. What each catches, what each misses, and the order to adopt them in.
Real substitutes
in Routing & Gateways- Portkeyplatform · proprietary
AI gateway with routing, caching and guardrails in one layer.
Use when A managed gateway with guardrails and analytics already bundled.
Skip when Prompts cannot leave your infrastructure.
- OpenRouterservice · proprietary
Single API key and billing across many hosted models.
Use when One key and one bill across many hosted models, while experimenting.
Skip when You need self-hosting or per-provider SLAs.
- Envoy AI Gatewayruntime · Apache-2.0
CNCF-track gateway for LLM traffic on an Envoy data plane.
Use when A Kubernetes shop that already runs Envoy and needs the gateway in-cluster.
Skip when You want a gateway configurable without a data plane.
- Bifrostlibrary · proprietary
High-throughput LLM gateway with drop-in OpenAI compatibility.
Use when A high-throughput OpenAI-compatible proxy with a small footprint.
Skip when You need the breadth of a full routing stack.
- Cloudflare AI Gatewayservice · proprietary
Edge gateway adding caching, retries and rate limiting.
Use when Edge caching and latency dominate, on Cloudflare already.
Skip when Requests must not transit a third party's network.
This graph is bidirectional and unsponsored. A tool appears here if LiteLLM or another entry names it as a substitute, and Portkey, OpenRouter, Envoy AI Gateway, Bifrost and Cloudflare AI Gateway point at LiteLLM as well. How this index is compiled — including where it is wrong.