
Open-source gateway routing apps to 250+ LLMs with retries, fallbacks and caching
- Open source
- 13.4K GitHub stars
- Developer tools

Open-source gateway routing apps to 250+ LLMs with retries, fallbacks and caching
Self-hosted proxy that logs token use, cost and latency for LLM API calls and enforces key
Self-hosted OpenAI-compatible gateway that load-balances multiple model upstreams

Open-source AI gateway in Go that routes LLM calls with budgets, fallbacks and MCP

Open-source gateway adding identity, policy and audit between AI agents and your systems
OpenAI-compatible gateway to around 1,000 LLMs with routing, cost tracking and team
Local reverse proxy that redacts names and secrets before prompts reach LLM APIs
The closest alternatives to langfuse are gateway, Llmtee, ShanHaiGateway, bifrost and archestra.
Yes. gateway, Llmtee, ShanHaiGateway have a free or open-source option.