
Open-source gateway routing apps to 250+ LLMs with retries, fallbacks and caching
- Open source
- 13.4K GitHub stars
- Developer tools

Open-source gateway routing apps to 250+ LLMs with retries, fallbacks and caching

Open-source AI gateway in Go that routes LLM calls with budgets, fallbacks and MCP
OpenAI-compatible gateway to around 1,000 LLMs with routing, cost tracking and team
Self-hosted proxy that logs token use, cost and latency for LLM API calls and enforces key

Open-source gateway adding identity, policy and audit between AI agents and your systems
OpenAI-compatible API gateway that routes requests across AI models, with automatic model

Ruby library with one API for 23 AI providers, tools and Rails conventions
Metering, load balancing and storage layer for developers serving LLM and image models

Self-hosted AI gateway routing many providers through one local endpoint with fallback
Self-hosted OpenAI-compatible gateway that load-balances multiple model upstreams

Desktop app to switch API providers and manage MCP, Skills and prompts across AI coding
Rust gateway that proxies OpenAI and Anthropic APIs and records each generation
Native Windows AI chat app for quick questions, drafting and translation
SEO and AI visibility platform that automates content, links and reporting for agencies
No-code builder that connects AI models into apps, with templates to start from
Local reverse proxy that redacts names and secrets before prompts reach LLM APIs
Android voice assistant for chatting with ChatGPT by speech, photo, or hotword
The closest alternatives to Berri.ai are gateway, bifrost, Eden AI, Llmtee and archestra.
Yes. gateway, bifrost, Llmtee have a free or open-source option.