Skip to content

Alternatives to gateway

AI tools that do a similar job to gateway, ranked by how closely they match what it does. gateway is an open-source AI tool for developer tools.

Top 12 alternatives

  1. Self-hosted OpenAI-compatible gateway that load-balances multiple model upstreams

    • Open source
    • 3 Hacker News points
    • Developer tools
  2. Self-hosted AI gateway routing many providers through one local endpoint with fallback

    • Freemium
    • Open-source agent
    • 88.4K GitHub stars
    • AI models and LLM tooling
  3. Open-source AI gateway in Go that routes LLM calls with budgets, fallbacks and MCP

    • Open source
    • Open-source agent
    • 9.7K GitHub stars
    • AI models and LLM tooling
  4. Rust gateway that proxies OpenAI and Anthropic APIs and records each generation

    • Open source
    • 9 Hacker News points
    • Developer tools
  5. OpenAI-compatible gateway to around 1,000 LLMs with routing, cost tracking and team

    • Paid
    • Developer tools
  6. Self-hosted proxy that logs token use, cost and latency for LLM API calls and enforces key

    • Open source
    • 10 Hacker News points
    • Developer tools
  7. Ruby library with one API for 23 AI providers, tools and Rails conventions

    • Open source
    • Open-source agent
    • 4.5K GitHub stars
    • Developer tools
  8. Desktop app to switch API providers and manage MCP, Skills and prompts across AI coding

    • Open source
    • 155K GitHub stars
    • Developer tools
  9. Open-source gateway adding identity, policy and audit between AI agents and your systems

    • Open source
    • Open-source agent
    • 4.4K GitHub stars
    • Security
  10. Lightweight async Python client for multiple LLM providers with agent and MCP support

    • Open source
    • 4 Hacker News points
    • Developer tools
  11. Local reverse proxy that redacts names and secrets before prompts reach LLM APIs

    • Open source
    • 3 Hacker News points
    • Developer tools
  12. Open OpenAI-compatible LLM inference engine for AWS Trainium2 with NKI megakernels

    • Open source
    • 54 Hacker News points
    • Developer tools

gateway alternatives: questions

What are the best alternatives to gateway?

The closest alternatives to gateway are ShanHaiGateway, OmniRoute, bifrost, langfuse and Eden AI.

Is there a free alternative to gateway?

Yes. ShanHaiGateway, OmniRoute, bifrost have a free or open-source option.

Compare head to head