Skip to content

Alternatives to ShanHaiGateway

AI tools that do a similar job to ShanHaiGateway, ranked by how closely they match what it does. ShanHaiGateway is an open-source AI tool for developer tools.

Top 9 alternatives

  1. Open-source gateway routing apps to 250+ LLMs with retries, fallbacks and caching

    • Open source
    • 13.4K GitHub stars
    • Developer tools
  2. Open-source AI gateway in Go that routes LLM calls with budgets, fallbacks and MCP

    • Open source
    • Open-source agent
    • 9.7K GitHub stars
    • AI models and LLM tooling
  3. Rust gateway that proxies OpenAI and Anthropic APIs and records each generation

    • Open source
    • 9 Hacker News points
    • Developer tools
  4. Self-hosted proxy that logs token use, cost and latency for LLM API calls and enforces key

    • Open source
    • 10 Hacker News points
    • Developer tools
  5. Self-hosted AI gateway routing many providers through one local endpoint with fallback

    • Freemium
    • Open-source agent
    • 88.4K GitHub stars
    • AI models and LLM tooling
  6. OpenAI-compatible gateway to around 1,000 LLMs with routing, cost tracking and team

    • Paid
    • Developer tools
  7. Self-hosted benchmark that scores local language models as agents on 40 tool-use tasks

    • Open source
    • 3 Hacker News points
    • Developer tools
  8. Open-source gateway adding identity, policy and audit between AI agents and your systems

    • Open source
    • Open-source agent
    • 4.4K GitHub stars
    • Security
  9. Ruby library with one API for 23 AI providers, tools and Rails conventions

    • Open source
    • Open-source agent
    • 4.5K GitHub stars
    • Developer tools

ShanHaiGateway alternatives: questions

What are the best alternatives to ShanHaiGateway?

The closest alternatives to ShanHaiGateway are gateway, bifrost, langfuse, Llmtee and OmniRoute.

Is there a free alternative to ShanHaiGateway?

Yes. gateway, bifrost, langfuse have a free or open-source option.

Compare head to head