Skip to content
ToolOpen-source agent

bifrost

Open-source AI gateway in Go that routes LLM calls with budgets, fallbacks and MCP

Pricing
Open source
Platforms
API, self-hosted
GitHub stars
9.6K
Last commit
today
Language
Go
License
Apache-2.0

About bifrost

bifrost is an open-source AI tool for ai models and llm tooling. It is available on API and self-hosted.

Bifrost sits between an application and its model providers. You change the base URL of an existing OpenAI, Anthropic, LiteLLM, Google GenAI or LangChain client to point at your Bifrost deployment, and requests are then routed to whichever provider and model you configure.

The feature list centres on running that traffic in production: virtual keys with their own budgets and access control, spending limits per team, automatic failover between providers, guardrails that block unsafe output, and a built-in MCP gateway that centralises tool connections and policy. The vendor's own benchmark claims lower latency than LiteLLM at 500 requests per second; treat that as the vendor's figure.

The open-source edition is Apache-2.0 and written in Go. An enterprise edition adds SAML single sign-on, role-based access control and adaptive load balancing, and the site offers a 14-day trial of it.

What it does

Drop-in endpoint
Point existing provider SDKs at Bifrost with a one-line base URL change.
Provider fallback
Fail over automatically between providers.
Virtual keys
Issue keys with separate budgets and access control.
Budgeting
Set spending limits and track cost by team, project and model.
MCP gateway
Centralise MCP tool connections, auth and policy.
Guardrails
Block unsafe outputs and enforce compliance rules in real time.

Good for

  • Put one gateway in front of several LLM providers
  • Cap spend per team with virtual keys
  • Add failover so a provider outage does not stop an app
  • Govern which MCP tools agents may call

Pricing

Open source

OSS free; Enterprise custom pricing with 14-day trial

Prices change. Check getmaxim.ai before you buy.

bifrost FAQ

Is Bifrost free?

The OSS edition is listed as free forever; Enterprise has custom pricing and a 14-day free trial.

How hard is it to adopt?

The site says one line of code changes, the base URL of your existing SDK client.

Which SDKs work with it?

OpenAI, Anthropic, LiteLLM, Google GenAI, LangChain and the Vercel AI SDK are named.

Who makes it?

The site is run by Maxim AI.

What are the best alternatives to bifrost?

The closest alternatives to bifrost are ECC, firecrawl, ponytail, graphify and orca.

Alternatives to bifrost

  1. Skills, hooks, memory and security layer for coding agent harnesses

    • Freemium
    • Open-source agent
    • 305K GitHub stars
    • AI models and LLM tooling
  2. Web search, scraping and page interaction API for AI agents and developers

    • Freemium
    • Agent framework
    • 202K GitHub stars
    • Web search and scraping
  3. Ruleset that makes AI coding agents write less code that still works

    • Open source
    • Open-source agent
    • 192K GitHub stars
    • AI models and LLM tooling
  4. Code knowledge graph that gives coding assistants shared, source-linked context

    • Freemium
    • Open-source agent
    • 149K GitHub stars
    • Knowledge and memory
  5. Desktop environment for running several coding agents in parallel worktrees

    • Open source
    • Open-source agent
    • 127K GitHub stars
    • Coding
  6. Agent skill that turns questions or code into validated HTML diagrams and one-page answers

    • Open source
    • Open-source agent
    • 97.2K GitHub stars
    • Design and media