Local reverse proxy that redacts names and secrets before prompts reach LLM APIs
- Open source
- 3 Hacker News points
- Developer tools
Local reverse proxy that redacts names and secrets before prompts reach LLM APIs
OpenAI-compatible gateway to around 1,000 LLMs with routing, cost tracking and team

Open-source gateway routing apps to 250+ LLMs with retries, fallbacks and caching

Open-source AI gateway in Go that routes LLM calls with budgets, fallbacks and MCP
Tunes a local vLLM or llama.cpp server by measuring one flag change at a time
Rust gateway that proxies OpenAI and Anthropic APIs and records each generation

Ruby library with one API for 23 AI providers, tools and Rails conventions
Self-hosted OpenAI-compatible gateway that load-balances multiple model upstreams

Learns from past agent sessions to cut coding-agent token costs

Open-source gateway adding identity, policy and audit between AI agents and your systems
Self-hosted benchmark that scores local language models as agents on 40 tool-use tasks
AI chat over your team's code snippets library, with codebase indexing and multiple LLMs
The closest alternatives to Llmtee are Aiproxy, Eden AI, gateway, bifrost and Tensward.
Yes. Aiproxy, gateway, bifrost have a free or open-source option.