# Llmtee

> Llmtee is an open-source AI tool for developer tools. Self-hosted proxy that logs token use, cost and latency for LLM API calls and enforces key. It is available on Linux, macOS, Windows, Web, API, CLI and self-hosted.

- **Kind:** Tool
- **Pricing:** Open source
- **Platforms:** Linux, macOS, Windows, Web, API, CLI, self-hosted
- **Repository:** https://github.com/garritfra/llmtee
- **Categories:** [developer tools](https://ai-powered.com/categories/developer-tools)
- **Listing updated:** 2026-11-18

## About

The README describes llmtee as a self-hosted proxy placed between a client and the OpenAI, Anthropic or OpenAI-compatible endpoints such as OpenRouter, Ollama, vLLM and Groq. Clients only need their base URL changed, and every request is recorded with tokens, cost, latency and time to first token. Responses stream back unchanged while a copy is parsed in the background.

Budgets are enforced per key, daily and monthly. Once a key reaches its limit, the proxy returns HTTP 429 without forwarding the request. Because cost is known only after a response arrives, the request that crosses the limit still completes. Data is stored in a SQLite file by default or in PostgreSQL, and can be viewed in a web UI, exported as CSV, scraped by Prometheus or queried through an MCP server.

The project targets individuals and small teams that want to see and cap their model spend. It deliberately omits routing, fallbacks and multi-tenancy, and the README notes that the 0.x releases may still change configuration.

## Features

- **Transparent request logging:** Records tokens, cost, latency and time to first token for each proxied chat, response, embedding or messages call.
- **Per-key daily and monthly budgets:** Rejects requests with HTTP 429 once a key reaches its configured spend limit for the day or month.
- **Llmtee keys hide provider secrets:** Issues proxy keys that stand in for real provider keys, so agents and teammates never handle the upstream credential.
- **Local and hosted models together:** Shows requests from Ollama, vLLM and hosted APIs in one dashboard via configurable upstreams.
- **Single binary with SQLite:** Runs as one Go binary with a SQLite file that can be backed up by copying, or with PostgreSQL.
- **Export and metrics access:** Offers CSV export, Prometheus metrics and an MCP server with spend and request query tools.

## Good for

- Track which agent or script is driving LLM spend across OpenAI and Anthropic accounts
- Cap daily or monthly API spend for a coding agent so a runaway loop cannot exhaust the budget
- Compare costs of hosted models against local Ollama or vLLM deployments in one place
- Export a month of request logs to CSV for expense review

## FAQ

### Does llmtee require code changes in my client?

The README says any client that allows setting a base URL works without code changes, including the OpenAI and Anthropic SDKs and Claude Code.

### What happens if llmtee's database is down?

Requests are still forwarded. Log events are dropped and counted in llmtee_events_dropped_total, according to the README.

### Are token counts estimated when the provider omits usage?

No. The README states llmtee marks such requests as usage unknown and never estimates tokens.

### Where are provider keys stored?

The README says llmtee never writes provider keys to the database, only their SHA-256 hashes.

### Is Llmtee free?

Yes. Llmtee is open source, so you can use and self-host it for free.

### What are the best alternatives to Llmtee?

The closest alternatives to Llmtee are Aiproxy, Eden AI, gateway, bifrost and Tensward.

## Where this comes from

- Description: written from the project's README.

## Alternatives

- [Aiproxy](https://ai-powered.com/tools/aiproxy): Aiproxy is an open-source AI tool for developer tools.
- [Eden AI](https://ai-powered.com/tools/eden_ai): Eden AI is a paid AI tool for developer tools.
- [gateway](https://ai-powered.com/tools/gateway-10): gateway is an open-source AI tool for developer tools.
- [bifrost](https://ai-powered.com/tools/bifrost-3): bifrost is an open-source AI tool for ai models and llm tooling.
- [Tensward](https://ai-powered.com/tools/tensward): Tensward is an open-source AI tool for developer tools.
- [langfuse](https://ai-powered.com/tools/langfuse-2): langfuse is an open-source AI tool for developer tools.
- [ruby_llm](https://ai-powered.com/tools/ruby-llm): ruby_llm is an open-source AI tool for developer tools.
- [ShanHaiGateway](https://ai-powered.com/tools/shanhaigateway): ShanHaiGateway is an open-source AI tool for developer tools.

---
Source: https://ai-powered.com/tools/llmtee
