MCP server
Llmtest MCP
Benchmark AI models on real prompts. Find cheaper, faster alternatives across 340+ models.
Runs locallyStatus and history
- Pricing
- Open source
- Runs
- Locally
- Version
- 0.6.1
- Listing updated
- 5 days ago
About Llmtest MCP
Llmtest MCP is an open-source MCP server. It runs locally on your machine and is started by your AI client.
Install
Run in a terminal
claude mcp add llmtest-mcp --env LLMTEST_API_KEY='<LLMTEST_API_KEY>' -- npx -y llmtest-mcpAdd to claude_desktop_config.json
{
"mcpServers": {
"llmtest-mcp": {
"command": "npx",
"args": [
"-y",
"llmtest-mcp"
],
"env": {
"LLMTEST_API_KEY": "<LLMTEST_API_KEY>"
}
}
}
}Add to ~/.cursor/mcp.json
{
"mcpServers": {
"llmtest-mcp": {
"command": "npx",
"args": [
"-y",
"llmtest-mcp"
],
"env": {
"LLMTEST_API_KEY": "<LLMTEST_API_KEY>"
}
}
}
}Add to .vscode/mcp.json
{
"servers": {
"llmtest-mcp": {
"type": "stdio",
"command": "npx",
"args": [
"-y",
"llmtest-mcp"
],
"env": {
"LLMTEST_API_KEY": "<LLMTEST_API_KEY>"
}
}
}
}Add to ~/.codeium/windsurf/mcp_config.json
{
"mcpServers": {
"llmtest-mcp": {
"command": "npx",
"args": [
"-y",
"llmtest-mcp"
],
"env": {
"LLMTEST_API_KEY": "<LLMTEST_API_KEY>"
}
}
}
}Add to your client's MCP settings (most use this shape)
{
"mcpServers": {
"llmtest-mcp": {
"command": "npx",
"args": [
"-y",
"llmtest-mcp"
],
"env": {
"LLMTEST_API_KEY": "<LLMTEST_API_KEY>"
}
}
}
}Using several servers? Build one config file with the MCP config generator.
Configuration
LLMTEST_API_KEYYour LLMTest API key from https://llmtest.io/dashboardRequired
Pricing
Open source
Prices change. Check llmtest.io before you buy.
Llmtest MCP FAQ
Is Llmtest MCP free?
Yes. Llmtest MCP is open source, so you can use and self-host it for free.
How do I add Llmtest MCP to Claude Code?
Run this command in your terminal: claude mcp add llmtest-mcp --env LLMTEST_API_KEY='<LLMTEST_API_KEY>' -- npx -y llmtest-mcp
Where this comes from
- Description: from the official MCP Registry entry.
- Install steps: from the official MCP Registry entry.