Promptster
Compare and monitor AI model quality, speed and cost across providers for developers
- Pricing
- Freemium
- Platforms
- Web, API
- Runs
- Remotely
- Version
- 1.0.0
- Listing updated
- today
Similar MCP servers
About Promptster
Promptster is a freemium MCP server for ai models and llm tooling. It runs as a hosted remote server, so there is nothing to install locally.
The README and site describe Promptster as a place to run the same prompt against many model providers and see the results next to each other. Each response shows its quality, latency, and token usage, with cost calculated from each provider's published per-token rates. After a comparison, it points out where switching to a cheaper model would save money and what that would cost in quality or speed.
The service also covers production. Scheduled tests can run saved prompts against a chosen provider on a recurring basis, tracking response time, cost, and output quality over time, and alerting when performance falls outside configured thresholds. Users bring their own provider API keys, which the site says are encrypted client-side before storage and billed directly by each provider.
The MCP server is intended for developers who want to run these tests from inside Claude, Cursor, or Windsurf without leaving their editor. A public REST API (v1) is also available for programmatic access.
Install
Run in a terminal
claude mcp add --transport http promptster https://www.promptster.dev/mcpAdd to Settings → Connectors → Add custom connector
https://www.promptster.dev/mcpAdd to ~/.cursor/mcp.json
{
"mcpServers": {
"promptster": {
"url": "https://www.promptster.dev/mcp"
}
}
}Add to .vscode/mcp.json
{
"servers": {
"promptster": {
"type": "http",
"url": "https://www.promptster.dev/mcp"
}
}
}Add to ~/.codeium/windsurf/mcp_config.json
{
"mcpServers": {
"promptster": {
"serverUrl": "https://www.promptster.dev/mcp"
}
}
}Add to your client's MCP settings (most use this shape)
{
"mcpServers": {
"promptster": {
"type": "http",
"url": "https://www.promptster.dev/mcp"
}
}
}Using several servers? Build one config file with the MCP config generator.
What it does
- Side-by-side model comparison
- Runs one prompt across several providers and shows quality, speed, and cost for each response.
- Per-token cost tracking
- Calculates cost in real time from each provider's published input and output token prices.
- Scheduled production monitoring
- Re-runs saved tests on a schedule and alerts when response time, cost, or quality drifts.
- Bring-your-own API keys
- Connects to provider accounts directly so usage is billed at provider rates without a markup.
- MCP server for coding assistants
- Exposes testing and comparison to Claude, Cursor, and Windsurf over a remote MCP endpoint.
- Public REST API
- Offers a v1 API for running tests and comparisons programmatically.
Good for
- Choosing a model for a new AI feature by comparing quality and price before building
- Finding cheaper providers that can handle part of an existing API workload
- Watching a production AI feature for quality or latency regressions after release
- Running prompt comparisons from inside an editor while coding
Pricing
Freemium, from $9 a month
Free plan; Builder $9/mo; Scale $29/mo; overage fees per call
Prices change. Check promptster.dev before you buy.
Promptster FAQ
Do I need to provide my own API keys?
Yes. The site says usage is billed directly by each provider at published rates with no Promptster markup, and keys are encrypted with AES-GCM-256 before being stored.
Which AI providers are supported?
The site lists OpenAI, Anthropic, Google AI, DeepSeek, xAI, Groq, Mistral AI, Perplexity, Together AI, Cerebras, and Fireworks AI.
What plans are available?
Free includes 2,000 API calls per month and 50 saved tests. Builder is $9 per month with 5,000 calls and 500 saved tests. Scale is $29 per month with 25,000 calls and 2,000 saved tests.
Is there a public API?
Yes, the site offers a Public API (v1) for programmatic access.
Is Promptster free?
Promptster has a free plan, with paid plans for more usage or features. Paid plans start at $9 a month.
How do I add Promptster to Claude Code?
Run this command in your terminal: claude mcp add --transport http promptster https://www.promptster.dev/mcp
What are the best alternatives to Promptster?
The closest alternatives to Promptster are Spring Prompt, Prompt Optimizer, OpenMark, Tokeven Cost Advisor and MCP.
Where this comes from
- Description: written from the project's website and its MCP Registry entry.
- Install steps: from the official MCP Registry entry.