# Web Search API Eval

> Web Search API Eval is a free MCP server for web search and scraping. Query a 30-question benchmark of You.com, Tavily, Exa and Parallel search APIs. It can run locally on your machine or as a hosted remote server.

- **Kind:** MCP server
- **Pricing:** Free
- **Platforms:** CLI, API, Web
- **Website:** https://psinglap.github.io/websearch-api-eval/
- **Repository:** https://github.com/psinglap/websearch-api-eval/tree/HEAD/mcp
- **MCP Registry name:** io.github.psinglap/websearch-api-eval
- **Categories:** web search and scraping, analytics and data
- **Listing updated:** 2026-11-15

## About

This server publishes the results of a web search API benchmark so assistants can answer questions about it. The study compared You.com, Tavily, Exa and Parallel on 30 agent-style queries, 10 each for GTM, insurance and finance agents, run in promptfoo with three runs per query and client-side timing. Answers were graded with the published SimpleQA rubric and FreshQA strict rules, and the data is dated 8 October 2026.

The study's own conclusions are that You.com was fastest and most consistently fresh, Parallel led accuracy, Exa had the best precision@5 in GTM and insurance, and Tavily was strongest on GTM accuracy and docs lookups. The benchmark tools are read-only, and you can pull the scorecard, compare providers, ask for a recommendation for a given agent need, read any single question with each API's answer and score, view charts and read the methodology.

The local npm version adds run_live_search, which sends one query to each provider with your own API keys and credits. It is a spot check rather than a graded run. A hosted endpoint without any install is also available.

## Features

- **Scorecards:** Overall and per-use-case scores for GTM, insurance and finance.
- **Provider comparison:** Side-by-side comparison of two or more providers, filterable by metric.
- **Question drill-down:** See the task, search call, answer key, sources and each API's result.
- **Recommendation:** Suggests which API fits an agent's need with supporting numbers.
- **Live spot check:** Local mode sends one query to each provider using your own keys.
- **Hosted or local:** Use the hosted URL with no install or run the npm package.

## Good for

- Pick a search API for a voice agent based on latency results
- Compare Exa and Parallel on finance questions
- Read what each API returned for one benchmark question
- Rerun a quick live query across providers with your keys

## Install

### Claude Code (Terminal)

```sh
claude mcp add --transport http websearch-api-eval https://websearch-api-eval.psberkeleymba.workers.dev/mcp
```

### Claude Desktop (Settings → Connectors → Add custom connector)

```sh
https://websearch-api-eval.psberkeleymba.workers.dev/mcp
```

### Cursor (~/.cursor/mcp.json)

```json
{
  "mcpServers": {
    "websearch-api-eval": {
      "url": "https://websearch-api-eval.psberkeleymba.workers.dev/mcp"
    }
  }
}
```

### VS Code (.vscode/mcp.json)

```json
{
  "servers": {
    "websearch-api-eval": {
      "type": "http",
      "url": "https://websearch-api-eval.psberkeleymba.workers.dev/mcp"
    }
  }
}
```

### Windsurf (~/.codeium/windsurf/mcp_config.json)

```json
{
  "mcpServers": {
    "websearch-api-eval": {
      "serverUrl": "https://websearch-api-eval.psberkeleymba.workers.dev/mcp"
    }
  }
}
```

### Other clients (your client's MCP settings (most use this shape))

```json
{
  "mcpServers": {
    "websearch-api-eval": {
      "type": "http",
      "url": "https://websearch-api-eval.psberkeleymba.workers.dev/mcp"
    }
  }
}
```

## Tools

- `get_overall_results`: Headline, overall scorecard, per-use-case summary and which API fits which agent.
- `get_scorecard`: Full scorecard for overall, gtm, insurance or finance.
- `compare_providers`: Two or more providers side by side.
- `recommend_provider`: Which API fits an agent's need, with numbers.
- `list_questions`: The 30 questions, filterable by use case.
- `get_question`: One question with answer key, sources and each API's result.
- `get_charts`: The published graphs, optionally an image.
- `get_methodology`: How tests ran, the 10 metrics and limits.
- `how_to_run_locally`: Steps and keys to rerun the full benchmark.
- `search`: Generic search used by ChatGPT research features.
- `fetch`: Generic document fetch.
- `run_live_search`: Sends one query to each provider with your keys (local only).

## FAQ

### Which providers were tested?

You.com, Tavily, Exa and Parallel.

### How many queries were used?

30 queries: 10 each for GTM, insurance and finance agents.

### Do I need API keys?

Only for run_live_search in the local version; the benchmark tools need none.

### Is run_live_search available on the hosted server?

No, it is local only.

### When were results collected?

The README gives the run date as 8 October 2026.

### Is Web Search API Eval free?

Yes. Web Search API Eval is free to use.

### How do I add Web Search API Eval to Claude Code?

Run this command in your terminal: claude mcp add --transport http websearch-api-eval https://websearch-api-eval.psberkeleymba.workers.dev/mcp

### What are the best alternatives to Web Search API Eval?

The closest alternatives to Web Search API Eval are Scrapling MCP Server, Firecrawl MCP Server, Agent-Native Analytics, Google Ads + Meta Ads + SEO/GEO MCP and SearXNG Search.

## Alternatives

- [Scrapling MCP Server](https://ai-powered.com/mcp/scrapling-mcp-server): Scrapling MCP Server is an open-source MCP server for web search and scraping.
- [Firecrawl MCP Server](https://ai-powered.com/mcp/firecrawl-mcp-server): Firecrawl MCP Server is a freemium MCP server for web search and scraping.
- [Agent-Native Analytics](https://ai-powered.com/mcp/agent-native-analytics): Agent-Native Analytics is an open-source MCP server for analytics and data.
- [Google Ads + Meta Ads + SEO/GEO MCP](https://ai-powered.com/mcp/google-ads-meta-ads-seo-geo-mcp): Google Ads + Meta Ads + SEO/GEO MCP is a freemium MCP server for marketing and seo.
- [SearXNG Search](https://ai-powered.com/mcp/searxng-search): SearXNG Search is an open-source MCP server for web search and scraping.
- [Tapetide - Indian Stock Market MCP](https://ai-powered.com/mcp/tapetide-indian-stock-market-mcp): Tapetide - Indian Stock Market MCP is a freemium MCP server for finance and payments.
- [World Monitor](https://ai-powered.com/mcp/world-monitor): World Monitor is a freemium MCP server for analytics and data.
- [CompanyData](https://ai-powered.com/mcp/companydata): CompanyData is a paid MCP server for analytics and data.

---
Source: https://ai-powered.com/mcp/web-search-api-eval
