# Web Research Agent

> Web Research Agent is a freemium MCP server for web search and scraping. Company profiles, site audits and email checks for agents, via a RapidAPI backend. It runs as a hosted remote server, so there is nothing to install locally.

- **Kind:** MCP server
- **Pricing:** Freemium
- **Platforms:** API, CLI, self-hosted
- **Website:** https://mcpize.com/mcp/web-research-agent-mcp
- **Repository:** https://github.com/elaysuu/web-research-agent-mcp
- **MCP Registry name:** io.github.elaysuu/web-research-agent-mcp
- **Categories:** web search and scraping
- **Listing updated:** 2026-11-15

## About

Six tools cover common web-research chores: `company_profile`, `site_audit`, `page_to_json`, `email_check`, `sitemap_urls` and `page_diff`. They call the Web Research Agent API on RapidAPI, so the self-run setup needs your own RapidAPI key; the free plan allows 50 calls a month.

`email_check` does live DNS lookups (MX, SPF, DMARC) without an SMTP probe and returns a 0-100 score. `page_diff` is stateless: you pass the previous text or hash and get back a new hash plus added and removed lines. `sitemap_urls` accepts a `since` value to return only changed pages.

The crawler respects robots.txt and refuses private and internal addresses. A hosted copy on MCPize needs no RapidAPI key and charges $0.01 to $0.02 per call in USDC on Base.

## Features

- **Company profile:** Returns name, description, logo, socials, emails, key pages, price mentions and tech stack for a URL.
- **Site audit:** Scores a site 0-100 and lists SEO, performance, security-header and broken-link issues.
- **Page to JSON:** Extracts meta, Open Graph, JSON-LD, headings, links, images and clean text.
- **Email check:** Checks syntax, MX, SPF, DMARC and disposable, free or role flags with a 0-100 score.
- **Sitemap listing:** Lists every sitemap URL with lastmod, optionally only those changed since a date.
- **Stateless page diff:** Reports a content hash and added or removed lines against your previous check.

## Good for

- Profile a prospect's company from its homepage
- Audit a site for broken links and missing security headers
- Validate an email address or domain before sending
- Watch a page for changes without running a database
- Collect every URL a site publishes in its sitemaps

## Install

### Claude Code (Terminal)

```sh
claude mcp add --transport http web-research-agent-mcp https://web-research-agent-mcp.mcpize.run/mcp
```

### Claude Desktop (Settings → Connectors → Add custom connector)

```sh
https://web-research-agent-mcp.mcpize.run/mcp
```

### Cursor (~/.cursor/mcp.json)

```json
{
  "mcpServers": {
    "web-research-agent-mcp": {
      "url": "https://web-research-agent-mcp.mcpize.run/mcp"
    }
  }
}
```

### VS Code (.vscode/mcp.json)

```json
{
  "servers": {
    "web-research-agent-mcp": {
      "type": "http",
      "url": "https://web-research-agent-mcp.mcpize.run/mcp"
    }
  }
}
```

### Windsurf (~/.codeium/windsurf/mcp_config.json)

```json
{
  "mcpServers": {
    "web-research-agent-mcp": {
      "serverUrl": "https://web-research-agent-mcp.mcpize.run/mcp"
    }
  }
}
```

### Other clients (your client's MCP settings (most use this shape))

```json
{
  "mcpServers": {
    "web-research-agent-mcp": {
      "type": "http",
      "url": "https://web-research-agent-mcp.mcpize.run/mcp"
    }
  }
}
```

## Tools

- `company_profile`: Name, description, logo, socials, emails, key pages, price mentions and tech stack.
- `site_audit`: 0-100 score with SEO, performance, security-header and broken-link issues.
- `page_to_json`: Meta, OG, JSON-LD, headings, links, images and clean text.
- `email_check`: Syntax, MX, SPF, DMARC and flags with a 0-100 score.
- `sitemap_urls`: URLs from a site's sitemaps with lastmod.
- `page_diff`: Content hash plus added and removed lines since a previous check.

## FAQ

### Do I need an API key?

For the npx setup, yes: a RapidAPI key with the free plan giving 50 calls a month. The hosted MCPize version needs no key.

### How much does the hosted version cost?

Pay-per-call pricing of $0.01 to $0.02 per call, settled in USDC on Base.

### Does it respect robots.txt?

Yes, and it refuses private and internal addresses.

### What license is the code under?

MIT.

### Is Web Research Agent free?

Web Research Agent has a free plan, with paid plans for more usage or features.

### How do I add Web Research Agent to Claude Code?

Run this command in your terminal: claude mcp add --transport http web-research-agent-mcp https://web-research-agent-mcp.mcpize.run/mcp

### What are the best alternatives to Web Research Agent?

The closest alternatives to Web Research Agent are Scrapling MCP Server, Firecrawl MCP Server, SearXNG Search, NeuralVerge and AI-Powered directory.

## Alternatives

- [Scrapling MCP Server](https://ai-powered.com/mcp/scrapling-mcp-server): Scrapling MCP Server is an open-source MCP server for web search and scraping.
- [Firecrawl MCP Server](https://ai-powered.com/mcp/firecrawl-mcp-server): Firecrawl MCP Server is a freemium MCP server for web search and scraping.
- [SearXNG Search](https://ai-powered.com/mcp/searxng-search): SearXNG Search is an open-source MCP server for web search and scraping.
- [NeuralVerge](https://ai-powered.com/mcp/neuralverge): NeuralVerge is an MCP server for web search and scraping.
- [AI-Powered directory](https://ai-powered.com/mcp/ai-powered-directory): AI-Powered directory is a free MCP server for developer tools.
- [Shopify MCP Server (any store)](https://ai-powered.com/mcp/shopify-mcp-server-any-store): Shopify MCP Server (any store) is a paid MCP server for e-commerce.
- [Chanroll: YouTube Channel Video Scraper (Official API)](https://ai-powered.com/mcp/chanroll-youtube-channel-video-scraper-official-api): Chanroll: YouTube Channel Video Scraper (Official API) is a paid MCP server for design and media.
- [Vidvett: YouTube Video Details Scraper (Official API)](https://ai-powered.com/mcp/vidvett-youtube-video-details-scraper-official-api): Vidvett: YouTube Video Details Scraper (Official API) is a paid MCP server for design and media.

---
Source: https://ai-powered.com/mcp/web-research-agent
