Skip to content
MCP server

Web Research Agent

Company profiles, site audits and email checks for agents, via a RapidAPI backend

Install
Pricing
Freemium
Platforms
API, CLI, self-hosted
Runs
Remotely
Version
0.3.0
Listing updated
2 days ago

About Web Research Agent

Web Research Agent is a freemium MCP server for web search and scraping. It runs as a hosted remote server, so there is nothing to install locally.

Six tools cover common web-research chores: company_profile, site_audit, page_to_json, email_check, sitemap_urls and page_diff. They call the Web Research Agent API on RapidAPI, so the self-run setup needs your own RapidAPI key; the free plan allows 50 calls a month.

email_check does live DNS lookups (MX, SPF, DMARC) without an SMTP probe and returns a 0-100 score. page_diff is stateless: you pass the previous text or hash and get back a new hash plus added and removed lines. sitemap_urls accepts a since value to return only changed pages.

The crawler respects robots.txt and refuses private and internal addresses. A hosted copy on MCPize needs no RapidAPI key and charges $0.01 to $0.02 per call in USDC on Base.

Install

Run in a terminal

claude mcp add --transport http web-research-agent-mcp https://web-research-agent-mcp.mcpize.run/mcp

Add to Settings → Connectors → Add custom connector

https://web-research-agent-mcp.mcpize.run/mcp
Install in CursorOpens Cursor, which asks you to confirm. Or add it by hand:

Add to ~/.cursor/mcp.json

{
  "mcpServers": {
    "web-research-agent-mcp": {
      "url": "https://web-research-agent-mcp.mcpize.run/mcp"
    }
  }
}
Install in VS CodeOpens VS Code, which asks you to confirm. Or add it by hand:

Add to .vscode/mcp.json

{
  "servers": {
    "web-research-agent-mcp": {
      "type": "http",
      "url": "https://web-research-agent-mcp.mcpize.run/mcp"
    }
  }
}

Add to ~/.codeium/windsurf/mcp_config.json

{
  "mcpServers": {
    "web-research-agent-mcp": {
      "serverUrl": "https://web-research-agent-mcp.mcpize.run/mcp"
    }
  }
}

Add to your client's MCP settings (most use this shape)

{
  "mcpServers": {
    "web-research-agent-mcp": {
      "type": "http",
      "url": "https://web-research-agent-mcp.mcpize.run/mcp"
    }
  }
}

Tools this server provides (6)

Taken from the project documentation; the running server may differ.

company_profile
Name, description, logo, socials, emails, key pages, price mentions and tech stack.
site_audit
0-100 score with SEO, performance, security-header and broken-link issues.
page_to_json
Meta, OG, JSON-LD, headings, links, images and clean text.
email_check
Syntax, MX, SPF, DMARC and flags with a 0-100 score.
sitemap_urls
URLs from a site's sitemaps with lastmod.
page_diff
Content hash plus added and removed lines since a previous check.

What it does

Company profile
Returns name, description, logo, socials, emails, key pages, price mentions and tech stack for a URL.
Site audit
Scores a site 0-100 and lists SEO, performance, security-header and broken-link issues.
Page to JSON
Extracts meta, Open Graph, JSON-LD, headings, links, images and clean text.
Email check
Checks syntax, MX, SPF, DMARC and disposable, free or role flags with a 0-100 score.
Sitemap listing
Lists every sitemap URL with lastmod, optionally only those changed since a date.
Stateless page diff
Reports a content hash and added or removed lines against your previous check.

Good for

  • Profile a prospect's company from its homepage
  • Audit a site for broken links and missing security headers
  • Validate an email address or domain before sending
  • Watch a page for changes without running a database
  • Collect every URL a site publishes in its sitemaps

Pricing

Freemium

RapidAPI free plan 50 calls/month; hosted pay-per-call $0.01-$0.02

Prices change. Check mcpize.com before you buy.

Web Research Agent FAQ

Do I need an API key?

For the npx setup, yes: a RapidAPI key with the free plan giving 50 calls a month. The hosted MCPize version needs no key.

How much does the hosted version cost?

Pay-per-call pricing of $0.01 to $0.02 per call, settled in USDC on Base.

Does it respect robots.txt?

Yes, and it refuses private and internal addresses.

What license is the code under?

MIT.

Is Web Research Agent free?

Web Research Agent has a free plan, with paid plans for more usage or features.

How do I add Web Research Agent to Claude Code?

Run this command in your terminal: claude mcp add --transport http web-research-agent-mcp https://web-research-agent-mcp.mcpize.run/mcp

What are the best alternatives to Web Research Agent?

The closest alternatives to Web Research Agent are Scrapling MCP Server, Firecrawl MCP Server, SearXNG Search, NeuralVerge and AI-Powered directory.

Alternatives to Web Research Agent

  1. MCP server for AI clients to scrape sites with HTTP and stealth browser sessions

    Runs locally
    • 17 tools
    • Open source
    • 104K GitHub stars
    • Web search and scraping
  2. MCP server that lets AI agents search, scrape and interact with web pages

    • 3 tools
    • Remote
    • Freemium
    • 7.8K GitHub stars
    • Web search and scraping
  3. SearXNG Search

    MCP server

    MCP server for web search and page reading through a SearXNG instance

    Runs locally
    • 3 tools
    • Open source
    • 1.4K GitHub stars
    • Web search and scraping
  4. NeuralVerge

    MCP server

    Structured, source-tagged business and people data from 300+ sources for agents

    • 200 tools
    • Remote
    • Free trial
    • 1 GitHub star
    • Web search and scraping
  5. Search AI tools, agents and MCP servers and get install configs from inside your AI assistant.

    • 4 tools
    • Remote
    • Free
    • Developer tools
  6. Hosted MCP server that returns any Shopify store's products, prices and stock

    Not checked yet
    • 4 tools
    • Remote
    • Paid
    • E-commerce