Web Research Agent
Company profiles, site audits and email checks for agents, via a RapidAPI backend
- Pricing
- Freemium
- Platforms
- API, CLI, self-hosted
- Runs
- Remotely
- Version
- 0.3.0
- Listing updated
- 2 days ago
About Web Research Agent
Web Research Agent is a freemium MCP server for web search and scraping. It runs as a hosted remote server, so there is nothing to install locally.
Six tools cover common web-research chores: company_profile, site_audit, page_to_json, email_check, sitemap_urls and page_diff. They call the Web Research Agent API on RapidAPI, so the self-run setup needs your own RapidAPI key; the free plan allows 50 calls a month.
email_check does live DNS lookups (MX, SPF, DMARC) without an SMTP probe and returns a 0-100 score. page_diff is stateless: you pass the previous text or hash and get back a new hash plus added and removed lines. sitemap_urls accepts a since value to return only changed pages.
The crawler respects robots.txt and refuses private and internal addresses. A hosted copy on MCPize needs no RapidAPI key and charges $0.01 to $0.02 per call in USDC on Base.
Install
Run in a terminal
claude mcp add --transport http web-research-agent-mcp https://web-research-agent-mcp.mcpize.run/mcpAdd to Settings → Connectors → Add custom connector
https://web-research-agent-mcp.mcpize.run/mcpAdd to ~/.cursor/mcp.json
{
"mcpServers": {
"web-research-agent-mcp": {
"url": "https://web-research-agent-mcp.mcpize.run/mcp"
}
}
}Add to .vscode/mcp.json
{
"servers": {
"web-research-agent-mcp": {
"type": "http",
"url": "https://web-research-agent-mcp.mcpize.run/mcp"
}
}
}Add to ~/.codeium/windsurf/mcp_config.json
{
"mcpServers": {
"web-research-agent-mcp": {
"serverUrl": "https://web-research-agent-mcp.mcpize.run/mcp"
}
}
}Add to your client's MCP settings (most use this shape)
{
"mcpServers": {
"web-research-agent-mcp": {
"type": "http",
"url": "https://web-research-agent-mcp.mcpize.run/mcp"
}
}
}Tools this server provides (6)
Taken from the project documentation; the running server may differ.
- company_profile
- Name, description, logo, socials, emails, key pages, price mentions and tech stack.
- site_audit
- 0-100 score with SEO, performance, security-header and broken-link issues.
- page_to_json
- Meta, OG, JSON-LD, headings, links, images and clean text.
- email_check
- Syntax, MX, SPF, DMARC and flags with a 0-100 score.
- sitemap_urls
- URLs from a site's sitemaps with lastmod.
- page_diff
- Content hash plus added and removed lines since a previous check.
What it does
- Company profile
- Returns name, description, logo, socials, emails, key pages, price mentions and tech stack for a URL.
- Site audit
- Scores a site 0-100 and lists SEO, performance, security-header and broken-link issues.
- Page to JSON
- Extracts meta, Open Graph, JSON-LD, headings, links, images and clean text.
- Email check
- Checks syntax, MX, SPF, DMARC and disposable, free or role flags with a 0-100 score.
- Sitemap listing
- Lists every sitemap URL with lastmod, optionally only those changed since a date.
- Stateless page diff
- Reports a content hash and added or removed lines against your previous check.
Good for
- Profile a prospect's company from its homepage
- Audit a site for broken links and missing security headers
- Validate an email address or domain before sending
- Watch a page for changes without running a database
- Collect every URL a site publishes in its sitemaps
Pricing
Freemium
RapidAPI free plan 50 calls/month; hosted pay-per-call $0.01-$0.02
Prices change. Check mcpize.com before you buy.
Web Research Agent FAQ
Do I need an API key?
For the npx setup, yes: a RapidAPI key with the free plan giving 50 calls a month. The hosted MCPize version needs no key.
How much does the hosted version cost?
Pay-per-call pricing of $0.01 to $0.02 per call, settled in USDC on Base.
Does it respect robots.txt?
Yes, and it refuses private and internal addresses.
What license is the code under?
MIT.
Is Web Research Agent free?
Web Research Agent has a free plan, with paid plans for more usage or features.
How do I add Web Research Agent to Claude Code?
Run this command in your terminal: claude mcp add --transport http web-research-agent-mcp https://web-research-agent-mcp.mcpize.run/mcp
What are the best alternatives to Web Research Agent?
The closest alternatives to Web Research Agent are Scrapling MCP Server, Firecrawl MCP Server, SearXNG Search, NeuralVerge and AI-Powered directory.
Alternatives to Web Research Agent

Scrapling MCP Server
MCP serverMCP server for AI clients to scrape sites with HTTP and stealth browser sessions
Runs locally- 17 tools
- Open source
- 104K GitHub stars
- Web search and scraping

Firecrawl MCP Server
MCP serverMCP server that lets AI agents search, scrape and interact with web pages
- 3 tools
- Remote
- Freemium
- 7.8K GitHub stars
- Web search and scraping

SearXNG Search
MCP serverMCP server for web search and page reading through a SearXNG instance
Runs locally- 3 tools
- Open source
- 1.4K GitHub stars
- Web search and scraping

NeuralVerge
MCP serverStructured, source-tagged business and people data from 300+ sources for agents
- 200 tools
- Remote
- Free trial
- 1 GitHub star
- Web search and scraping

AI-Powered directory
MCP serverSearch AI tools, agents and MCP servers and get install configs from inside your AI assistant.
- 4 tools
- Remote
- Free
- Developer tools

Shopify MCP Server (any store)
MCP serverHosted MCP server that returns any Shopify store's products, prices and stock
Not checked yet- 4 tools
- Remote
- Paid
- E-commerce