Web Scraping
Map a site, scrape pages to markdown or JSON, and search the web from an AI client
- Pricing
- Free trial
- Platforms
- Web, API
- Runs
- Remotely
- Version
- 0.2.0
- Listing updated
- 2 days ago
About Web Scraping
Web Scraping is an MCP server for web search and scraping. It runs as a hosted remote server, so there is nothing to install locally.
Scraping here is two steps by design. You map a site to get its URLs, then pick pages to scrape; it does not crawl a whole site by itself. It reads public pages only and never logs in, submits forms or buys anything.
A page can come back as markdown, a summary, links, images, raw HTML or JSON extracted to a schema you supply. superagnt reports that on ten well-known pages, markdown was a median 25 times smaller than the raw HTML, which keeps model context cheap. Web search results can include page content.
The page's example calls are map and scrape actions at about $0.00144 each. Billing runs through superagnt credits, with a no-card trial of $3 and plans from $49 a month.
Install
Run in a terminal
claude mcp add --transport http web-scraping https://mcp.superagnt.com/mcp/web-scrapingAdd to Settings → Connectors → Add custom connector
https://mcp.superagnt.com/mcp/web-scrapingAdd to ~/.cursor/mcp.json
{
"mcpServers": {
"web-scraping": {
"url": "https://mcp.superagnt.com/mcp/web-scraping"
}
}
}Add to .vscode/mcp.json
{
"servers": {
"web-scraping": {
"type": "http",
"url": "https://mcp.superagnt.com/mcp/web-scraping"
}
}
}Add to ~/.codeium/windsurf/mcp_config.json
{
"mcpServers": {
"web-scraping": {
"serverUrl": "https://mcp.superagnt.com/mcp/web-scraping"
}
}
}Add to your client's MCP settings (most use this shape)
{
"mcpServers": {
"web-scraping": {
"type": "http",
"url": "https://mcp.superagnt.com/mcp/web-scraping"
}
}
}Tools this server provides (2)
Taken from the project documentation; the running server may differ.
- data_web_map
- Maps a site's URLs.
- data_web_scrape
- Scrapes a page to the requested formats.
What it does
- Site mapping
- Lists a site's URLs, optionally filtered by search term.
- Page scraping
- Returns markdown, summary, links, images, HTML or schema-based JSON.
- Web search
- Returns results along with their content.
- No browser to run
- Runs on superagnt's side without your own proxy.
- Public pages only
- Never logs in or submits forms.
Good for
- Turn documentation pages into markdown for an agent
- Extract structured data to a JSON schema
- Find pages on a site before scraping
- Research a topic with search results and content
Pricing
Free trial, from $49 a month
No-card trial with $3 of data credits; plans from $49/month; reads cost about $0.005 per call
Prices change. Check superagnt.com before you buy.
Web Scraping FAQ
Can it crawl a whole site?
No. You map first, then choose pages to scrape.
Can it log in to sites?
No, it reads public pages only.
What formats can it return?
Markdown, summary, links, images, raw HTML or JSON to your schema.
What does it cost?
The sample map and scrape calls were about $0.00144 each at list price.
Is Web Scraping free?
Web Scraping is a paid product with a free trial. Paid plans start at $49 a month.
How do I add Web Scraping to Claude Code?
Run this command in your terminal: claude mcp add --transport http web-scraping https://mcp.superagnt.com/mcp/web-scraping
What are the best alternatives to Web Scraping?
The closest alternatives to Web Scraping are Scrapling MCP Server, Firecrawl MCP Server, SearXNG Search, NeuralVerge and AI-Powered directory.
Alternatives to Web Scraping

Scrapling MCP Server
MCP serverMCP server for AI clients to scrape sites with HTTP and stealth browser sessions
Runs locally- 17 tools
- Open source
- 104K GitHub stars
- Web search and scraping

Firecrawl MCP Server
MCP serverMCP server that lets AI agents search, scrape and interact with web pages
- 3 tools
- Remote
- Freemium
- 7.8K GitHub stars
- Web search and scraping

SearXNG Search
MCP serverMCP server for web search and page reading through a SearXNG instance
Runs locally- 3 tools
- Open source
- 1.4K GitHub stars
- Web search and scraping

NeuralVerge
MCP serverStructured, source-tagged business and people data from 300+ sources for agents
- 200 tools
- Remote
- Free trial
- 1 GitHub star
- Web search and scraping

AI-Powered directory
MCP serverSearch AI tools, agents and MCP servers and get install configs from inside your AI assistant.
- 4 tools
- Remote
- Free
- Developer tools

Shopify MCP Server (any store)
MCP serverHosted MCP server that returns any Shopify store's products, prices and stock
Not checked yet- 4 tools
- Remote
- Paid
- E-commerce