Skip to content
MCP server

Web Scraping

Map a site, scrape pages to markdown or JSON, and search the web from an AI client

Pricing
Free trial
Platforms
Web, API
Runs
Remotely
Version
0.2.0
Listing updated
2 days ago

About Web Scraping

Web Scraping is an MCP server for web search and scraping. It runs as a hosted remote server, so there is nothing to install locally.

Scraping here is two steps by design. You map a site to get its URLs, then pick pages to scrape; it does not crawl a whole site by itself. It reads public pages only and never logs in, submits forms or buys anything.

A page can come back as markdown, a summary, links, images, raw HTML or JSON extracted to a schema you supply. superagnt reports that on ten well-known pages, markdown was a median 25 times smaller than the raw HTML, which keeps model context cheap. Web search results can include page content.

The page's example calls are map and scrape actions at about $0.00144 each. Billing runs through superagnt credits, with a no-card trial of $3 and plans from $49 a month.

Install

Run in a terminal

claude mcp add --transport http web-scraping https://mcp.superagnt.com/mcp/web-scraping

Add to Settings → Connectors → Add custom connector

https://mcp.superagnt.com/mcp/web-scraping
Install in CursorOpens Cursor, which asks you to confirm. Or add it by hand:

Add to ~/.cursor/mcp.json

{
  "mcpServers": {
    "web-scraping": {
      "url": "https://mcp.superagnt.com/mcp/web-scraping"
    }
  }
}
Install in VS CodeOpens VS Code, which asks you to confirm. Or add it by hand:

Add to .vscode/mcp.json

{
  "servers": {
    "web-scraping": {
      "type": "http",
      "url": "https://mcp.superagnt.com/mcp/web-scraping"
    }
  }
}

Add to ~/.codeium/windsurf/mcp_config.json

{
  "mcpServers": {
    "web-scraping": {
      "serverUrl": "https://mcp.superagnt.com/mcp/web-scraping"
    }
  }
}

Add to your client's MCP settings (most use this shape)

{
  "mcpServers": {
    "web-scraping": {
      "type": "http",
      "url": "https://mcp.superagnt.com/mcp/web-scraping"
    }
  }
}

Tools this server provides (2)

Taken from the project documentation; the running server may differ.

data_web_map
Maps a site's URLs.
data_web_scrape
Scrapes a page to the requested formats.

What it does

Site mapping
Lists a site's URLs, optionally filtered by search term.
Page scraping
Returns markdown, summary, links, images, HTML or schema-based JSON.
Web search
Returns results along with their content.
No browser to run
Runs on superagnt's side without your own proxy.
Public pages only
Never logs in or submits forms.

Good for

  • Turn documentation pages into markdown for an agent
  • Extract structured data to a JSON schema
  • Find pages on a site before scraping
  • Research a topic with search results and content

Pricing

Free trial, from $49 a month

No-card trial with $3 of data credits; plans from $49/month; reads cost about $0.005 per call

Prices change. Check superagnt.com before you buy.

Web Scraping FAQ

Can it crawl a whole site?

No. You map first, then choose pages to scrape.

Can it log in to sites?

No, it reads public pages only.

What formats can it return?

Markdown, summary, links, images, raw HTML or JSON to your schema.

What does it cost?

The sample map and scrape calls were about $0.00144 each at list price.

Is Web Scraping free?

Web Scraping is a paid product with a free trial. Paid plans start at $49 a month.

How do I add Web Scraping to Claude Code?

Run this command in your terminal: claude mcp add --transport http web-scraping https://mcp.superagnt.com/mcp/web-scraping

What are the best alternatives to Web Scraping?

The closest alternatives to Web Scraping are Scrapling MCP Server, Firecrawl MCP Server, SearXNG Search, NeuralVerge and AI-Powered directory.

Alternatives to Web Scraping

  1. MCP server for AI clients to scrape sites with HTTP and stealth browser sessions

    Runs locally
    • 17 tools
    • Open source
    • 104K GitHub stars
    • Web search and scraping
  2. MCP server that lets AI agents search, scrape and interact with web pages

    • 3 tools
    • Remote
    • Freemium
    • 7.8K GitHub stars
    • Web search and scraping
  3. SearXNG Search

    MCP server

    MCP server for web search and page reading through a SearXNG instance

    Runs locally
    • 3 tools
    • Open source
    • 1.4K GitHub stars
    • Web search and scraping
  4. NeuralVerge

    MCP server

    Structured, source-tagged business and people data from 300+ sources for agents

    • 200 tools
    • Remote
    • Free trial
    • 1 GitHub star
    • Web search and scraping
  5. Search AI tools, agents and MCP servers and get install configs from inside your AI assistant.

    • 4 tools
    • Remote
    • Free
    • Developer tools
  6. Hosted MCP server that returns any Shopify store's products, prices and stock

    Not checked yet
    • 4 tools
    • Remote
    • Paid
    • E-commerce