# WebRead

> WebRead is a freemium MCP server for files and documents. Fetches any public web page as clean Markdown for agents, free tier then $0.002 per page. It runs as a hosted remote server, so there is nothing to install locally.

- **Kind:** MCP server
- **Pricing:** Freemium
- **Platforms:** API, Web
- **Website:** https://webread.agentgate.workers.dev
- **Repository:** https://github.com/agentgate-builder/x402-url-to-markdown
- **MCP Registry name:** io.github.agentgate-builder/x402-url-to-markdown
- **Categories:** files and documents, web search and scraping
- **Listing updated:** 2026-11-15

## About

One tool, read_url, returns a page's main content without navigation, scripts or ads, keeping absolute links plus title and description metadata. The default is 50,000 characters and maxChars can go up to 200,000.

It behaves as a polite fetcher: robots.txt is honoured under the user-agent token WebReadBot on every redirect hop, private and reserved IPs, internal hostnames, non-default ports and other schemes are refused, and each download is capped at 2 MB and 10 seconds. Bad URLs, robots blocks, unsupported content and upstream failures are never charged.

A free preview endpoint returns the first 2,000 characters at 10 calls a minute per IP. Through the remote MCP server you get 30 full reads a day per IP, then $0.002 per call in USDC over x402 with no account or key. Payments settle through the PayAI facilitator. It is one of nine small x402 tools from the same builder.

## Features

- **Clean Markdown:** Main content only, with absolute links and page metadata.
- **Large pages:** Default 50,000 characters, configurable up to 200,000.
- **robots.txt aware:** Checks robots.txt for WebReadBot on every redirect hop.
- **SSRF protection:** Refuses private IPs, internal hostnames and non-default ports.
- **Pay per read:** 30 free reads a day per IP, then $0.002 per call over x402.
- **Free preview:** First 2,000 characters via a no-wallet preview endpoint.

## Good for

- Give an agent a readable copy of a documentation page
- Feed article text to an LLM without page clutter
- Prototype a research agent that pays per page
- Test the preview endpoint from curl before wiring it up

## Install

### Claude Code (Terminal)

```sh
claude mcp add --transport http x402-url-to-markdown https://webread.agentgate.workers.dev/mcp
```

### Claude Desktop (Settings → Connectors → Add custom connector)

```sh
https://webread.agentgate.workers.dev/mcp
```

### Cursor (~/.cursor/mcp.json)

```json
{
  "mcpServers": {
    "x402-url-to-markdown": {
      "url": "https://webread.agentgate.workers.dev/mcp"
    }
  }
}
```

### VS Code (.vscode/mcp.json)

```json
{
  "servers": {
    "x402-url-to-markdown": {
      "type": "http",
      "url": "https://webread.agentgate.workers.dev/mcp"
    }
  }
}
```

### Windsurf (~/.codeium/windsurf/mcp_config.json)

```json
{
  "mcpServers": {
    "x402-url-to-markdown": {
      "serverUrl": "https://webread.agentgate.workers.dev/mcp"
    }
  }
}
```

### Other clients (your client's MCP settings (most use this shape))

```json
{
  "mcpServers": {
    "x402-url-to-markdown": {
      "type": "http",
      "url": "https://webread.agentgate.workers.dev/mcp"
    }
  }
}
```

## Tools

- `read_url`: Reads a public web page and returns clean Markdown, with an optional maxChars limit.

## FAQ

### What does it cost?

Free for 30 full reads a day per IP (10 a minute), then $0.002 per call in USDC over x402.

### Are failed fetches charged?

No. Bad URLs, robots.txt blocks, unsupported content and upstream failures are not charged.

### What are the size limits?

2 MB download and 10 seconds per page; output defaults to 50,000 characters, up to 200,000.

### Does it respect robots.txt?

Yes, using the user-agent token WebReadBot.

### Is WebRead free?

WebRead has a free plan, with paid plans for more usage or features.

### How do I add WebRead to Claude Code?

Run this command in your terminal: claude mcp add --transport http x402-url-to-markdown https://webread.agentgate.workers.dev/mcp

### What are the best alternatives to WebRead?

The closest alternatives to WebRead are Scrapling MCP Server, Firecrawl MCP Server, SearXNG Search, NeuralVerge and ASTra.

## Alternatives

- [Scrapling MCP Server](https://ai-powered.com/mcp/scrapling-mcp-server): Scrapling MCP Server is an open-source MCP server for web search and scraping.
- [Firecrawl MCP Server](https://ai-powered.com/mcp/firecrawl-mcp-server): Firecrawl MCP Server is a freemium MCP server for web search and scraping.
- [SearXNG Search](https://ai-powered.com/mcp/searxng-search): SearXNG Search is an open-source MCP server for web search and scraping.
- [NeuralVerge](https://ai-powered.com/mcp/neuralverge): NeuralVerge is an MCP server for web search and scraping.
- [ASTra](https://ai-powered.com/mcp/astra): ASTra is a freemium MCP server for files and documents.
- [AI-Powered directory](https://ai-powered.com/mcp/ai-powered-directory): AI-Powered directory is a free MCP server for developer tools.
- [CARTESIAN ECU](https://ai-powered.com/mcp/cartesian-ecu): CARTESIAN ECU is a paid MCP server for files and documents.
- [Invoices](https://ai-powered.com/mcp/invoices): Invoices is a paid MCP server for files and documents.

---
Source: https://ai-powered.com/mcp/webread-2
