# Web Scraper Markdown Reader, Live Search & Agent Pass x402 MCP

> Web Scraper Markdown Reader, Live Search & Agent Pass x402 MCP is a paid MCP server for web search and scraping. Pay-per-request web scraping, live search and a 30-day pass for AI agents over MCP. It runs as a hosted remote server, so there is nothing to install locally.

- **Kind:** MCP server
- **Pricing:** Paid
- **Starting price:** $4.9 a month
- **Platforms:** API, Web
- **Website:** https://agent-web-x402-gateway.b2bintel-edge.workers.dev
- **Repository:** https://github.com/beakdo/defi-customs-mcp-hub
- **MCP Registry name:** dev.workers.b2bintel-edge.agent-web-x402-gateway/web-scrape-search-firecrawl-x402-mcp
- **Categories:** [web search and scraping](https://ai-powered.com/categories/web-search-and-scraping), [files and documents](https://ai-powered.com/categories/files-and-documents)
- **Listing updated:** 2026-11-20

## About

This gateway lets an AI agent pull a public web page back as clean Markdown, run a live search across news, Hacker News, GitHub and Wikipedia, or bundle search results with the full text of the top three links. Payment is handled per call in USDC on Base through the x402 protocol, so no account, API key or card is needed to start.

Agents that prefer a flat allowance can buy a 30-day prepaid Bearer pass for $4.90 and use it across the gateway's related endpoints. A free preview lets you test HTML-to-Markdown conversion in the browser before connecting anything.

The service is aimed at developers and autonomous agents that need current web content in a language model's context without managing scraping infrastructure. It is also reachable as a remote MCP server at a single HTTPS URL for compatible clients.

## Features

- **Webpage to Markdown:** Converts any public URL into LLM-ready Markdown with JSON-LD, token count and extracted links.
- **Live multi-source search:** Queries news, Hacker News, GitHub and Wikipedia in parallel for real-time results.
- **Deep research bundle:** Returns search hits together with the cleaned full text of the top three URLs.
- **Per-request USDC payments:** Each call is priced in USDC on Base via x402, with no signup or card required.
- **30-day prepaid pass:** A $4.90 Bearer token covers repeated calls across the gateway's endpoints for 30 days.
- **Remote MCP endpoint:** Connects to MCP-compatible clients over streamable HTTP without a local install.

## Good for

- Feeding current web pages into an agent's context as clean Markdown
- Running live news or GitHub searches inside an autonomous workflow
- Gathering full article text from the top search results for research tasks
- Giving an agent metered, wallet-based access to web data without API keys

## Install

### Claude Code (Terminal)

```sh
claude mcp add --transport http web-scrape-search-firecrawl-x402-mcp https://agent-web-x402-gateway.b2bintel-edge.workers.dev/mcp
```

### Claude Desktop (Settings → Connectors → Add custom connector)

```sh
https://agent-web-x402-gateway.b2bintel-edge.workers.dev/mcp
```

### Cursor (~/.cursor/mcp.json)

```json
{
  "mcpServers": {
    "web-scrape-search-firecrawl-x402-mcp": {
      "url": "https://agent-web-x402-gateway.b2bintel-edge.workers.dev/mcp"
    }
  }
}
```

### VS Code (.vscode/mcp.json)

```json
{
  "servers": {
    "web-scrape-search-firecrawl-x402-mcp": {
      "type": "http",
      "url": "https://agent-web-x402-gateway.b2bintel-edge.workers.dev/mcp"
    }
  }
}
```

### Windsurf (~/.codeium/windsurf/mcp_config.json)

```json
{
  "mcpServers": {
    "web-scrape-search-firecrawl-x402-mcp": {
      "serverUrl": "https://agent-web-x402-gateway.b2bintel-edge.workers.dev/mcp"
    }
  }
}
```

### Grok Bot (Grok Bot desktop app → Connect apps → Add a custom connector)

```sh
https://agent-web-x402-gateway.b2bintel-edge.workers.dev/mcp
```

Enter a Name (for example "Web Scraper Markdown Reader, Live Search & Agent Pass x402 MCP"), choose Type: Remote HTTPS, paste this as the Server URL and choose Add plugin.

### Other clients (your client's MCP settings (most use this shape))

```json
{
  "mcpServers": {
    "web-scrape-search-firecrawl-x402-mcp": {
      "type": "http",
      "url": "https://agent-web-x402-gateway.b2bintel-edge.workers.dev/mcp"
    }
  }
}
```

## Tools

All 4 tools say they're read-only. From the server's own tool annotations; not verified by us.

- `preview_webpage_markdown_free` (says read-only): Extracts title, token estimate, and a 450-character clean Markdown preview from any public URL at $0.00.
- `scrape_webpage_markdown_x402` (says read-only): Converts any public webpage into up to 24,000 chars of clean LLM Markdown, JSON-LD, and outbound links ($0.015 USDC on Base via x402 or 30d Pass).
- `search_live_web_x402` (says read-only): Searches live News, HackerNews, GitHub, and Wikipedia in parallel ($0.02 USDC on Base via x402 or 30d Pass).
- `buy_30day_agent_pass_x402` (says read-only): Mints a 30-day ak_x402_... Bearer pass unlocking all 5 Edge Gateways without per-call signatures ($4.90 USDC on Base via x402).

## FAQ

### Do I need an account or API key to use Web Scraper Markdown Reader, Live Search & Agent Pass x402 MCP?

No. Requests are paid per call in USDC on Base via x402, or you can buy a 30-day Bearer pass for $4.90.

### How much does a single scrape cost?

Converting a URL to Markdown costs $0.015 USDC per request, and a live web search costs $0.020 USDC.

### Which blockchain is used for payment?

Payments are made in USDC on Base (eip155:8453) using EIP-3009 x402.

### How do I connect Web Scraper Markdown Reader, Live Search & Agent Pass x402 MCP to an MCP client?

Add the remote server URL ending in /mcp to your client's MCP configuration; the transport is streamable HTTP.

### How do I add Web Scraper Markdown Reader, Live Search & Agent Pass x402 MCP to Claude Code?

Run this command in your terminal: claude mcp add --transport http web-scrape-search-firecrawl-x402-mcp https://agent-web-x402-gateway.b2bintel-edge.workers.dev/mcp

### What are the best alternatives to Web Scraper Markdown Reader, Live Search & Agent Pass x402 MCP?

The closest alternatives to Web Scraper Markdown Reader, Live Search & Agent Pass x402 MCP are Web Search & Page Markdown for AI Agents, WarpPay402 MCP Gateway, Search402, Agentreader MCP and Industrial Platform.

## Where this comes from

- Description: written from the project's README, the project's website and its MCP Registry entry.
- Status and tools: checked automatically by AIPoweredBot on 21 November 2026.
- Install steps: from the official MCP Registry entry.

## Alternatives

- [Web Search & Page Markdown for AI Agents](https://ai-powered.com/mcp/web-search-and-page-markdown-for-ai-agents): Web Search & Page Markdown for AI Agents is a paid MCP server for web search and scraping.
- [WarpPay402 MCP Gateway](https://ai-powered.com/mcp/warppay402-mcp-gateway): WarpPay402 MCP Gateway is a paid MCP server for web search and scraping.
- [Search402](https://ai-powered.com/mcp/search402): Search402 is a paid MCP server for web search and scraping.
- [Agentreader MCP](https://ai-powered.com/mcp/agentreader-mcp): Agentreader MCP is a freemium MCP server for web search and scraping.
- [Industrial Platform](https://ai-powered.com/mcp/industrial-platform): Industrial Platform is a paid MCP server for finance and payments.
- [X402tools](https://ai-powered.com/mcp/x402tools): X402tools is a paid MCP server for files and documents.
- [AgentAPIHub — Google SERP, News, Trends & Clean Web-to-Markdown MCP](https://ai-powered.com/mcp/agentapihub-google-serp-news-trends-and-clean-web-to-markdow-2): AgentAPIHub — Google SERP, News, Trends & Clean Web-to-Markdown MCP is a freemium MCP server for web search and scraping.
- [x402 Web Extract](https://ai-powered.com/mcp/x402-web-extract): x402 Web Extract is a paid MCP server for web search and scraping.

---
Source: https://ai-powered.com/mcp/web-scraper-markdown-reader-live-search-and-agent-pass-x402
