# mcp.vanshul.com

> mcp.vanshul.com is an open-source MCP server for web search and scraping. Public MCP server that reads any web page as clean Markdown for AI agents. It runs as a hosted remote server, so there is nothing to install locally.

- **Kind:** MCP server
- **Pricing:** Open source
- **Platforms:** API, CLI, Self-hosted
- **Website:** https://mcp.vanshul.com
- **Repository:** https://github.com/vanshulgoyal101/mcp
- **MCP Registry name:** io.github.vanshulgoyal101/mcp
- **Categories:** [web search and scraping](https://ai-powered.com/categories/web-search-and-scraping)
- **Listing updated:** 2026-11-21

## About

The README describes it as a Cloudflare Worker that gives AI agents read access to live web pages. Each URL is run through Mozilla Readability and Turndown, so navigation, ads and cookie banners are stripped before the text reaches the model.

It exposes four tools over the MCP Streamable HTTP transport: fetch_markdown for the full main content, search_page for only the passages that match a query, fetch_metadata for title, byline, site name and excerpt, and extract_links for outbound links. Clients such as Claude Desktop, Cursor and Continue connect by URL, and stdio-only clients can bridge through mcp-remote.

The server is aimed at developers and agent builders who want current documentation or articles rather than stale training data. Requests are limited to public http(s) addresses, with a 10 second fetch timeout, a roughly 3 MB page cap and a per-IP rate limit. The source is MIT licensed and can be deployed to a Cloudflare account.

## Features

- **Clean Markdown extraction:** Converts a page's main content into Markdown, dropping navigation and page chrome.
- **Query-focused passage search:** Returns only the passages matching a query, each with its heading breadcrumb, to save tokens.
- **Page metadata lookup:** Returns title, byline, site name, excerpt and word count for a URL.
- **Outbound link listing:** Lists outbound http(s) links and their anchor text, with an optional limit.
- **SSRF protection:** Blocks private, internal and cloud metadata addresses and re-validates every redirect hop.
- **No API key required:** Public endpoint with no sign-up, and page content is not stored.

## Good for

- Give a coding assistant access to the current version of a documentation page
- Feed article text into a research or summarisation prompt without boilerplate
- Pull a specific detail such as a pricing table or config flag from a long page
- Walk a site's outbound links to find related pages
- Collect titles and excerpts for citations or link previews

## Install

### Claude Code (Terminal)

```sh
claude mcp add --transport http mcp https://mcp.vanshul.com/mcp
```

### Claude Desktop (Settings → Connectors → Add custom connector)

```sh
https://mcp.vanshul.com/mcp
```

### Cursor (~/.cursor/mcp.json)

```json
{
  "mcpServers": {
    "mcp": {
      "url": "https://mcp.vanshul.com/mcp"
    }
  }
}
```

### VS Code (.vscode/mcp.json)

```json
{
  "servers": {
    "mcp": {
      "type": "http",
      "url": "https://mcp.vanshul.com/mcp"
    }
  }
}
```

### Windsurf (~/.codeium/windsurf/mcp_config.json)

```json
{
  "mcpServers": {
    "mcp": {
      "serverUrl": "https://mcp.vanshul.com/mcp"
    }
  }
}
```

### Grok Bot (Grok Bot desktop app → Connect apps → Add a custom connector)

```sh
https://mcp.vanshul.com/mcp
```

Enter a Name (for example "mcp.vanshul.com"), choose Type: Remote HTTPS, paste this as the Server URL and choose Add plugin.

### Other clients (your client's MCP settings (most use this shape))

```json
{
  "mcpServers": {
    "mcp": {
      "type": "http",
      "url": "https://mcp.vanshul.com/mcp"
    }
  }
}
```

## Tools

- `fetch_markdown`: Returns the page's main content as clean Markdown, with an optional max_chars limit.
- `search_page`: Returns the passages on a page that match a query, ranked by relevance.
- `fetch_metadata`: Returns title, byline, site name, excerpt and word count for a page.
- `extract_links`: Returns outbound http(s) links and their anchor text from a page.

## FAQ

### Which MCP clients can connect to mcp.vanshul.com?

Any client that supports remote Streamable HTTP MCP servers, such as Claude Desktop, Cursor and Continue. Stdio-only clients can bridge with npx mcp-remote.

### Does mcp.vanshul.com need an API key or store page content?

The site says no key is needed and no page content is stored. Extraction is deterministic and uses no LLM.

### How does mcp.vanshul.com protect against SSRF?

Only public http(s) URLs are allowed. Localhost, private ranges and cloud metadata addresses are blocked, and each redirect is re-checked.

### What tools does mcp.vanshul.com expose?

fetch_markdown, search_page, fetch_metadata and extract_links, as listed in the README's tools table.

### Is mcp.vanshul.com free?

Yes. mcp.vanshul.com is open source, so you can use and self-host it for free.

### How do I add mcp.vanshul.com to Claude Code?

Run this command in your terminal: claude mcp add --transport http mcp https://mcp.vanshul.com/mcp

### What are the best alternatives to mcp.vanshul.com?

The closest alternatives to mcp.vanshul.com are Markfetch, webfetch.run, Fetch URL, WebCrawlerAPI and ToolTrace.

## Where this comes from

- Description: written from the project's README, the project's website and its MCP Registry entry.
- Install steps: from the official MCP Registry entry.

## Alternatives

- [Markfetch](https://ai-powered.com/mcp/markfetch): Markfetch is a freemium MCP server for web search and scraping.
- [webfetch.run](https://ai-powered.com/mcp/webfetch-run): webfetch.run is a freemium MCP server for web search and scraping.
- [Fetch URL](https://ai-powered.com/mcp/fetch-url): Fetch URL is an open-source MCP server for web search and scraping.
- [WebCrawlerAPI](https://ai-powered.com/mcp/webcrawlerapi): WebCrawlerAPI is a paid MCP server for web search and scraping.
- [ToolTrace](https://ai-powered.com/mcp/tooltrace): ToolTrace is a freemium MCP server for web search and scraping.
- [Scrapi](https://ai-powered.com/mcp/scrapi): Scrapi is a freemium MCP server for web search and scraping.
- [AI-First Scraper](https://ai-powered.com/mcp/ai-first-scraper): AI-First Scraper is an open-source MCP server for web search and scraping.
- [UK Data: Web reader](https://ai-powered.com/mcp/uk-data-web-reader): UK Data: Web reader is a freemium MCP server for web search and scraping.

---
Source: https://ai-powered.com/mcp/mcp-vanshul-com
