Skip to content
MCP server

Website to Markdown

Web pages and whole sites to clean Markdown for RAG and AI agents. Crawls links and…

Install
Runs
Remotely
Version
1.0.0
Listing updated
4 days ago

About Website to Markdown

Website to Markdown is an MCP server for files and documents. It runs as a hosted remote server, so there is nothing to install locally.

Web pages and whole sites to clean Markdown for RAG and AI agents. Crawls links and sitemaps.

Install

Run in a terminal

claude mcp add --transport http website-content-crawler 'https://mcp.apify.com/?tools=sauliusautomatesit/website-content-crawler-api'

Add to Settings → Connectors → Add custom connector

https://mcp.apify.com/?tools=sauliusautomatesit/website-content-crawler-api
Install in CursorOpens Cursor, which asks you to confirm. Or add it by hand:

Add to ~/.cursor/mcp.json

{
  "mcpServers": {
    "website-content-crawler": {
      "url": "https://mcp.apify.com/?tools=sauliusautomatesit/website-content-crawler-api"
    }
  }
}
Install in VS CodeOpens VS Code, which asks you to confirm. Or add it by hand:

Add to .vscode/mcp.json

{
  "servers": {
    "website-content-crawler": {
      "type": "http",
      "url": "https://mcp.apify.com/?tools=sauliusautomatesit/website-content-crawler-api"
    }
  }
}

Add to ~/.codeium/windsurf/mcp_config.json

{
  "mcpServers": {
    "website-content-crawler": {
      "serverUrl": "https://mcp.apify.com/?tools=sauliusautomatesit/website-content-crawler-api"
    }
  }
}

Add to your client's MCP settings (most use this shape)

{
  "mcpServers": {
    "website-content-crawler": {
      "type": "http",
      "url": "https://mcp.apify.com/?tools=sauliusautomatesit/website-content-crawler-api"
    }
  }
}

Website to Markdown FAQ

How do I add Website to Markdown to Claude Code?

Run this command in your terminal: claude mcp add --transport http website-content-crawler 'https://mcp.apify.com/?tools=sauliusautomatesit/website-content-crawler-api'

What are the best alternatives to Website to Markdown?

The closest alternatives to Website to Markdown are Scrapling MCP Server, Firecrawl MCP Server, SearXNG Search, NeuralVerge and ASTra.

Alternatives to Website to Markdown

  1. MCP server for AI clients to scrape sites with HTTP and stealth browser sessions

    Runs locally
    • 17 tools
    • Open source
    • 104K GitHub stars
    • Web search and scraping
  2. MCP server that lets AI agents search, scrape and interact with web pages

    • 3 tools
    • Remote
    • Freemium
    • 7.8K GitHub stars
    • Web search and scraping
  3. SearXNG Search

    MCP server

    MCP server for web search and page reading through a SearXNG instance

    Runs locally
    • 3 tools
    • Open source
    • 1.4K GitHub stars
    • Web search and scraping
  4. NeuralVerge

    MCP server

    Structured, source-tagged business and people data from 300+ sources for agents

    • 200 tools
    • Remote
    • Free trial
    • 1 GitHub star
    • Web search and scraping
  5. ASTra

    MCP server

    Let agents read, edit, validate and undo Word .docx files with exact operations

    Runs locally
    • 5 tools
    • Freemium
    • Files and documents
  6. Search AI tools, agents and MCP servers and get install configs from inside your AI assistant.

    • 4 tools
    • Remote
    • Free
    • Developer tools