Skip to content

MCP servers for web search and scraping

268 MCP servers that give AI live web search, page fetching and structured data extraction. Each one shows how to install it in Claude, Cursor and VS Code, whether it runs locally or remotely, and the tools it provides.
  1. Docker-run MCP server for finding public emails and subdomains of a domain

    Runs locally
    • 4 tools
    • Open source
    • Security
  2. Docker-run MCP server that identifies the CMS, server and frameworks behind a website

    Runs locally
    • 3 tools
    • Open source
    • Security
  3. Check domain availability and registrar prices and look up public domain records

    Not checked yet
    • 3 tools
    • Remote
    • Free
    • Web search and scraping
  4. Keyless web search, page fetching and document reading that runs locally

    Runs locally
    • 11 tools
    • Open source
    • Web search and scraping
  5. Live weather, WHOIS, DNS, SSL, IP and other lookups from APIFreaks, enabled by module

    Runs locally
    • 1 tool
    • Freemium
    • Web search and scraping
  6. Web-fetch tool that returns block pages as failures, via your own Proxlane gateway

    Runs locally
    • 1 tool
    • Open source
    • Web search and scraping
  7. Buy and manage residential and mobile proxies from an AI agent, metered per GB

    Not checked yet
    • 11 tools
    • Remote
    • Paid
    • Web search and scraping
  8. Check which AI crawlers can read a site and generate llms.txt, robots.txt and schema

    Runs locally
    • 9 tools
    • Freemium
    • Web search and scraping
  9. URL intelligence MCP server for link previews, Markdown extraction, screenshots and audits

    Not checked yet
    • Remote
    • Freemium
    • Web search and scraping
  10. Twenty-odd public-data tools for agents: Google SERP, AI Overviews, Maps, Jobs and more

    Runs locally
    • 8 tools
    • Paid
    • Web search and scraping
  11. Find songs by a remembered lyric or title and read lyrics from lyrics.com

    Runs locally
    • 3 tools
    • Free
    • Events and entertainment
  12. Ask Claude about Reddit and Hacker News threads you exported with Comment Scraper

    Runs locally
    • 4 tools
    • Freemium
    • Web search and scraping
  13. Oxylabs MCP server for scraping, Google and Amazon search and AI-driven crawling

    Not checked yet
    • 10 tools
    • Remote
    • Free trial
    • Web search and scraping
  14. Open-source MCP server for web search via SearXNG or You.com and Markdown crawling

    Runs locally
    • 3 tools
    • Open source
    • Web search and scraping
  15. Pay-per-call web reading, search, fact-checks and token screening for agents, in USDC

    Runs locally
    • 7 tools
    • Paid
    • Web search and scraping
  16. Web search, page fetch, AI extraction and cited research reports for agents

    Not checked yet
    • 6 tools
    • Remote
    • Freemium
    • Web search and scraping
  17. Pay-per-call toolbox for agents: search, scraping, business data and media

    Not checked yet
    • 8 tools
    • Remote
    • Paid
    • Web search and scraping
  18. Pay-per-call data tools for agents: social platforms, weather, GitHub and more

    Not checked yet
    • 4 tools
    • Remote
    • Freemium
    • Analytics and data
  19. Pay-per-call MCP tools for web-to-Markdown, XRPL data and file conversion via x402

    Runs locally
    • 7 tools
    • Paid
    • Web search and scraping
  20. Anonymous, no-key MCP server for SEO and AI crawler checks, robots.txt and llms.txt

    Not checked yet
    • 4 tools
    • Remote
    • Free
    • Web search and scraping
  21. Remote MCP server giving AI assistants free checks on websites, IPs, emails and domains

    Not checked yet
    • 7 tools
    • Remote
    • Free
    • Web search and scraping
  22. Live results from six search engines with original ranks, plus page extraction

    Runs locally
    • 10 tools
    • Freemium
    • Web search and scraping
  23. MCP server for searching live data feeds and paying per unlock in Nano (XNO)

    Not checked yet
    • 6 tools
    • Remote
    • Freemium
    • Web search and scraping
  24. Structured JSON from 248 websites through three MCP tools and one API key

    Not checked yet
    • 3 tools
    • Remote
    • Free trial
    • Web search and scraping
  25. Open-source crawler that turns websites into Markdown and JSON, with a local MCP server

    Runs locally
    • Open source
    • Web search and scraping
  26. Query a 30-question benchmark of You.com, Tavily, Exa and Parallel search APIs

    Not checked yet
    • 12 tools
    • Remote
    • Free
    • Web search and scraping
  27. MCP server giving AI assistants live proxy locations, prices and residential or mobile

    Not checked yet
    • 14 tools
    • Remote
    • Freemium
    • Web search and scraping
  28. Checks live whether short .com, .ai, .io and other domains are free; suggests free ones

    Runs locally
    • Open source
    • Developer tools
  29. Convert a public URL to clean Markdown, with a free tier of 10 requests a day

    Not checked yet
    • 1 tool
    • Remote
    • Freemium
    • Web search and scraping

See every kind of AI for web search and scraping: tools, agents, MCP servers and skills.Ranked: the best AI for web search and scraping.