Skip to content

MCP servers for web search and scraping

868 MCP servers that give AI live web search, page fetching and structured data extraction. Each one shows how to install it in Claude, Cursor and VS Code, whether it runs locally or remotely, and the tools it provides.
  1. Research African companies from an assistant, with cited answers and spend approval

    Not checked yet
    • 2 tools
    • Remote
    • Freemium
    • Sales and CRM
  2. Test whether GPTBot, ClaudeBot, PerplexityBot and 10 more crawlers can reach a page

    • 1 tool
    • Remote
    • Free
    • Marketing and SEO
  3. Pay-per-use SEO tools for SERPs, keyword volume, rank tracking and site audits

    • 19 tools
    • Remote
    • Paid
    • Marketing and SEO
  4. Search X posts, profiles, followers, lists and Spaces through an X data API over MCP

    • 4 tools
    • Remote
    • Paid
    • Web search and scraping
  5. Hosted MCP server for cited web research across search, Reddit, YouTube and reviews

    Not checked yet
    • 1 tool
    • Remote
    • Freemium
    • Web search and scraping
  6. Read public posts, comments, profiles and transcripts from Reddit, X, TikTok and more

    • 6 tools
    • Remote
    • Paid
    • Web search and scraping
  7. Crawl and scrape sites to markdown, then ask what changed between runs

    Not checked yet
    • 6 tools
    • Remote
    • Freemium
    • Web search and scraping
  8. Turn YouTube, TikTok, Instagram, Facebook, X and article URLs into transcripts and JSON

    • 6 tools
    • Remote
    • Freemium
    • Web search and scraping
  9. Check whether a half-remembered thing can be found before your agent answers

    • 4 tools
    • Remote
    • Free
    • Web search and scraping
  10. Remote MCP server for live Google results, SEO research and web scraping with credits

    • Remote
    • Freemium
    • Marketing and SEO
  11. Scrape App Store and Google Play reviews and get AI themes, bugs and competitor reports

    • Remote
    • Paid
    • Analytics and data
  12. Pay-per-call social data from Douyin, Xiaohongshu, TikTok, X, YouTube and more

    • 5 tools
    • Remote
    • Paid
    • Web search and scraping
  13. Fetch web pages as clean Markdown for agents, honouring robots.txt and noai

    Runs locally
    • 2 tools
    • Freemium
    • Web search and scraping
  14. Web capture, MCP and x402 inspectors and a verified directory for agent tools

    • 34 tools
    • Remote
    • Freemium
    • Web search and scraping
  15. Hourly-checked free HTTP and SOCKS proxy lists with a CLI and MCP tools to fetch pages

    Runs locally
    • Free
    • Web search and scraping
  16. Official SerpApi server: Google, Bing and other search results as JSON or Markdown

    • 4 tools
    • Remote
    • Freemium
    • Web search and scraping
  17. One prepaid balance for thousands of pay-per-call search, maps and market-data tools

    Not checked yet
    • 4 tools
    • Remote
    • Paid
    • Web search and scraping
  18. Reddit search, comments, users and monitors as 61 pay-per-call MCP tools

    Not checked yet
    • 1 tool
    • Remote
    • Paid
    • Web search and scraping
  19. Reads web pages for agents as clean markdown with hidden instructions stripped

    Not checked yet
    • 2 tools
    • Remote
    • Freemium
    • Security
  20. Turn any web page into clean Markdown, design tokens and a link list for LLMs

    Not checked yet
    • 4 tools
    • Remote
    • Free
    • Files and documents
  21. Open-source web scraper for agents with scrape, crawl, map and search tools

    Runs locally
    • 3 tools
    • Freemium
    • Web search and scraping
  22. Live web and news search, full article text and research papers for agents on a flat plan

    Not checked yet
    • 9 tools
    • Remote
    • Freemium
    • Web search and scraping

See every kind of AI for web search and scraping: tools, agents, MCP servers and skills.Ranked: the best AI for web search and scraping.