Skip to content

MCP servers for web search and scraping

180 MCP servers that give AI live web search, page fetching and structured data extraction. Each one shows how to install it in Claude, Cursor and VS Code, whether it runs locally or remotely, and the tools it provides.
  1. MCP server for AI clients to scrape sites with HTTP and stealth browser sessions

    Runs locally
    • 17 tools
    • Open source
    • 104K GitHub stars
    • Web search and scraping
  2. MCP server for web search and page reading through a SearXNG instance

    Runs locally
    • 3 tools
    • Open source
    • 1.4K GitHub stars
    • Web search and scraping
  3. Structured, source-tagged business and people data from 300+ sources for agents

    • 200 tools
    • Remote
    • Free trial
    • 1 GitHub star
    • Web search and scraping
  4. Structured Google and Bing search results for agents, with recoverable requests

    Runs locally
    • Free trial
    • Web search and scraping
  5. Fetch pages and search the web through a Singapore 4G/5G mobile IP from your agent

    • 4 tools
    • Remote
    • Free trial
    • Web search and scraping
  6. Live JSON from sites with no API, plus agent-built APIs for any website

    • 9 tools
    • Remote
    • Free trial
    • Web search and scraping
  7. Search Console clicks, positions, URL inspection and sitemaps for your AI agent

    Runs locally
    • 8 tools
    • Open source
    • Web search and scraping
  8. Hosted and open-source web scraper that returns clean Markdown with change tracking

    • Remote
    • Free trial
    • Web search and scraping
  9. Local deep research assistant that checks each citation and keeps what it finds

    Runs locally
    • Open source
    • Knowledge and memory
  10. One MCP server for web search, page extraction, crawling and platform scraping

    • 9 tools
    • Remote
    • Free trial
    • Web search and scraping
  11. Fetch web pages as markdown with SSRF protection, reader mode, feeds and robots checks

    Runs locally
    • 15 tools
    • Open source
    • Web search and scraping
  12. Self-hosted Google Search Console MCP for analytics, URL inspection and sitemaps

    Not checked yet
    • Remote
    • Open source
    • Marketing and SEO
  13. Pull Google Maps, reviews, web pages and public LinkedIn data into your assistant

    Runs locally
    • 4 tools
    • Free trial
    • Maps and travel
  14. Trace what really runs in Java, Python, TypeScript and JavaScript, with edge confidence

    Runs locally
    • 13 tools
    • Open source
    • Web search and scraping
  15. Cited research answers with source budgets and visible USDC payment states

    Not checked yet
    • 3 tools
    • Remote
    • Free trial
    • Web search and scraping
  16. Fetch bot-protected and JavaScript-heavy pages as Markdown or template-parsed JSON

    Not checked yet
    • 3 tools
    • Remote
    • Free trial
    • Web search and scraping
  17. One API key for public TikTok data, with X, Instagram and Reddit planned

    Not checked yet
    • Remote
    • Free trial
    • Analytics and data
  18. Europe PMC literature search, full text and export for AI agents (Python, MIT)

    Runs locally
    • Open source
    • Health and science
  19. Read-only Google Play data for agents: apps, charts, reviews, permissions and data safety

    Runs locally
    • 8 tools
    • Open source
    • E-commerce
  20. Find a creator's other social accounts from one profile link, with confidence scores

    Not checked yet
    • 4 tools
    • Remote
    • Free trial
    • Marketing and SEO
  21. Crawl documentation sites into local Markdown that agents search offline

    Runs locally
    • 4 tools
    • Open source
    • Web search and scraping
  22. Browse login-protected and JavaScript-heavy pages through your own Chrome, Edge or Brave

    Runs locally
    • 9 tools
    • Open source
    • Browser automation
  23. Google Search Console, Bing and Yandex data inside your AI assistant, with SEO analyses

    Not checked yet
    • 16 tools
    • Remote
    • Free trial
    • Web search and scraping
  24. Turns web pages and PDFs into cached Markdown outlines read one section at a time

    Runs locally
    • Open source
    • Web search and scraping
  25. Anti-bot-aware scraping: crawl, render, screenshot and unlock pages via one API

    Not checked yet
    • 5 tools
    • Remote
    • Free trial
    • Web search and scraping
  26. Structured Google, Bing and Brave search results for agents via the Autom SERP API

    Not checked yet
    • 6 tools
    • Remote
    • Free trial
    • Web search and scraping
  27. Website screenshots, PDF export, page content and AI analysis through one API

    Not checked yet
    • 6 tools
    • Remote
    • Free trial
    • Web search and scraping
  28. Remote MCP server that searches the MCP Harbor directory of MCP servers and agent tools

    Not checked yet
    • 2 tools
    • Remote
    • Open source
    • Developer tools
  29. Passive-by-default OSINT lookups for AI agents: DNS, WHOIS, IP, breaches, Shodan and more

    Runs locally
    • 16 tools
    • Open source
    • Security

See every kind of AI for web search and scraping: tools, agents, MCP servers and skills.Ranked: the best AI for web search and scraping.