Skip to content

MCP servers for web search and scraping

1,469 MCP servers that give AI live web search, page fetching and structured data extraction. Each one shows how to install it in Claude, Cursor and VS Code, whether it runs locally or remotely, and the tools it provides.
  1. Pay-per-result data tools for SAM.gov, SEC EDGAR, USAspending, GLEIF and more

    Not checked yet
    • 7 tools
    • Remote
    • Paid
    • Legal and government
  2. Fetch a public page as Markdown or read its metadata, run by an autonomous AI agent

    Not checked yet
    • 2 tools
    • Remote
    • Freemium
    • Web search and scraping
  3. Pay-per-call email, DNS, SEO and Swedish data checks for agents, paid in USDC via x402

    Not checked yet
    • Remote
    • Paid
    • Developer tools
  4. Live Google for Jobs postings with salary, apply links and remote and date filters

    Not checked yet
    • Remote
    • Paid
    • Hiring and recruiting
  5. Hosted Reddit and X data tools for agents, with the credit cost shown on every call

    Not checked yet
    • 14 tools
    • Remote
    • Free trial
    • Web search and scraping
  6. Apify-hosted review classifiers, rank trackers and lead scorers for Maps and Naver

    Not checked yet
    • 17 tools
    • Remote
    • Paid
    • Maps and travel
  7. Pay-per-call x402 tools: web to Markdown, PDF text, India IFSC and PIN, Base addresses

    Not checked yet
    • Remote
    • Paid
    • Files and documents
  8. MCP server giving AI agents web scraping, search and extraction as Markdown or JSON

    Runs locally
    • 10 tools
    • Freemium
    • Web search and scraping
  9. Pay-per-result X, YouTube, TikTok and LinkedIn data plus transcripts via Apify

    Runs locally
    • 6 tools
    • Paid
    • Design and media
  10. LinkedIn company and public profile lookups by URL, charged per result, no login

    Not checked yet
    • Remote
    • Paid
    • Web search and scraping
  11. Test URLs against robots.txt, check AI crawler access and validate sitemaps

    Not checked yet
    • Remote
    • Freemium
    • Web search and scraping
  12. Private web search with no API key, plus Moshpit name lookups and a pro directory

    Runs locally
    • 7 tools
    • Free
    • Web search and scraping
  13. Fetch any public web page as clean Markdown with its title, byline, date and JSON-LD

    Not checked yet
    • 1 tool
    • Remote
    • Paid
    • Web search and scraping
  14. MCP server that finds other MCP servers and APIs, ranked by agent-reported outcomes

    Not checked yet
    • 2 tools
    • Remote
    • Free
    • Developer tools
  15. Open source Python interface for web search, extraction and browsing across many providers

    Runs locally
    • Open source
    • Web search and scraping
  16. Turn web pages into clean Markdown or token-sized RAG chunks via the Web2MD API

    Runs locally
    • 4 tools
    • Freemium
    • Web search and scraping
  17. Remote MCP server giving AI agents live SEO data: SERP, keywords, backlinks, audits

    Not checked yet
    • 7 tools
    • Remote
    • Freemium
    • Marketing and SEO
  18. TikTok profile and video stats by handle or link, billed per result

    Not checked yet
    • Remote
    • Paid
    • Web search and scraping
  19. TikTok video captions as text with timestamps, billed per transcript

    Not checked yet
    • Remote
    • Paid
    • Web search and scraping

See every kind of AI for web search and scraping: tools, agents, MCP servers and skills.Ranked: the best AI for web search and scraping.