Skip to content

MCP servers for web search and scraping

1,469 MCP servers that give AI live web search, page fetching and structured data extraction. Each one shows how to install it in Claude, Cursor and VS Code, whether it runs locally or remotely, and the tools it provides.
  1. Find free .si domain names from a 600,000-name index, plus DNS and WHOIS lookups

    Not checked yet
    • Remote
    • Free
    • Developer tools
  2. Pay-per-call x402 data from Telegram, Mastodon, Bluesky, Hacker News and Lobsters

    Not checked yet
    • Remote
    • Paid
    • Analytics and data
  3. Search websites whose agent-facing features were probed and dated, not just claimed

    Not checked yet
    • Remote
    • Free
    • Web search and scraping
  4. Pay-per-call web search, news search and autocomplete for AI agents via x402

    Not checked yet
    • Remote
    • Paid
    • Web search and scraping
  5. Give an AI assistant a real browser for screenshots, PDFs, video and page markdown

    Not checked yet
    • Remote
    • Free trial
    • Web search and scraping
  6. Budgeted web page reading for AI assistants, read-only until you allow clicking

    Runs locally
    • 1 tool
    • Open source
    • Browser automation
  7. Pay-per-call web jobs for agents: URL probe, page extract, watch and researched briefs

    Not checked yet
    • Remote
    • Paid
    • Web search and scraping
  8. Bing Webmaster, IndexNow and Search Console data for your AI assistant

    Not checked yet
    • 3 tools
    • Remote
    • Freemium
    • Web search and scraping
  9. Web research with each paragraph checked against its cited source, plus text verification

    Runs locally
    • 6 tools
    • Freemium
    • Web search and scraping
  10. Search YouTube as tables and manage scheduled web data extractions in Lection

    Not checked yet
    • 11 tools
    • Remote
    • Freemium
    • Web search and scraping
  11. Export public Threads profiles' posts, followers and following into your AI chat

    Not checked yet
    • 6 tools
    • Remote
    • Freemium
    • Marketing and SEO
  12. Search LinkedIn, Indeed and company-site jobs in one run, with salary and apply links

    Not checked yet
    • Remote
    • Paid
    • Hiring and recruiting
  13. Download transcripts of every video of a YouTube channel or playlist, new ones only

    Not checked yet
    • Remote
    • Paid
    • Design and media
  14. Transcripts of top YouTube search results by keyword, with date, length and sort filters

    Not checked yet
    • Remote
    • Paid
    • Design and media
  15. Web access preflight for agents: robots rules, licensing signals and advertised routes

    Not checked yet
    • Remote
    • Web search and scraping
  16. Google Shopping seller prices and Google Search, Images, News and Local results as JSON

    Not checked yet
    • Remote
    • Paid
    • Web search and scraping
  17. Read-only discovery of agent services with sourced capability and connection evidence

    Not checked yet
    • Remote
    • Free
    • Developer tools
  18. Give agents a real Chrome that renders JavaScript: Markdown, screenshots, Lighthouse

    Not checked yet
    • 2 tools
    • Remote
    • Freemium
    • Web search and scraping
  19. Pay-per-call web research tools: cited briefs, quote checks and page text via x402

    Not checked yet
    • 7 tools
    • Remote
    • Paid
    • Web search and scraping
  20. Pull every URL from a site's sitemaps with lastmod, via an Apify actor

    Not checked yet
    • Remote
    • Paid
    • Web search and scraping
  21. Source-linked SEC filings, Wikipedia, arXiv and Census data for AI agents

    Not checked yet
    • 4 tools
    • Remote
    • Freemium
    • Analytics and data
  22. Pay-per-use scraping and AI data tools, run as Apify actors from an MCP endpoint

    Not checked yet
    • Remote
    • Paid
    • Web search and scraping
  23. Pay-per-call arXiv paper search, metadata and category listings for AI agents

    Not checked yet
    • Remote
    • Paid
    • Health and science
  24. Turn a public webpage into JSON with AI and save it as a callable API

    Not checked yet
    • 5 tools
    • Remote
    • Freemium
    • Web search and scraping
  25. Live organic results from six search engines as JSON for agents, one tool

    Not checked yet
    • 1 tool
    • Remote
    • Freemium
    • Web search and scraping
  26. Pay-per-call access to data APIs for SEO, company, people and web data from one key

    Not checked yet
    • 7 tools
    • Remote
    • Paid
    • Web search and scraping
  27. Search and cite timestamped YouTube and podcast transcripts, or transcribe any episode

    Not checked yet
    • 3 tools
    • Remote
    • Freemium
    • Design and media
  28. Scrape, search and extract web data as Markdown or validated JSON, with credit caps

    Not checked yet
    • Remote
    • Paid
    • Web search and scraping
  29. Keyless web, news, image, video and book search for AI agents, via MCP or REST

    Runs locally
    • Open source
    • Web search and scraping

See every kind of AI for web search and scraping: tools, agents, MCP servers and skills.Ranked: the best AI for web search and scraping.