Skip to content

MCP servers for web search and scraping

40 MCP servers that give AI live web search, page fetching and structured data extraction. Each one shows how to install it in Claude, Cursor and VS Code, whether it runs locally or remotely, and the tools it provides.
  1. Structured Google and Bing search results for agents, with recoverable requests

    Runs locally
    • Free trial
    • Web search and scraping
  2. Turn any website, GitHub repo, PDF or video link into llms.txt or llms-full.txt

    • 7 tools
    • Remote
    • Free
    • AI models and LLM tooling
  3. Fetch pages and search the web through a Singapore 4G/5G mobile IP from your agent

    • 4 tools
    • Remote
    • Free trial
    • Web search and scraping
  4. Live JSON from sites with no API, plus agent-built APIs for any website

    Runs locally
    • 9 tools
    • Free trial
    • Web search and scraping
  5. Ask an agent what a website is: AI builder traces, tech stack, traffic rank and trust

    • 6 tools
    • Remote
    • Free
    • Analytics and data
  6. Hosted and open-source web scraper that returns clean Markdown with change tracking

    • Remote
    • Free trial
    • Web search and scraping
  7. One MCP server for web search, page extraction, crawling and platform scraping

    • 9 tools
    • Remote
    • Free trial
    • Web search and scraping
  8. Hourly-checked free HTTP and SOCKS proxy lists with a CLI and MCP tools to fetch pages

    Runs locally
    • Free
    • Web search and scraping
  9. Pull Google Maps, reviews, web pages and public LinkedIn data into your assistant

    Runs locally
    • 4 tools
    • Free trial
    • Maps and travel
  10. Search podcasts, videos, Chinese forums and paper citations from your coding agent

    Not checked yet
    • Remote
    • Free
    • Web search and scraping
  11. Cited research answers with source budgets and visible USDC payment states

    Not checked yet
    • 3 tools
    • Remote
    • Free trial
    • Web search and scraping
  12. Fetch bot-protected and JavaScript-heavy pages as Markdown or template-parsed JSON

    Not checked yet
    • 3 tools
    • Remote
    • Free trial
    • Web search and scraping
  13. Anti-bot-aware scraping: crawl, render, screenshot and unlock pages via one API

    Not checked yet
    • 5 tools
    • Remote
    • Free trial
    • Web search and scraping
  14. Structured Google, Bing and Brave search results for agents via the Autom SERP API

    Not checked yet
    • 6 tools
    • Remote
    • Free trial
    • Web search and scraping
  15. Website screenshots, PDF export, page content and AI analysis through one API

    Not checked yet
    • 6 tools
    • Remote
    • Free trial
    • Web search and scraping
  16. Search 1,500+ indie-made products as alternatives to big-name software from your AI

    Not checked yet
    • 4 tools
    • Remote
    • Free
    • Web search and scraping
  17. Search launched products, alternatives and weekly launch boards on MakerRadar

    Not checked yet
    • 14 tools
    • Remote
    • Free
    • Web search and scraping
  18. Drive the SEO Content Machine desktop app: crawls, scraping, Maps and workspace pages

    Runs locally
    • 23 tools
    • Free trial
    • Marketing and SEO
  19. Check domain availability and registrar prices and look up public domain records

    Not checked yet
    • 3 tools
    • Remote
    • Free
    • Web search and scraping
  20. Find songs by a remembered lyric or title and read lyrics from lyrics.com

    Runs locally
    • 3 tools
    • Free
    • Events and entertainment
  21. Oxylabs MCP server for scraping, Google and Amazon search and AI-driven crawling

    Not checked yet
    • 10 tools
    • Remote
    • Free trial
    • Web search and scraping
  22. Anonymous, no-key MCP server for SEO and AI crawler checks, robots.txt and llms.txt

    Not checked yet
    • 4 tools
    • Remote
    • Free
    • Web search and scraping
  23. Remote MCP server giving AI assistants free checks on websites, IPs, emails and domains

    Not checked yet
    • 7 tools
    • Remote
    • Free
    • Web search and scraping
  24. Structured JSON from 248 websites through three MCP tools and one API key

    Not checked yet
    • 3 tools
    • Remote
    • Free trial
    • Web search and scraping
  25. Query a 30-question benchmark of You.com, Tavily, Exa and Parallel search APIs

    Not checked yet
    • 12 tools
    • Remote
    • Free
    • Web search and scraping
  26. Keyless web search and page reading for agents using r.jina.ai, Wikipedia, HN and GitHub

    Not checked yet
    • 5 tools
    • Remote
    • Free
    • Web search and scraping
  27. Search a catalogue of MCP servers, agent skills and open-source AI projects

    Not checked yet
    • 3 tools
    • Remote
    • Free
    • Community directories
  28. Local research workspace that tracks sources, claims and gaps for your AI agent

    Runs locally
    • 5 tools
    • Free
    • Web search and scraping

See every kind of AI for web search and scraping: tools, agents, MCP servers and skills.Ranked: the best AI for web search and scraping.