Skip to content

MCP servers for web search and scraping

1,469 MCP servers that give AI live web search, page fetching and structured data extraction. Each one shows how to install it in Claude, Cursor and VS Code, whether it runs locally or remotely, and the tools it provides.
  1. Read public X posts and full X Articles as clean Markdown, with no X API key

    Not checked yet
    • 1 tool
    • Remote
    • Free
    • Web search and scraping
  2. Scrape public posts and videos from Bluesky, Telegram, Substack, Dailymotion and Likee

    Not checked yet
    • Remote
    • Freemium
    • Web search and scraping
  3. Fetch public web pages as numbered, quotable paragraphs with integrity hashes

    Not checked yet
    • 3 tools
    • Remote
    • Freemium
    • Web search and scraping
  4. EU-hosted web search from an independent German-language index, with an English tech mode

    Not checked yet
    • 1 tool
    • Remote
    • Freemium
    • Web search and scraping
  5. Search new software launches and daily upvote rankings from your AI assistant

    Not checked yet
    • 10 tools
    • Remote
    • Free
    • Web search and scraping
  6. Look up conference and journal deadlines, CCF and CORE rankings and acceptance rates

    Not checked yet
    • 8 tools
    • Remote
    • Free
    • Web search and scraping
  7. Open-source MCP server for web search via SearXNG or You.com and Markdown crawling

    Runs locally
    • 3 tools
    • Open source
    • Web search and scraping
  8. Read YouTube transcripts and research across videos from Claude or ChatGPT

    Not checked yet
    • 1 tool
    • Remote
    • Freemium
    • Design and media
  9. Checks whether a page may be used, then reads it as Markdown or JSON for agents

    Not checked yet
    • 7 tools
    • Remote
    • Freemium
    • Web search and scraping
  10. Official registers as MCP tools: EU/US tenders, NPI providers, Companies House, Mexico

    Not checked yet
    • 7 tools
    • Remote
    • Freemium
    • Analytics and data
  11. Collect Coupang rankings and Korean public web data through ready-made data bots

    Runs locally
    • 7 tools
    • Freemium
    • Web search and scraping
  12. Read public Facebook Pages, groups, Marketplace and Ad Library ads with no login

    Not checked yet
    • 1 tool
    • Remote
    • Free trial
    • Marketing and SEO
  13. Read public Instagram profiles, posts, reels, hashtags and locations without logging in

    Not checked yet
    • 1 tool
    • Remote
    • Free trial
    • Marketing and SEO
  14. Read-only LinkedIn profiles, companies, jobs and posts without using your own account

    Not checked yet
    • 1 tool
    • Remote
    • Free trial
    • Sales and CRM
  15. Search Reddit and read posts, comments, subreddits and user histories with no Reddit app

    Not checked yet
    • 1 tool
    • Remote
    • Free trial
    • Marketing and SEO
  16. Public data from X, LinkedIn, Instagram, TikTok, YouTube, Reddit and Facebook

    Not checked yet
    • 5 tools
    • Remote
    • Free trial
    • Marketing and SEO
  17. Map a site, scrape pages to markdown or JSON, and search the web from an AI client

    Not checked yet
    • 2 tools
    • Remote
    • Free trial
    • Web search and scraping
  18. Fetch YouTube transcripts with timestamps, channels, comments and search

    Not checked yet
    • 1 tool
    • Remote
    • Free trial
    • Design and media
  19. Google SERP, maps, news and AI-assistant answers for agents over one API key

    Not checked yet
    • Remote
    • Freemium
    • Web search and scraping
  20. Check if a site allows scraping, and get an extraction plan, before an agent fetches it

    Not checked yet
    • 8 tools
    • Remote
    • Free
    • Web search and scraping
  21. Dated residential proxy prices, terms and sourcing checks for 30 providers

    Not checked yet
    • 7 tools
    • Remote
    • Free
    • Web search and scraping
  22. Pay-per-call web reading, search, fact-checks and token screening for agents, in USDC

    Runs locally
    • 7 tools
    • Paid
    • Web search and scraping
  23. Live job postings from Greenhouse, Lever, Workday, Ashby and other career sites

    Not checked yet
    • 3 tools
    • Remote
    • Freemium
    • Hiring and recruiting
  24. Web search, page fetch, AI extraction and cited research reports for agents

    Not checked yet
    • 6 tools
    • Remote
    • Freemium
    • Web search and scraping
  25. Free web search, business records and travel data for local AI agents

    Not checked yet
    • 4 tools
    • Remote
    • Free
    • Maps and travel
  26. Web search, scraping and data endpoints for agents, priced per successful call

    Not checked yet
    • 1 tool
    • Remote
    • Freemium
    • Design and media
  27. Persistent identity, memory, headless browser and research for stateless agents

    Not checked yet
    • 11 tools
    • Remote
    • Freemium
    • Browser automation

See every kind of AI for web search and scraping: tools, agents, MCP servers and skills.Ranked: the best AI for web search and scraping.