Skip to content

AI tools, agents, MCP servers and skills for web search and scraping

1,168 MCP servers, 10 agent skills, 6 AI tools and 2 AI agents for web search and scraping, including Scrapling MCP Server, firecrawl and Firecrawl MCP Server. Each listing shows pricing, platforms and alternatives; use the kind links to see only one kind.

Showing 1–30 of 109

  1. MCP server for AI clients to scrape sites with HTTP and stealth browser sessions

    Runs locally
    • 17 tools
    • Open source
    • 104K GitHub stars
    • Web search and scraping
  2. Command-line channels that let AI agents read X, Reddit, YouTube and Chinese platforms

    • Open source
    • Open-source agent
    • 112K GitHub stars
    • AI models and LLM tooling
  3. Browser automation CLI that drives your logged-in Chrome, with reusable site commands

    • Open source
    • Open-source agent
    • 31.1K GitHub stars
    • Browser automation
  4. Open-source research agent that writes cited reports from the web and your documents

    • Open source
    • Open-source agent
    • 30.7K GitHub stars
    • Research
  5. SearXNG Search

    MCP server

    MCP server for web search and page reading through a SearXNG instance

    Runs locally
    • 3 tools
    • Open source
    • 1.4K GitHub stars
    • Web search and scraping
  6. Browser engine and CLI built for agents that browse, extract and crawl at scale

    • Open source
    • Open-source agent
    • 1.2K GitHub stars
    • Browser automation
  7. EuroScrape

    MCP server

    European flight, hotel, power-price, marketplace and company data tools for agents

    Runs locally
    • 13 tools
    • Paid
    • Web search and scraping
  8. llms.ink

    MCP server

    Turn any website, GitHub repo, PDF or video link into llms.txt or llms-full.txt

    • 7 tools
    • Remote
    • Free
    • AI models and LLM tooling
  9. CheckAnySite

    MCP server

    Ask an agent what a website is: AI builder traces, tech stack, traffic rank and trust

    • 6 tools
    • Remote
    • Free
    • Analytics and data
  10. Search Console clicks, positions, URL inspection and sitemaps for your AI agent

    Runs locally
    • 8 tools
    • Open source
    • Web search and scraping
  11. ResearchZosho

    MCP server

    Local deep research assistant that checks each citation and keeps what it finds

    Runs locally
    • Open source
    • Knowledge and memory
  12. okdata

    MCP server

    Pay-per-call social data from Douyin, Xiaohongshu, TikTok, X, YouTube and more

    • 5 tools
    • Remote
    • Paid
    • Web search and scraping
  13. proxy-scraper

    MCP server

    Hourly-checked free HTTP and SOCKS proxy lists with a CLI and MCP tools to fetch pages

    Runs locally
    • Free
    • Web search and scraping
  14. RedditAPIs

    MCP server

    Reddit search, comments, users and monitors as 61 pay-per-call MCP tools

    Not checked yet
    • 1 tool
    • Remote
    • Paid
    • Web search and scraping
  15. Fetch web pages as markdown with SSRF protection, reader mode, feeds and robots checks

    Runs locally
    • 15 tools
    • Open source
    • Web search and scraping
  16. Self-hosted Google Search Console MCP for analytics, URL inspection and sitemaps

    Not checked yet
    • Remote
    • Open source
    • Marketing and SEO
  17. OmniSeek

    MCP server

    Search podcasts, videos, Chinese forums and paper citations from your coding agent

    Not checked yet
    • Remote
    • Free
    • Web search and scraping
  18. Code Crawler

    MCP server

    Trace what really runs in Java, Python, TypeScript and JavaScript, with edge confidence

    Runs locally
    • 13 tools
    • Open source
    • Web search and scraping
  19. apinoa

    MCP server

    One key for Amazon, TikTok, Google and AI-answer data, as MCP tools or sandboxed code

    Not checked yet
    • 10 tools
    • Remote
    • Paid
    • Web search and scraping
  20. Copyseeker

    MCP server

    Reverse image search, AI-image and NSFW detection tools for your assistant

    Runs locally
    • 3 tools
    • Paid
    • Web search and scraping
  21. UpRock

    MCP server

    Fetch pages, search the web and search video from real devices in chosen countries

    Not checked yet
    • 1 tool
    • Remote
    • Paid
    • Web search and scraping
  22. TwitterAPIs

    MCP server

    X (Twitter) search, profiles, followers, posting and monitors through 120 MCP tools

    Not checked yet
    • 7 tools
    • Remote
    • Paid
    • Marketing and SEO
  23. PyEuropePMC

    MCP server

    Europe PMC literature search, full text and export for AI agents (Python, MIT)

    Runs locally
    • Open source
    • Health and science
  24. Read-only Google Play data for agents: apps, charts, reviews, permissions and data safety

    Runs locally
    • 8 tools
    • Open source
    • E-commerce