Skip to content

AI tools, agents, MCP servers and skills for web search and scraping

1,212 MCP servers, 15 agent skills, 6 AI tools and 2 AI agents for web search and scraping, including Scrapling MCP Server, Competitor profiling and firecrawl. Each listing shows pricing, platforms and alternatives; use the kind links to see only one kind.

Showing 1–30 of 38

  1. MCP server for AI clients to scrape sites with HTTP and stealth browser sessions

    Runs locally
    • 17 tools
    • Open source
    • 104K GitHub stars
    • Web search and scraping
  2. Open-source research agent that writes cited reports from the web and your documents

    • Open source
    • Open-source agent
    • 30.8K GitHub stars
    • Research
  3. SearXNG Search

    MCP server

    MCP server for web search and page reading through a SearXNG instance

    Runs locally
    • 3 tools
    • Open source
    • 1.4K GitHub stars
    • Web search and scraping
  4. Browser engine and CLI built for agents that browse, extract and crawl at scale

    • Open source
    • Open-source agent
    • 1.2K GitHub stars
    • Browser automation
  5. Self-hosted browser agent that scrapes protected sites from a plain-English prompt

    • Open source
    • Open-source agent
    • 180 GitHub stars
    • Web search and scraping
  6. ResearchZosho

    MCP server

    Local deep research assistant that checks each citation and keeps what it finds

    Runs locally
    • Open source
    • Knowledge and memory
  7. Self-hosted Google Search Console MCP for analytics, URL inspection and sitemaps

    Not checked yet
    • Remote
    • Open source
    • Marketing and SEO
  8. OmniSeek

    MCP server

    Search podcasts, videos, Chinese forums and paper citations from your coding agent

    Not checked yet
    • Remote
    • Free
    • Web search and scraping
  9. Code Crawler

    MCP server

    Trace what really runs in Java, Python, TypeScript and JavaScript, with edge confidence

    Runs locally
    • 13 tools
    • Open source
    • Web search and scraping
  10. Search immunology and virology literature, trials and grants across six databases at once

    Not checked yet
    • 3 tools
    • Remote
    • Free
    • Health and science
  11. PyEuropePMC

    MCP server

    Europe PMC literature search, full text and export for AI agents (Python, MIT)

    Runs locally
    • Open source
    • Health and science
  12. Read-only Google Play data for agents: apps, charts, reviews, permissions and data safety

    Runs locally
    • 8 tools
    • Open source
    • E-commerce
  13. doc-scraper

    MCP server

    Crawl documentation sites into local Markdown that agents search offline

    Runs locally
    • 4 tools
    • Open source
    • Web search and scraping
  14. Remote MCP server that searches the MCP Harbor directory of MCP servers and agent tools

    Not checked yet
    • 2 tools
    • Remote
    • Open source
    • Developer tools
  15. OpenOSINT

    MCP server

    Passive-by-default OSINT lookups for AI agents: DNS, WHOIS, IP, breaches, Shodan and more

    Runs locally
    • 16 tools
    • Open source
    • Security
  16. Query your website change-tracking history and monitors in plain language

    Not checked yet
    • Remote
    • Open source
    • Productivity
  17. Turn any web page into clean Markdown with one tool, run locally with no API key

    Runs locally
    • 1 tool
    • Open source
    • Files and documents
  18. Rangefind

    MCP server

    Static-file search engine with an MCP server so AI agents can query prebuilt indexes

    Runs locally
    • 5 tools
    • Open source
    • 3 GitHub stars
    • Web search and scraping
  19. Free Search

    MCP server

    Keyless web search, page fetching and document reading that runs locally

    Runs locally
    • 11 tools
    • Open source
    • Web search and scraping
  20. Proxlane

    MCP server

    Web-fetch tool that returns block pages as failures, via your own Proxlane gateway

    Runs locally
    • 1 tool
    • Open source
    • Web search and scraping
  21. X Reader MCP

    MCP server

    Read public X posts and full X Articles as clean Markdown, with no X API key

    Not checked yet
    • 1 tool
    • Remote
    • Free
    • Web search and scraping
  22. searxNcrawl

    MCP server

    Open-source MCP server for web search via SearXNG or You.com and Markdown crawling

    Runs locally
    • 3 tools
    • Open source
    • Web search and scraping
  23. Crawlberg

    MCP server

    Open-source crawler that turns websites into Markdown and JSON, with a local MCP server

    Runs locally
    • Open source
    • Web search and scraping
  24. shortfree

    MCP server

    Checks live whether short .com, .ai, .io and other domains are free; suggests free ones

    Runs locally
    • Open source
    • Developer tools
  25. Flop Scout

    MCP server

    Search, page reading and FLOP miner rankings that AI agents pay for per call

    Not checked yet
    • Remote
    • Open source
    • Web search and scraping
  26. Look up people, places and organizations in Google's Knowledge Graph from Claude

    Runs locally
    • 2 tools
    • Open source
    • Knowledge and memory
  27. Honestkit MCP

    MCP server

    18 Apify-backed web data tools: WHOIS, DNS, SEO audits, app store ranks, company lookups

    Runs locally
    • 14 tools
    • Open source
    • Web search and scraping
  28. Check whether Chinese, Japanese and Korean page titles fit Google by pixel width

    Runs locally
    • 2 tools
    • Open source
    • Web search and scraping
  29. WebRouter

    MCP server

    Open source Python interface for web search, extraction and browsing across many providers

    Runs locally
    • Open source
    • Web search and scraping
  30. FrankenSurf

    MCP server

    Reads web pages with the cheapest tool that works, then checks the page is real

    Runs locally
    • Free
    • Web search and scraping