
MCP server for AI clients to scrape sites with HTTP and stealth browser sessions
Runs locally- 17 tools
- Open source
- 104K GitHub stars
- Web search and scraping

MCP server for AI clients to scrape sites with HTTP and stealth browser sessions
Runs locally
MCP server for web search and page reading through a SearXNG instance
Runs locallySearch Console clicks, positions, URL inspection and sitemaps for your AI agent
Runs locallyLocal deep research assistant that checks each citation and keeps what it finds
Runs locallyFetch web pages as markdown with SSRF protection, reader mode, feeds and robots checks
Runs locallySelf-hosted Google Search Console MCP for analytics, URL inspection and sitemaps
Not checked yetTrace what really runs in Java, Python, TypeScript and JavaScript, with edge confidence
Runs locallyEurope PMC literature search, full text and export for AI agents (Python, MIT)
Runs locallyRead-only Google Play data for agents: apps, charts, reviews, permissions and data safety
Runs locallyCrawl documentation sites into local Markdown that agents search offline
Runs locallyBrowse login-protected and JavaScript-heavy pages through your own Chrome, Edge or Brave
Runs locallyTurns web pages and PDFs into cached Markdown outlines read one section at a time
Runs locallyRemote MCP server that searches the MCP Harbor directory of MCP servers and agent tools
Not checked yetPassive-by-default OSINT lookups for AI agents: DNS, WHOIS, IP, breaches, Shodan and more
Runs locallyQuery your website change-tracking history and monitors in plain language
Not checked yetLocal, read-only Google Search Console tools for traffic, indexing and sitemap checks
Runs locallyWeb research for agents that returns cited claims with confidence scores
Runs locallyTurn any web page into clean Markdown with one tool, run locally with no API key
Runs locallyStatic-file search engine with an MCP server so AI agents can query prebuilt indexes
Runs locallyDocker-run MCP server for finding public emails and subdomains of a domain
Runs locallyDocker-run MCP server that identifies the CMS, server and frameworks behind a website
Runs locallyKeyless web search, page fetching and document reading that runs locally
Runs locallyWeb-fetch tool that returns block pages as failures, via your own Proxlane gateway
Runs locallyOpen-source MCP server for web search via SearXNG or You.com and Markdown crawling
Runs locallyOpen-source crawler that turns websites into Markdown and JSON, with a local MCP server
Runs locallyChecks live whether short .com, .ai, .io and other domains are free; suggests free ones
Runs locallySearch, page reading and FLOP miner rankings that AI agents pay for per call
Not checked yet
Look up people, places and organizations in Google's Knowledge Graph from Claude
Runs locally18 Apify-backed web data tools: WHOIS, DNS, SEO audits, app store ranks, company lookups
Runs locallyCheck whether Chinese, Japanese and Korean page titles fit Google by pixel width
Runs locallySee every kind of AI for web search and scraping: tools, agents, MCP servers and skills.Ranked: the best AI for web search and scraping.