
MCP server for AI clients to scrape sites with HTTP and stealth browser sessions
Runs locally- 17 tools
- Open source
- 104K GitHub stars
- Web search and scraping

MCP server for AI clients to scrape sites with HTTP and stealth browser sessions
Runs locally
MCP server for web search and page reading through a SearXNG instance
Runs locallySearch Console clicks, positions, URL inspection and sitemaps for your AI agent
Runs locallyLocal deep research assistant that checks each citation and keeps what it finds
Runs locallyFetch web pages as markdown with SSRF protection, reader mode, feeds and robots checks
Runs locallySelf-hosted Google Search Console MCP for analytics, URL inspection and sitemaps
Not checked yetTrace what really runs in Java, Python, TypeScript and JavaScript, with edge confidence
Runs locallyEurope PMC literature search, full text and export for AI agents (Python, MIT)
Runs locallyRead-only Google Play data for agents: apps, charts, reviews, permissions and data safety
Runs locallyCrawl documentation sites into local Markdown that agents search offline
Runs locallyBrowse login-protected and JavaScript-heavy pages through your own Chrome, Edge or Brave
Runs locallyTurns web pages and PDFs into cached Markdown outlines read one section at a time
Runs locallyPassive-by-default OSINT lookups for AI agents: DNS, WHOIS, IP, breaches, Shodan and more
Runs locallyLocal, read-only Google Search Console tools for traffic, indexing and sitemap checks
Runs locallyWeb research for agents that returns cited claims with confidence scores
Runs locallyTurn any web page into clean Markdown with one tool, run locally with no API key
Runs locallyDocker-run MCP server for finding public emails and subdomains of a domain
Runs locallyDocker-run MCP server that identifies the CMS, server and frameworks behind a website
Runs locallyKeyless web search, page fetching and document reading that runs locally
Runs locallyWeb-fetch tool that returns block pages as failures, via your own Proxlane gateway
Runs locallyOpen-source MCP server for web search via SearXNG or You.com and Markdown crawling
Runs locallyOpen-source crawler that turns websites into Markdown and JSON, with a local MCP server
Runs locallyChecks live whether short .com, .ai, .io and other domains are free; suggests free ones
Runs locally
Look up people, places and organizations in Google's Knowledge Graph from Claude
Runs locally18 Apify-backed web data tools: WHOIS, DNS, SEO audits, app store ranks, company lookups
Runs locallyCheck whether Chinese, Japanese and Korean page titles fit Google by pixel width
Runs locallyOne AI interface to Search Console, Bing, GA4 and AdSense data, with multi-account support
Runs locallyShows which page text AI crawlers miss because it only appears after JavaScript runs
Runs locallyBulk domain availability checker for AI assistants, with prices at nine registrars
Runs locallySelf-hosted SEO crawler with AI-crawler checks that assistants can drive over MCP
Runs locallySee every kind of AI for web search and scraping: tools, agents, MCP servers and skills.Ranked: the best AI for web search and scraping.