
MCP server for AI clients to scrape sites with HTTP and stealth browser sessions
Runs locally- 17 tools
- Open source
- 104K GitHub stars
- Web search and scraping

MCP server for AI clients to scrape sites with HTTP and stealth browser sessions
Runs locally
MCP server for web search and page reading through a SearXNG instance
Runs locallyStructured Google and Bing search results for agents, with recoverable requests
Runs locallySearch and safety-check x402 APIs, MCP servers and A2A agents by intent
Turn any website, GitHub repo, PDF or video link into llms.txt or llms-full.txt

Fetch pages and search the web through a Singapore 4G/5G mobile IP from your agent
Live JSON from sites with no API, plus agent-built APIs for any website
Runs locallyAsk an agent what a website is: AI builder traces, tech stack, traffic rank and trust
Search Console clicks, positions, URL inspection and sitemaps for your AI agent
Runs locallyHosted and open-source web scraper that returns clean Markdown with change tracking
Local deep research assistant that checks each citation and keeps what it finds
Runs locallyOne MCP server for web search, page extraction, crawling and platform scraping
Hourly-checked free HTTP and SOCKS proxy lists with a CLI and MCP tools to fetch pages
Runs locallyFetch web pages as markdown with SSRF protection, reader mode, feeds and robots checks
Runs locallySelf-hosted Google Search Console MCP for analytics, URL inspection and sitemaps
Not checked yetPull Google Maps, reviews, web pages and public LinkedIn data into your assistant
Runs locallySearch podcasts, videos, Chinese forums and paper citations from your coding agent
Not checked yetTrace what really runs in Java, Python, TypeScript and JavaScript, with edge confidence
Runs locallyCited research answers with source budgets and visible USDC payment states
Not checked yetFetch bot-protected and JavaScript-heavy pages as Markdown or template-parsed JSON
Not checked yetEurope PMC literature search, full text and export for AI agents (Python, MIT)
Runs locallyRead-only Google Play data for agents: apps, charts, reviews, permissions and data safety
Runs locallyCrawl documentation sites into local Markdown that agents search offline
Runs locallyBrowse login-protected and JavaScript-heavy pages through your own Chrome, Edge or Brave
Runs locallyTurns web pages and PDFs into cached Markdown outlines read one section at a time
Runs locallyAnti-bot-aware scraping: crawl, render, screenshot and unlock pages via one API
Not checked yetStructured Google, Bing and Brave search results for agents via the Autom SERP API
Not checked yet
Website screenshots, PDF export, page content and AI analysis through one API
Not checked yet
Search 1,500+ indie-made products as alternatives to big-name software from your AI
Not checked yetPassive-by-default OSINT lookups for AI agents: DNS, WHOIS, IP, breaches, Shodan and more
Runs locallySee every kind of AI for web search and scraping: tools, agents, MCP servers and skills.Ranked: the best AI for web search and scraping.