
Web search, scraping and page interaction API for AI agents and developers
- Freemium
- Agent framework
- 203K GitHub stars
- Web search and scraping

Web search, scraping and page interaction API for AI agents and developers

Web crawler and hosted API that turns URLs into LLM-ready Markdown or JSON

MCP server that lets AI agents search, scrape and interact with web pages
Turn YouTube captions, PDFs and web pages into clean Markdown for RAG
Turn audio, images, PDFs, video and web pages into text an agent can read
Pay-per-call URL-to-Markdown, B2B enrichment and bounty feeds for agents via x402
Pay-per-call web and data utilities for agents: page to Markdown, RSS, CSV and JSON
31 web scraping, search and research tools that return clean Markdown or JSON
Runs locallyCrawl and scrape sites to markdown, then ask what changed between runs
Not checked yetFetch web pages as clean Markdown for agents, honouring robots.txt and noai
Runs locallyOfficial SerpApi server: Google, Bing and other search results as JSON or Markdown

Reads web pages for agents as clean markdown with hidden instructions stripped
Not checked yetOpen-source web scraper for agents with scrape, crawl, map and search tools
Runs locallyWeb scraping, mapping and crawling MCP server that returns clean Markdown
Not checked yet
Remote MCP endpoint for Olostep's search, scrape and crawl API
Not checked yetEmail address checks, URL uptime pings and page-to-markdown reading for agents
Not checked yetHosted MCP tool that fetches a public web page live and returns Markdown, text or HTML
Not checked yetGives agents live page content from any public URL, with actionable error messages
Not checked yetLive page-to-Markdown fetch for agents, billed per page with rendering surcharges
Not checked yetRemote fetch tool for agents: one URL, a bearer key and a stateless HTTP transport
Not checked yetWeb page retrieval for LLM context, with six paid tiers and a no-card free test
Not checked yetRemote MCP server that fetches live web pages as Markdown, text or HTML for agents
Not checked yetMCPScraper API: hosted MCP tool that turns any public URL into Markdown, text or HTML
Not checked yetScrape any URL to Markdown or JSON, with JavaScript rendering and batch jobs
Not checked yetRemote MCP tools to turn web pages into Markdown and pull contacts, reviews and jobs
Not checked yetTurns a web page URL or raw HTML into clean Markdown or plain text for an LLM
Not checked yetRemote MCP server that turns web pages into Markdown, screenshots, metadata and RDAP
Not checked yetTurn any web page into clean Markdown plus product, table and metadata JSON
Not checked yetWeb fetch for agents that checks pages for blocks and empty shells, bills only on success
Not checked yetGive your agent a real Chrome for screenshots, Markdown, PDFs and phone-size page checks
Not checked yet