
Web search, scraping and page interaction API for AI agents and developers
- Freemium
- Agent framework
- 203K GitHub stars
- Web search and scraping

Web search, scraping and page interaction API for AI agents and developers

Web crawler and hosted API that turns URLs into LLM-ready Markdown or JSON
Read public X Articles, video transcripts and posts as plain text, no account needed
Turn YouTube captions, PDFs and web pages into clean Markdown for RAG
Crawl and scrape sites to markdown, then ask what changed between runs
Not checked yet
Reads web pages for agents as clean markdown with hidden instructions stripped
Not checked yetTurn any web page into clean Markdown, design tokens and a link list for LLMs
Not checked yetOpen-source web scraper for agents with scrape, crawl, map and search tools
Runs locally
Remote MCP endpoint for Olostep's search, scrape and crawl API
Not checked yetHosted MCP tool that fetches a public web page live and returns Markdown, text or HTML
Not checked yetGives agents live page content from any public URL, with actionable error messages
Not checked yetLive page-to-Markdown fetch for agents, billed per page with rendering surcharges
Not checked yetRemote fetch tool for agents: one URL, a bearer key and a stateless HTTP transport
Not checked yetWeb page retrieval for LLM context, with six paid tiers and a no-card free test
Not checked yetScrape any URL to Markdown or JSON, with JavaScript rendering and batch jobs
Not checked yetRemote MCP tools to turn web pages into Markdown and pull contacts, reviews and jobs
Not checked yetPay-per-request screenshots, page-to-Markdown or PDF and Nostr relay tests via Lightning
Not checked yetGive your agent a real Chrome for screenshots, Markdown, PDFs and phone-size page checks
Not checked yetTurn pages or whole sites into clean Markdown or JSON for LLM and RAG pipelines
Not checked yetThree pay-per-run Apify actors for bulk email checks, DNS facts and URL-to-Markdown
Not checked yetTurn web pages, PDFs, JSON and CSV into clean Markdown for agents, with free daily reads
Not checked yetA free URL-to-Markdown reader for agents, plus a public message board they post to
Not checked yetFetch any public web page as clean Markdown or structured metadata, paid per call
Not checked yetWeb access MCP server for searching the web, fetching URLs and mapping sites as Markdown
Not checked yet
Scrape, crawl and search the web, and run browser agents, from any MCP client
Not checked yetPay per fetch in USDC to turn web pages into clean markdown or structured JSON
Not checked yetHosted MCP server that turns any public web page into clean Markdown for an assistant
Not checked yet
Convert web pages, PDFs and small sites into clean Markdown with chunks for RAG
Not checked yetURL intelligence MCP server for link previews, Markdown extraction, screenshots and audits
Not checked yetTurns web pages and PDFs into clean Markdown and strips hidden prompt-injection text
Not checked yet