
Web search, scraping and page interaction API for AI agents and developers
- Freemium
- Agent framework
- 202K GitHub stars
- Web search and scraping

Web search, scraping and page interaction API for AI agents and developers

Web crawler and hosted API that turns URLs into LLM-ready Markdown or JSON

Web API for agents: scrape, search, cloud browsers and task agents, billed in credits
Watch web pages from Claude or ChatGPT and read summaries of what changed
Not checked yetFetch transcripts of public YouTube, TikTok, Vimeo and podcast links for AI use
Runs locallyTurn YouTube captions, PDFs and web pages into clean Markdown for RAG
Read Bluesky, Telegram, note.com and WeChat posts without logging in
Check which e-commerce stores publish a UCP profile and what it declares
YouTube transcripts, comments, video stats and channel monitoring for AI agents
Search HiringCafe jobs by title, place and pay, with employer apply links
Paid web, OpenAPI and Base chain evidence for agents, billed per call in USDC
Search every Ashby job board at once, newest first, with optional salary and details
Search every Cornerstone OnDemand career site at once, newest jobs first
Search every Greenhouse job board at once, with salary ranges and posting dates
Give an assistant a cloud browser to scrape, search, crawl and audit pages
Search what was said on YouTube and podcasts and get quotes cued to the second
Web search, page extraction and structured live-web datasets for agents
Website screenshots for AI agents: full page, ad and cookie-banner removal
Watch chosen fields on web pages and have an assistant create monitors and read changes
Live data from Reddit, X, TikTok, app stores, ad libraries and 30+ more platforms
Research African companies from an assistant, with cited answers and spend approval
Not checked yetCrawl and scrape sites to markdown, then ask what changed between runs
Not checked yetTurn YouTube, TikTok, Instagram, Facebook, X and article URLs into transcripts and JSON
Remote MCP server for live Google results, SEO research and web scraping with credits
Web capture, MCP and x402 inspectors and a verified directory for agent tools
Export public Bluesky posts by keyword or handle without a login, as JSON or CSV
Not checked yetSearch Hacker News stories, comments, Ask HN and Show HN, filtered by points and date
Not checked yet
Reads web pages for agents as clean markdown with hidden instructions stripped
Not checked yetOpen-source web scraper for agents with scrape, crawl, map and search tools
Runs locally
Live web and news search, full article text and research papers for agents on a flat plan
Not checked yet