
Web search, scraping and page interaction API for AI agents and developers
- Freemium
- Agent framework
- 202K GitHub stars
- Web search and scraping

Web search, scraping and page interaction API for AI agents and developers

Web crawler and hosted API that turns URLs into LLM-ready Markdown or JSON

Open-source research agent that writes cited reports from the web and your documents

Web API for agents: scrape, search, cloud browsers and task agents, billed in credits

Self-hosted browser agent that scrapes protected sites from a plain-English prompt
Pull every video of a YouTube channel with stats via the official API, pay per video
Search YouTube and pull trending charts with stats through your own API key
Bulk YouTube video stats and growth tracking from links or playlists via your own key
27 pay-per-call search tools: web, news, SEC, patents, clinical and more
Watch web pages from Claude or ChatGPT and read summaries of what changed
Not checked yetFetch transcripts of public YouTube, TikTok, Vimeo and podcast links for AI use
Runs locally
Pull open jobs from Greenhouse and Lever company boards through Apify
Turn any website, GitHub repo, PDF or video link into llms.txt or llms-full.txt
Read public X Articles, video transcripts and posts as plain text, no account needed
Ask an agent what a website is: AI builder traces, tech stack, traffic rank and trust
Turn YouTube captions, PDFs and web pages into clean Markdown for RAG
Read Bluesky, Telegram, note.com and WeChat posts without logging in
Read public Telegram channel posts with views, reactions and media, no login
Track EU TikTok Ad Library ads by advertiser or keyword, with change status
Check which e-commerce stores publish a UCP profile and what it declares
Track brand mentions and citations in ChatGPT, Perplexity, Claude and Grok answers
Crawl a site for broken links, redirects, title and canonical issues, 37 checks
YouTube transcripts, comments, video stats and channel monitoring for AI agents
Search a free directory of MCP servers and x402 services, or list your own
Search 18 job boards at once for remote and worldwide jobs, via Apify
Search HiringCafe jobs by title, place and pay, with employer apply links
Paid web, OpenAPI and Base chain evidence for agents, billed per call in USDC
Search every Ashby job board at once, newest first, with optional salary and details
Search every Cornerstone OnDemand career site at once, newest jobs first
Live finance, banking and quant job search across eFinancialCareers, run through Apify