Skip to content

AI for web search and scraping

759 AI tools, agents, MCP servers and skills for web search and scraping, with pricing, platforms and alternatives for each.

Showing 1–30 of 759

  1. Web search, scraping and page interaction API for AI agents and developers

    • Freemium
    • Agent framework
    • 202K GitHub stars
    • Web search and scraping
  2. Web crawler and hosted API that turns URLs into LLM-ready Markdown or JSON

    • Freemium
    • Open-source agent
    • 87.5K GitHub stars
    • Web search and scraping
  3. MCP server that lets AI agents search, scrape and interact with web pages

    • 3 tools
    • Remote
    • Freemium
    • 7.8K GitHub stars
    • Web search and scraping
  4. Web API for agents: scrape, search, cloud browsers and task agents, billed in credits

    • Freemium
    • Open-source agent
    • 745 GitHub stars
    • Web search and scraping
  5. Hosted MCP server that returns any Shopify store's products, prices and stock

    Not checked yet
    • 4 tools
    • Remote
    • Paid
    • E-commerce
  6. EuroScrape

    MCP server

    European flight, hotel, power-price, marketplace and company data tools for agents

    Runs locally
    • 13 tools
    • Paid
    • Web search and scraping
  7. API Pick

    MCP server

    27 pay-per-call search tools: web, news, SEC, patents, clinical and more

    • 27 tools
    • Remote
    • Paid
    • Web search and scraping
  8. ChangePing

    MCP server

    Watch web pages from Claude or ChatGPT and read summaries of what changed

    Not checked yet
    • 7 tools
    • Remote
    • Freemium
    • Web search and scraping
  9. ClawGrab

    MCP server

    Fetch transcripts of public YouTube, TikTok, Vimeo and podcast links for AI use

    Runs locally
    • 6 tools
    • Freemium
    • Web search and scraping
  10. Pay-per-call tools for chain data, sanctions screening, web reading and PDFs

    • 15 tools
    • Remote
    • Freemium
    • Web search and scraping
  11. llms.ink

    MCP server

    Turn any website, GitHub repo, PDF or video link into llms.txt or llms-full.txt

    • 7 tools
    • Remote
    • Free
    • AI models and LLM tooling
  12. Search a catalogue of Apify Actors and n8n recipes for web-data jobs

    • 8 tools
    • Remote
    • Free
    • Web search and scraping
  13. Scraper Finder

    MCP server

    Look up the official API and ranked scraping tools for 172 websites

    • 3 tools
    • Remote
    • Free
    • Web search and scraping
  14. Pull Google Maps places with phone, website, rating and hours into your AI chat

    • 5 tools
    • Remote
    • Paid
    • Maps and travel
  15. Reverse image search through Yandex: matching pages, similar images and shop products

    • 5 tools
    • Remote
    • Paid
    • Design and media
  16. Bing Copilot

    MCP server

    Get Bing's Copilot answer for a query, with cited sources and brand mentions

    • 5 tools
    • Remote
    • Paid
    • Web search and scraping
  17. x-toolkit

    MCP server

    Read public X Articles, video transcripts and posts as plain text, no account needed

    • 4 tools
    • Remote
    • Free
    • Web search and scraping
  18. ExtractHub

    MCP server

    Remote MCP server that runs versioned web scrapers on a URL and returns JSON

    • 25 tools
    • Remote
    • Paid
    • Web search and scraping
  19. Hosted MCP server for capturing screenshots and page text through ApiFlash

    • 3 tools
    • Remote
    • Freemium
    • Browser automation
  20. CheckAnySite

    MCP server

    Ask an agent what a website is: AI builder traces, tech stack, traffic rank and trust

    • 6 tools
    • Remote
    • Free
    • Analytics and data
  21. Pay-per-call crypto token risk, web and developer data tools for agents, paid with x402

    • 136 tools
    • Remote
    • Paid
    • Analytics and data
  22. Turn YouTube captions, PDFs and web pages into clean Markdown for RAG

    • Remote
    • Freemium
    • Knowledge and memory
  23. Read Bluesky, Telegram, note.com and WeChat posts without logging in

    • Remote
    • Freemium
    • Web search and scraping
  24. Read public Telegram channel posts with views, reactions and media, no login

    • Remote
    • Paid
    • Communication
  25. Track EU TikTok Ad Library ads by advertiser or keyword, with change status

    • Remote
    • Paid
    • Marketing and SEO