Skip to content

AI tools, agents, MCP servers and skills for web search and scraping

1,212 MCP servers, 15 agent skills, 6 AI tools and 2 AI agents for web search and scraping, including Scrapling MCP Server, Competitor profiling and firecrawl. Each listing shows pricing, platforms and alternatives; use the kind links to see only one kind.

Showing 1–30 of 205

  1. Web search, scraping and page interaction API for AI agents and developers

    • Freemium
    • Agent framework
    • 203K GitHub stars
    • Web search and scraping
  2. Web crawler and hosted API that turns URLs into LLM-ready Markdown or JSON

    • Freemium
    • Open-source agent
    • 87.5K GitHub stars
    • Web search and scraping
  3. Web API for agents: scrape, search, cloud browsers and task agents, billed in credits

    • Freemium
    • Open-source agent
    • 746 GitHub stars
    • Web search and scraping
  4. ChangePing

    MCP server

    Watch web pages from Claude or ChatGPT and read summaries of what changed

    Not checked yet
    • 7 tools
    • Remote
    • Freemium
    • Web search and scraping
  5. ClawGrab

    MCP server

    Fetch transcripts of public YouTube, TikTok, Vimeo and podcast links for AI use

    Runs locally
    • 6 tools
    • Freemium
    • Web search and scraping
  6. Turn YouTube captions, PDFs and web pages into clean Markdown for RAG

    • Remote
    • Freemium
    • Knowledge and memory
  7. Read Bluesky, Telegram, note.com and WeChat posts without logging in

    • Remote
    • Freemium
    • Web search and scraping
  8. Check which e-commerce stores publish a UCP profile and what it declares

    • Remote
    • Freemium
    • E-commerce
  9. YouTube transcripts, comments, video stats and channel monitoring for AI agents

    • 6 tools
    • Remote
    • Freemium
    • Design and media
  10. Paid web, OpenAPI and Base chain evidence for agents, billed per call in USDC

    • 12 tools
    • Remote
    • Freemium
    • Web search and scraping
  11. Browserless

    MCP server

    Give an assistant a cloud browser to scrape, search, crawl and audit pages

    • 5 tools
    • Remote
    • Freemium
    • Browser automation
  12. Search what was said on YouTube and podcasts and get quotes cued to the second

    • 4 tools
    • Remote
    • Freemium
    • Design and media
  13. SpecStream

    MCP server

    Web search, page extraction and structured live-web datasets for agents

    • 3 tools
    • Remote
    • Freemium
    • Web search and scraping
  14. QuietDiff

    MCP server

    Watch chosen fields on web pages and have an assistant create monitors and read changes

    • 9 tools
    • Remote
    • Freemium
    • Web search and scraping
  15. Site-Shot

    MCP server

    Website screenshots for AI agents: full page, ad and cookie-banner removal

    • Remote
    • Freemium
    • Web search and scraping
  16. FetchLayer

    MCP server

    Live data from Reddit, X, TikTok, app stores, ad libraries and 30+ more platforms

    • Remote
    • Freemium
    • Web search and scraping
  17. Konexium

    MCP server

    Research African companies from an assistant, with cited answers and spend approval

    Not checked yet
    • 2 tools
    • Remote
    • Freemium
    • Sales and CRM
  18. MeshArc

    MCP server

    Crawl and scrape sites to markdown, then ask what changed between runs

    Not checked yet
    • 6 tools
    • Remote
    • Freemium
    • Web search and scraping
  19. Post Reef

    MCP server

    Turn YouTube, TikTok, Instagram, Facebook, X and article URLs into transcripts and JSON

    • 6 tools
    • Remote
    • Freemium
    • Web search and scraping
  20. DataFluxor

    MCP server

    Remote MCP server for live Google results, SEO research and web scraping with credits

    • Remote
    • Freemium
    • Marketing and SEO
  21. PageVerified

    MCP server

    Web capture, MCP and x402 inspectors and a verified directory for agent tools

    • 34 tools
    • Remote
    • Freemium
    • Web search and scraping
  22. Export public Bluesky posts by keyword or handle without a login, as JSON or CSV

    Not checked yet
    • Remote
    • Freemium
    • Web search and scraping
  23. CORDON

    MCP server

    Reads web pages for agents as clean markdown with hidden instructions stripped

    Not checked yet
    • 2 tools
    • Remote
    • Freemium
    • Security
  24. CRW Web Scraper

    MCP server

    Open-source web scraper for agents with scrape, crawl, map and search tools

    Runs locally
    • 3 tools
    • Freemium
    • Web search and scraping
  25. NestDaddy

    MCP server

    Live web and news search, full article text and research papers for agents on a flat plan

    Not checked yet
    • 9 tools
    • Remote
    • Freemium
    • Web search and scraping