Skip to content

AI tools, agents, MCP servers and skills for web search and scraping

1,372 MCP servers, 15 agent skills, 9 AI tools and 2 AI agents for web search and scraping, including Scrapling MCP Server, Competitor profiling and firecrawl. Each listing shows pricing, platforms and alternatives; use the kind links to see only one kind.

Showing 1,321–1,350 of 1,398

  1. AI-agent web search, answer-ready content. Beats Tavily: 60.7% of quality duels, 20.2%…

    Not checked yet
    • Remote
    • Open source
    • Web search and scraping
  2. Google Search Console for AI agents: search analytics, sitemaps, URL inspection.

    Runs locally
    • Open source
    • Web search and scraping
  3. Multi-step web research with citations via Perplexity's Agent API. Standard library only.

    Runs locally
    • Open source
    • Web search and scraping
  4. WebReaper

    MCP server

    AI-native web scraper: scrape, crawl and map any site to clean markdown over stdio…

    Runs locally
    • Open source
    • Web search and scraping
  5. fastCRW

    MCP server

    Scrape, crawl, map & search the web. Open-source, self-hostable Rust crawler & search…

    Not checked yet
    • Remote
    • Web search and scraping
  6. Search rankings, clicks, and indexing for your site — in chat.

    Not checked yet
    • Remote
    • Web search and scraping
  7. One Search MCP

    MCP server

    Web search, URL discovery, scraping & extraction with agent-browser and search providers

    Runs locally
    • Open source
    • Web search and scraping
  8. MESSORA

    MCP server

    Scrape, crawl and search the web for AI agents via MCP.

    Not checked yet
    • Remote
    • Web search and scraping
  9. Scraper API

    MCP server

    One API for public web data across social, directories and real estate, as clean JSON.

    Not checked yet
    • Remote
    • Web search and scraping
  10. Web Search

    MCP server

    Keyless multi-engine web search, fetch, and clean-Markdown read for AI agents. No API…

    Runs locally
    • Open source
    • Web search and scraping
  11. NVIDIA Nemotron + Perplexity Sonar as knowledge graphs — 2 domains, 83 nodes. MCP-native.

    Runs locally
    • Open source
    • Web search and scraping
  12. CN Scraper MCP

    MCP server

    MCP server for AI agents to search major Chinese internet platforms with local-first…

    Runs locally
    • Open source
    • Web search and scraping
  13. 1 Google Search endpoints. Pay per call in USDC via x402.

    Not checked yet
    • Remote
    • Web search and scraping
  14. Real-time web search, reasoning, and research through Perplexity's API

    Runs locally
    • Web search and scraping
  15. AgentScrape

    MCP server

    Pay-per-call web scraping for AI agents via x402 on Base USDC. Six tools, no signup.

    Not checked yet
    • Remote
    • Web search and scraping
  16. Apexapi MCP

    MCP server

    Call 120+ AI models and live web context (scrape/crawl/extract) from any MCP client with…

    Runs locally
    • Open source
    • Web search and scraping
  17. Metalift

    MCP server

    Metalift MCP for AI agents: web search (2 credits), scrape, crawl, and map tools

    Runs locally
    • Open source
    • Web search and scraping
  18. Web Search

    MCP server

    Web search for AI agents — one tool across 6 engines, routed to the cheapest + cached.

    Not checked yet
    • Remote
    • Web search and scraping
  19. Spider Cloud

    MCP server

    Crawl, scrape, search the web, and automate browsers at scale with anti-bot bypass.

    Not checked yet
    • Remote
    • Web search and scraping
  20. Kreuzcrawl

    MCP server

    Scrape, crawl, and map websites to Markdown or JSON via local CLI.

    Runs locally
    • Open source
    • Web search and scraping
  21. Auxiliar MCP

    MCP server

    Web access for AI agents — search/scrape/extract/crawl via the auxiliar.ai gateway.

    Runs locally
    • Open source
    • Web search and scraping
  22. Track brand mentions & keywords on Bluesky. Sentiment, engagement, author reach. Pay per…

    Not checked yet
    • Remote
    • Web search and scraping
  23. Bulk Bluesky profiles plus full follower/following exports via the open AT Protocol. Pay…

    Not checked yet
    • Remote
    • Web search and scraping
  24. Bluesky Scraper

    MCP server

    Scrape Bluesky posts, profiles, followers, threads and keyword search. Clean JSON, pay…

    Not checked yet
    • Remote
    • Web search and scraping
  25. Scrape Shopify App Store apps, full review histories and catalog. E-commerce market…

    Not checked yet
    • Remote
    • E-commerce
  26. 14 web scrapers as MCP tools: Reddit, Amazon, Google Maps, Yelp, YouTube, Indeed & more.

    Runs locally
    • Open source
    • Web search and scraping
  27. Search and explore the Holy Qur'an with Arabic text, transliteration, and advanced…

    Runs locally
    • Open source
    • Web search and scraping