Skip to content

AI tools, agents, MCP servers and skills for web search and scraping

1,168 MCP servers, 10 agent skills, 6 AI tools and 2 AI agents for web search and scraping, including Scrapling MCP Server, firecrawl and Firecrawl MCP Server. Each listing shows pricing, platforms and alternatives; use the kind links to see only one kind.

Showing 1–20 of 20

  1. Web search, scraping and page interaction API for AI agents and developers

    • Freemium
    • Agent framework
    • 202K GitHub stars
    • Web search and scraping
  2. Web crawler and hosted API that turns URLs into LLM-ready Markdown or JSON

    • Freemium
    • Open-source agent
    • 87.5K GitHub stars
    • Web search and scraping
  3. SerpApi

    MCP server

    Official SerpApi server: Google, Bing and other search results as JSON or Markdown

    • 4 tools
    • Remote
    • Freemium
    • Web search and scraping
  4. CRW Web Scraper

    MCP server

    Open-source web scraper for agents with scrape, crawl, map and search tools

    Runs locally
    • 3 tools
    • Freemium
    • Web search and scraping
  5. Octocrawl

    MCP server

    Web scraping, mapping and crawling MCP server that returns clean Markdown

    Not checked yet
    • 2 tools
    • Remote
    • Freemium
    • Web search and scraping
  6. Crawlora MCP

    MCP server

    Hosted MCP exposing 4,684 structured web-data tools across 534 platforms, returned as JSON

    Not checked yet
    • Remote
    • Freemium
    • Web search and scraping
  7. Read-only Search Console data for assistants: queries, indexing, sitemaps

    Runs locally
    • Freemium
    • Web search and scraping
  8. Pay-per-call catalog of 500+ agent tools, paid in USDC over x402 or free by proof-of-work

    Not checked yet
    • Remote
    • Freemium
    • Web search and scraping
  9. Scrape.ly

    MCP server

    Find, run and read results from Scrape.ly Actors inside any MCP client

    Not checked yet
    • 14 tools
    • Remote
    • Freemium
    • Web search and scraping
  10. webclaw

    MCP server

    Scrape, crawl, search and extract web pages as clean Markdown or JSON for agents

    Not checked yet
    • Remote
    • Freemium
    • Web search and scraping
  11. Company profiles, site audits and email checks for agents, via a RapidAPI backend

    Not checked yet
    • 6 tools
    • Remote
    • Freemium
    • Web search and scraping
  12. Page Monitor

    MCP server

    Noise-filtered web page diffs with SHA-256 evidence, plus a key gate for scheduled watches

    Runs locally
    • 2 tools
    • Freemium
    • Web search and scraping
  13. APIFreaks MCP

    MCP server

    Live weather, WHOIS, DNS, SSL, IP and other lookups from APIFreaks, enabled by module

    Runs locally
    • 1 tool
    • Freemium
    • Web search and scraping
  14. AgentFeed

    MCP server

    MCP server and REST API that turn RSS/Atom feeds into JSON and web pages into clean text

    Not checked yet
    • 2 tools
    • Remote
    • Freemium
    • Web search and scraping
  15. OpenSERP

    MCP server

    Live results from six search engines with original ranks, plus page extraction

    Runs locally
    • 10 tools
    • Freemium
    • Web search and scraping
  16. Fetch YouTube transcripts, search, chapters and extractive summaries for agents

    Not checked yet
    • 4 tools
    • Remote
    • Freemium
    • Design and media
  17. Public social data from nine platforms as JSON tools, with credits refunded on failure

    Runs locally
    • 3 tools
    • Freemium
    • Web search and scraping
  18. RealtyCrawl

    MCP server

    Source-linked real estate listings and observations for agents, paid in credits

    Not checked yet
    • 5 tools
    • Remote
    • Freemium
    • Analytics and data
  19. scrapewright

    MCP server

    URL-to-rows scraper that has a model write a parser once and replays it free

    Not checked yet
    • Remote
    • Freemium
    • Web search and scraping
  20. Research briefs built from verified quotations, refusing claims it cannot ground

    Not checked yet
    • 1 tool
    • Remote
    • Freemium
    • Web search and scraping