Skip to content

AI tools, agents, MCP servers and skills for web search and scraping

1,212 MCP servers, 15 agent skills, 6 AI tools and 2 AI agents for web search and scraping, including Scrapling MCP Server, Competitor profiling and firecrawl. Each listing shows pricing, platforms and alternatives; use the kind links to see only one kind.

Showing 121–150 of 360

  1. xfix

    MCP server

    Checks whether AI crawlers and shopping agents can read a site, from inside your assistant

    Not checked yet
    • 8 tools
    • Remote
    • Freemium
    • Marketing and SEO
  2. Captapi

    MCP server

    Read public social media data from 30+ platforms through one API key

    Not checked yet
    • 6 tools
    • Remote
    • Freemium
    • Web search and scraping
  3. Scrape pages, render JavaScript, take screenshots and extract JSON with AI via Irmu

    Not checked yet
    • Remote
    • Freemium
    • Web search and scraping
  4. Apify actors serving ATS job feeds, domain and email posture, and Google Trends JSON

    Not checked yet
    • Remote
    • Freemium
    • Analytics and data
  5. Pay-per-call catalog of 500+ agent tools, paid in USDC over x402 or free by proof-of-work

    Not checked yet
    • Remote
    • Freemium
    • Web search and scraping
  6. Web Intel

    MCP server

    Pay-per-call MCP server that turns web pages into Markdown, metadata and scored SEO audits

    Not checked yet
    • 8 tools
    • Remote
    • Freemium
    • Web search and scraping
  7. MCP

    MCP server

    Scrape pages and map sites from an agent, processed on EU servers

    Runs locally
    • 1 tool
    • Freemium
    • Web search and scraping
  8. Google Trends and Pinterest Trends data for AI agents, with no API key or login

    Not checked yet
    • Remote
    • Freemium
    • Web search and scraping
  9. Scrape.ly

    MCP server

    Find, run and read results from Scrape.ly Actors inside any MCP client

    Not checked yet
    • 14 tools
    • Remote
    • Freemium
    • Web search and scraping
  10. GroundLock

    MCP server

    Checks a claim against public web pages and returns supported, refuted or unverifiable

    Not checked yet
    • Remote
    • Freemium
    • Web search and scraping
  11. Live web search and clean-markdown page fetch for coding agents, keyless by default

    Not checked yet
    • 2 tools
    • Remote
    • Freemium
    • Web search and scraping
  12. Piloterr

    MCP server

    Search, inspect and call 391 scraping endpoints through four small MCP tools

    Not checked yet
    • 4 tools
    • Remote
    • Freemium
    • Web search and scraping
  13. SearchPipe

    MCP server

    Live web search with quoted evidence and source authority tiers for agents

    Not checked yet
    • 1 tool
    • Remote
    • Freemium
    • Web search and scraping
  14. AgentReader

    MCP server

    Turn web pages, PDFs, JSON and CSV into clean Markdown for agents, with free daily reads

    Not checked yet
    • Remote
    • Freemium
    • Files and documents
  15. Search MCP servers and agent skills from inside an agent and get ready install configs

    Not checked yet
    • 9 tools
    • Remote
    • Freemium
    • Developer tools
  16. Download YouTube comments and transcripts from Claude, ChatGPT or Cursor

    Not checked yet
    • 3 tools
    • Remote
    • Freemium
    • Design and media
  17. Sugra MCP

    MCP server

    Search and call 1,600+ primary-source data endpoints from your AI client

    Not checked yet
    • Remote
    • Freemium
    • Analytics and data
  18. A free URL-to-Markdown reader for agents, plus a public message board they post to

    Not checked yet
    • 12 tools
    • Remote
    • Freemium
    • Web search and scraping
  19. DeepSift Search

    MCP server

    Web search for agents that returns only the answering passages, in Tavily's format

    Not checked yet
    • 4 tools
    • Remote
    • Freemium
    • Web search and scraping
  20. Pull YouTube transcripts with timestamps into your AI assistant, billed in credits

    Not checked yet
    • 5 tools
    • Remote
    • Freemium
    • Design and media
  21. One Apify MCP link exposing 40 Steadyfetch data actors for agents, billed per result

    Not checked yet
    • 5 tools
    • Remote
    • Freemium
    • Web search and scraping
  22. Serper.live

    MCP server

    Live Google results and domain rank checks by country and device, pay per search

    Runs locally
    • 3 tools
    • Freemium
    • Web search and scraping
  23. Free AI-readiness SEO checks: AI crawler access, llms.txt validation and AI citations

    Not checked yet
    • 3 tools
    • Remote
    • Freemium
    • Web search and scraping
  24. AdsCrawl

    MCP server

    Cloud browsers, web extraction and screenshots for agents, with residential proxy routing

    Not checked yet
    • Remote
    • Freemium
    • Web search and scraping
  25. TrueScrape

    MCP server

    Public social, marketplace and property data for agents: profiles, posts, mentions

    Not checked yet
    • Remote
    • Freemium
    • Web search and scraping
  26. ClearPage

    MCP server

    Fetch any public web page as clean Markdown or structured metadata, paid per call

    Not checked yet
    • 2 tools
    • Remote
    • Freemium
    • Web search and scraping
  27. ogfetch

    MCP server

    Turn any public URL into JSON with title, Open Graph tags, favicon and tech stack

    Not checked yet
    • 7 tools
    • Remote
    • Freemium
    • Developer tools