Skip to content

AI tools, agents, MCP servers and skills for web search and scraping

1,212 MCP servers, 15 agent skills, 6 AI tools and 2 AI agents for web search and scraping, including Scrapling MCP Server, Competitor profiling and firecrawl. Each listing shows pricing, platforms and alternatives; use the kind links to see only one kind.

Showing 751–780 of 1,235

  1. MCP server exposing 59 live B2B lead, startup dealflow, crypto and security data tools

    Not checked yet
    • Remote
    • Freemium
    • Web search and scraping
  2. RobotsGate

    MCP server

    Generate, validate and check robots.txt rules for AI crawlers such as GPTBot and ClaudeBot

    Not checked yet
    • 4 tools
    • Remote
    • Freemium
    • Marketing and SEO
  3. Pay-per-call agent tools for page reading, token, email and wallet checks, paid in USDC

    Runs locally
    • 10 tools
    • Paid
    • Web search and scraping
  4. localscreenshot

    MCP server

    Screenshot API for AI agents: any public page as an image or PDF from 227 countries

    Not checked yet
    • 5 tools
    • Remote
    • Freemium
    • Web search and scraping
  5. OSINTverse

    MCP server

    Pay-per-lookup OSINT across breach, people, domain, crypto and image sources

    Not checked yet
    • Remote
    • Paid
    • Security
  6. Self-hosted SEO crawler with AI-crawler checks that assistants can drive over MCP

    Runs locally
    • Open source
    • Web search and scraping
  7. Unbrowse

    MCP server

    Turns websites into callable tools so agents skip the browser, with a cloud fallback

    Not checked yet
    • Remote
    • Freemium
    • Web search and scraping
  8. Evascrape

    MCP server

    Pull business leads with emails from Google Maps, Apollo.io and LinkedIn via an assistant

    Runs locally
    • 7 tools
    • Paid
    • Sales and CRM
  9. CurlShot

    MCP server

    Take screenshots of public web pages as images, PDF or scrolling video from an agent

    Not checked yet
    • 2 tools
    • Remote
    • Freemium
    • Web search and scraping
  10. Fetch a public web page as clean Markdown, paid per call in USDC on Base

    Not checked yet
    • 1 tool
    • Remote
    • Paid
    • Files and documents
  11. MapsData

    MCP server

    Build Google Maps lead lists with emails and phones from an AI assistant

    Not checked yet
    • 8 tools
    • Remote
    • Free trial
    • Maps and travel
  12. Pay-per-result tools for company contacts, WHOIS, job listings, Hacker News and App Store

    Not checked yet
    • 5 tools
    • Remote
    • Paid
    • Sales and CRM
  13. Google Images results as URLs, dimensions and source pages, for image research

    Runs locally
    • 4 tools
    • Paid
    • Design and media
  14. Google News articles with publishers, date labels and links for topic briefs

    Runs locally
    • 4 tools
    • Paid
    • News and media
  15. Local business and place search results with addresses and ratings for shortlists

    Runs locally
    • 4 tools
    • Paid
    • Maps and travel
  16. Google Search rankings, URLs and snippets for localized search research

    Runs locally
    • 4 tools
    • Paid
    • Web search and scraping
  17. Google Shopping product, merchant and price-label snapshots for offer comparison

    Runs locally
    • 4 tools
    • Paid
    • E-commerce
  18. YouTube video metadata by ID: channel details, counts, formats and chapters

    Runs locally
    • Paid
    • Design and media
  19. YouTube keyword search with filters, up to 20 results per request

    Runs locally
    • Paid
    • Design and media
  20. YTAPI

    MCP server

    YouTube transcripts, comments, search and channel data for AI agents

    Not checked yet
    • Remote
    • Free trial
    • Design and media
  21. RealtyCrawl

    MCP server

    Source-linked real estate listings and observations for agents, paid in credits

    Not checked yet
    • 5 tools
    • Remote
    • Freemium
    • Analytics and data
  22. WebKit

    MCP server

    Email validation, link previews and article-to-Markdown extraction for agents

    Not checked yet
    • Remote
    • Freemium
    • Developer tools
  23. SocialTap

    MCP server

    Remote MCP server giving AI clients live public posts and profiles from 35 platforms

    Not checked yet
    • 12 tools
    • Remote
    • Freemium
    • Web search and scraping
  24. Clear Line Ops

    MCP server

    Hosted MCP toolbox for web research, security checks, CAD, architecture and media

    Not checked yet
    • 5 tools
    • Remote
    • Free trial
    • Web search and scraping
  25. AgentRXI

    MCP server

    232 pay-per-call tools for agents, from LLMs and browsers to OCR, data and wallet checks

    Not checked yet
    • Remote
    • Paid
    • AI models and LLM tooling