Skip to content

AI tools, agents, MCP servers and skills for web search and scraping

1,212 MCP servers, 15 agent skills, 6 AI tools and 2 AI agents for web search and scraping, including Scrapling MCP Server, Competitor profiling and firecrawl. Each listing shows pricing, platforms and alternatives; use the kind links to see only one kind.

Showing 1–30 of 189

  1. API Pick

    MCP server

    27 pay-per-call search tools: web, news, SEC, patents, clinical and more

    • 27 tools
    • Remote
    • Paid
    • Web search and scraping
  2. llms.ink

    MCP server

    Turn any website, GitHub repo, PDF or video link into llms.txt or llms-full.txt

    • 7 tools
    • Remote
    • Free
    • AI models and LLM tooling
  3. x-toolkit

    MCP server

    Read public X Articles, video transcripts and posts as plain text, no account needed

    • 4 tools
    • Remote
    • Free
    • Web search and scraping
  4. CheckAnySite

    MCP server

    Ask an agent what a website is: AI builder traces, tech stack, traffic rank and trust

    • 6 tools
    • Remote
    • Free
    • Analytics and data
  5. Read public Telegram channel posts with views, reactions and media, no login

    • Remote
    • Paid
    • Communication
  6. Track EU TikTok Ad Library ads by advertiser or keyword, with change status

    • Remote
    • Paid
    • Marketing and SEO
  7. Search a free directory of MCP servers and x402 services, or list your own

    • 12 tools
    • Remote
    • Free
    • Web search and scraping
  8. CoProxy

    MCP server

    Buy, manage and monitor CoProxy residential, mobile and datacenter proxies by chat

    Not checked yet
    • Remote
    • Paid
    • Web search and scraping
  9. Free check of whether GPTBot, ClaudeBot and PerplexityBot can really reach a website

    • 1 tool
    • Remote
    • Free
    • Web search and scraping
  10. Start cited research runs, search graded sources and run research workflows from an agent

    • 11 tools
    • Remote
    • Paid
    • Web search and scraping
  11. Test whether GPTBot, ClaudeBot, PerplexityBot and 10 more crawlers can reach a page

    • 1 tool
    • Remote
    • Free
    • Marketing and SEO
  12. Pay-per-use SEO tools for SERPs, keyword volume, rank tracking and site audits

    • 19 tools
    • Remote
    • Paid
    • Marketing and SEO
  13. PostToData

    MCP server

    Read public posts, comments, profiles and transcripts from Reddit, X, TikTok and more

    • 6 tools
    • Remote
    • Paid
    • Web search and scraping
  14. Check whether a half-remembered thing can be found before your agent answers

    • 4 tools
    • Remote
    • Free
    • Web search and scraping
  15. Scrape App Store and Google Play reviews and get AI themes, bugs and competitor reports

    • Remote
    • Paid
    • Analytics and data
  16. 1ToolRing

    MCP server

    One prepaid balance for thousands of pay-per-call search, maps and market-data tools

    Not checked yet
    • 4 tools
    • Remote
    • Paid
    • Web search and scraping