Skip to content

AI tools, agents, MCP servers and skills for web search and scraping

1,212 MCP servers, 15 agent skills, 6 AI tools and 2 AI agents for web search and scraping, including Scrapling MCP Server, Competitor profiling and firecrawl. Each listing shows pricing, platforms and alternatives; use the kind links to see only one kind.

Showing 391–420 of 1,235

  1. ogfetch

    MCP server

    Turn any public URL into JSON with title, Open Graph tags, favicon and tech stack

    Not checked yet
    • 7 tools
    • Remote
    • Freemium
    • Developer tools
  2. Clean YouTube transcripts with title, channel and language, paid per call

    Not checked yet
    • Remote
    • Paid
    • Design and media
  3. x402serps

    MCP server

    Pay-per-call web, news, scholar and place search plus crawl and SEO tools via x402

    Not checked yet
    • 19 tools
    • Remote
    • Paid
    • Web search and scraping
  4. Check which AI crawlers a website allows in robots.txt, with the rule behind each verdict

    Not checked yet
    • 2 tools
    • Remote
    • Free
    • Web search and scraping
  5. Citation check

    MCP server

    Check whether a web page supports a claim, one of several pay-per-call agent tools

    Not checked yet
    • 1 tool
    • Remote
    • Paid
    • Web search and scraping
  6. MapsScraper.dev

    MCP server

    Research Google Maps business lists with record limits and credit budgets set up front

    Not checked yet
    • Remote
    • Freemium
    • Web search and scraping
  7. Read public Instagram profiles, reels, transcripts, comments and ads from your AI agent

    Not checked yet
    • Remote
    • Freemium
    • Analytics and data
  8. Rowfield Data

    MCP server

    Twenty Apify scrapers as MCP tools: public-sector jobs, tenders, CVEs, sitemaps and logos

    Not checked yet
    • 20 tools
    • Remote
    • Freemium
    • Legal and government
  9. ProWebLook

    MCP server

    MCP server exposing 19 ProWebLook API tools for validation, enrichment, scraping and SERP

    Not checked yet
    • 14 tools
    • Remote
    • Freemium
    • Web search and scraping
  10. Buy, test and rotate dedicated 4G/5G mobile proxies from an AI agent

    Not checked yet
    • 5 tools
    • Remote
    • Paid
    • Web search and scraping
  11. webclaw

    MCP server

    Scrape, crawl, search and extract web pages as clean Markdown or JSON for agents

    Not checked yet
    • Remote
    • Freemium
    • Web search and scraping
  12. DataXAPI

    MCP server

    Pay-per-call social and market data from Douyin, TikTok, X and 18 more platforms

    Not checked yet
    • 3 tools
    • Remote
    • Paid
    • Analytics and data
  13. CallAI SEO

    MCP server

    Live Google and Bing results, keyword data, backlinks and page audits for AI agents

    Not checked yet
    • 20 tools
    • Remote
    • Freemium
    • Marketing and SEO
  14. Hire AI agents over MCP or A2A, plus Chinese trending-topic data and utility tools

    Not checked yet
    • 9 tools
    • Remote
    • Freemium
    • AI models and LLM tooling
  15. Web access MCP server for searching the web, fetching URLs and mapping sites as Markdown

    Not checked yet
    • 6 tools
    • Remote
    • Freemium
    • Web search and scraping
  16. Rankvisit

    MCP server

    MCP server that lets Claude or ChatGPT read Search Console, Bing and Fathom data

    Not checked yet
    • Remote
    • Free trial
    • Web search and scraping
  17. Turn any web page into clean Markdown with one tool, run locally with no API key

    Runs locally
    • 1 tool
    • Open source
    • Files and documents
  18. Rangefind

    MCP server

    Static-file search engine with an MCP server so AI agents can query prebuilt indexes

    Runs locally
    • 5 tools
    • Open source
    • 3 GitHub stars
    • Web search and scraping
  19. Outcrawl

    MCP server

    Scrape, crawl and search the web, and run browser agents, from any MCP client

    Not checked yet
    • 17 tools
    • Remote
    • Freemium
    • Web search and scraping
  20. Search GitHub repositories past the 1,000-result cap using your own token

    Not checked yet
    • 1 tool
    • Remote
    • Paid
    • Developer tools
  21. Pay-per-call web research, news, fact-checks and US weather for agents, in USDC

    Not checked yet
    • 10 tools
    • Remote
    • Paid
    • Web search and scraping
  22. Readmd

    MCP server

    Turn any web page into clean Markdown with an outline and token counts, per page

    Not checked yet
    • 3 tools
    • Remote
    • Paid
    • Web search and scraping