Skip to content

AI tools, agents, MCP servers and skills for web search and scraping

1,212 MCP servers, 15 agent skills, 6 AI tools and 2 AI agents for web search and scraping, including Scrapling MCP Server, Competitor profiling and firecrawl. Each listing shows pricing, platforms and alternatives; use the kind links to see only one kind.

Showing 481–510 of 1,235

  1. Competitor Google ads by brand, domain or advertiser ID, with new-ad-only mode

    Not checked yet
    • Remote
    • Paid
    • Marketing and SEO
  2. Google Trends data as structured output: interest over time, regions, rising queries

    Not checked yet
    • 1 tool
    • Remote
    • Paid
    • Web search and scraping
  3. Convert web pages, PDFs and small sites into clean Markdown with chunks for RAG

    Not checked yet
    • 1 tool
    • Remote
    • Paid
    • Files and documents
  4. Pay-per-call tools for agents: web search, page-to-markdown, memory and proofs, via x402

    Not checked yet
    • Remote
    • Freemium
    • Developer tools
  5. YouTube Scraper

    MCP server

    Public YouTube search, channel videos and Shorts as flat data, without an API key

    Not checked yet
    • Remote
    • Paid
    • Design and media
  6. Crawl Readiness

    MCP server

    Check which AI crawlers can read a site and generate llms.txt, robots.txt and schema

    Runs locally
    • 9 tools
    • Freemium
    • Web search and scraping
  7. Hosted cloud browsers for agents with saved logins, residential IPs and live takeover

    Not checked yet
    • Remote
    • Paid
    • Browser automation
  8. URL intelligence MCP server for link previews, Markdown extraction, screenshots and audits

    Not checked yet
    • Remote
    • Freemium
    • Web search and scraping
  9. Twenty-odd public-data tools for agents: Google SERP, AI Overviews, Maps, Jobs and more

    Runs locally
    • 8 tools
    • Paid
    • Web search and scraping
  10. Briefpanel

    MCP server

    Let an AI agent watch web pages and report which field changed, old value to new

    Not checked yet
    • Remote
    • Freemium
    • Web search and scraping
  11. MCP Lyricscom

    MCP server

    Find songs by a remembered lyric or title and read lyrics from lyrics.com

    Runs locally
    • 3 tools
    • Free
    • Events and entertainment
  12. Comment Scraper

    MCP server

    Ask Claude about Reddit and Hacker News threads you exported with Comment Scraper

    Runs locally
    • 4 tools
    • Freemium
    • Web search and scraping
  13. Mamitsu MCP

    MCP server

    MCP server that pulls structured JSON from public Instagram, TikTok, YouTube and X posts

    Not checked yet
    • 1 tool
    • Remote
    • Free trial
    • Web search and scraping
  14. Turns web pages and PDFs into clean Markdown and strips hidden prompt-injection text

    Not checked yet
    • Remote
    • Paid
    • Web search and scraping
  15. X Reader MCP

    MCP server

    Read public X posts and full X Articles as clean Markdown, with no X API key

    Not checked yet
    • 1 tool
    • Remote
    • Free
    • Web search and scraping
  16. Oxylabs MCP

    MCP server

    Oxylabs MCP server for scraping, Google and Amazon search and AI-driven crawling

    Not checked yet
    • 10 tools
    • Remote
    • Free trial
    • Web search and scraping
  17. Pay-per-call web, AI and Base chain tools for agents, paid in USDC over x402

    Not checked yet
    • 1 tool
    • Remote
    • Paid
    • Developer tools
  18. Scrape public posts and videos from Bluesky, Telegram, Substack, Dailymotion and Likee

    Not checked yet
    • Remote
    • Freemium
    • Web search and scraping
  19. Fetch public web pages as numbered, quotable paragraphs with integrity hashes

    Not checked yet
    • 3 tools
    • Remote
    • Freemium
    • Web search and scraping
  20. Polias Search

    MCP server

    EU-hosted web search from an independent German-language index, with an English tech mode

    Not checked yet
    • 1 tool
    • Remote
    • Freemium
    • Web search and scraping
  21. CodeDebut

    MCP server

    Search new software launches and daily upvote rankings from your AI assistant

    Not checked yet
    • 10 tools
    • Remote
    • Free
    • Web search and scraping
  22. Look up conference and journal deadlines, CCF and CORE rankings and acceptance rates

    Not checked yet
    • 8 tools
    • Remote
    • Free
    • Web search and scraping
  23. searxNcrawl

    MCP server

    Open-source MCP server for web search via SearXNG or You.com and Markdown crawling

    Runs locally
    • 3 tools
    • Open source
    • Web search and scraping
  24. Read YouTube transcripts and research across videos from Claude or ChatGPT

    Not checked yet
    • 1 tool
    • Remote
    • Freemium
    • Design and media
  25. Checks whether a page may be used, then reads it as Markdown or JSON for agents

    Not checked yet
    • 7 tools
    • Remote
    • Freemium
    • Web search and scraping
  26. Hexadata

    MCP server

    Official registers as MCP tools: EU/US tenders, NPI providers, Companies House, Mexico

    Not checked yet
    • 7 tools
    • Remote
    • Freemium
    • Analytics and data
  27. Facebook Data

    MCP server

    Read public Facebook Pages, groups, Marketplace and Ad Library ads with no login

    Not checked yet
    • 1 tool
    • Remote
    • Free trial
    • Marketing and SEO
  28. Instagram Data

    MCP server

    Read public Instagram profiles, posts, reels, hashtags and locations without logging in

    Not checked yet
    • 1 tool
    • Remote
    • Free trial
    • Marketing and SEO
  29. Linkedin Data

    MCP server

    Read-only LinkedIn profiles, companies, jobs and posts without using your own account

    Not checked yet
    • 1 tool
    • Remote
    • Free trial
    • Sales and CRM