Skip to content

AI tools, agents, MCP servers and skills for web search and scraping

1,212 MCP servers, 15 agent skills, 6 AI tools and 2 AI agents for web search and scraping, including Scrapling MCP Server, Competitor profiling and firecrawl. Each listing shows pricing, platforms and alternatives; use the kind links to see only one kind.

Showing 1–30 of 108

  1. NeuralVerge

    MCP server

    Structured, source-tagged business and people data from 300+ sources for agents

    • 200 tools
    • Remote
    • Free trial
    • 1 GitHub star
    • Web search and scraping
  2. easyserp

    MCP server

    Structured Google and Bing search results for agents, with recoverable requests

    Runs locally
    • Free trial
    • Web search and scraping
  3. llms.ink

    MCP server

    Turn any website, GitHub repo, PDF or video link into llms.txt or llms-full.txt

    • 7 tools
    • Remote
    • Free
    • AI models and LLM tooling
  4. Search a catalogue of Apify Actors and n8n recipes for web-data jobs

    • 8 tools
    • Remote
    • Free
    • Web search and scraping
  5. Scraper Finder

    MCP server

    Look up the official API and ranked scraping tools for 172 websites

    • 3 tools
    • Remote
    • Free
    • Web search and scraping
  6. x-toolkit

    MCP server

    Read public X Articles, video transcripts and posts as plain text, no account needed

    • 4 tools
    • Remote
    • Free
    • Web search and scraping
  7. Fetch pages and search the web through a Singapore 4G/5G mobile IP from your agent

    • 4 tools
    • Remote
    • Free trial
    • Web search and scraping
  8. maviapi

    MCP server

    Live JSON from sites with no API, plus agent-built APIs for any website

    Runs locally
    • 9 tools
    • Free trial
    • Web search and scraping
  9. CheckAnySite

    MCP server

    Ask an agent what a website is: AI builder traces, tech stack, traffic rank and trust

    • 6 tools
    • Remote
    • Free
    • Analytics and data
  10. Search a free directory of MCP servers and x402 services, or list your own

    • 12 tools
    • Remote
    • Free
    • Web search and scraping
  11. Hosted and open-source web scraper that returns clean Markdown with change tracking

    • Remote
    • Free trial
    • Web search and scraping
  12. Free check of whether GPTBot, ClaudeBot and PerplexityBot can really reach a website

    • 1 tool
    • Remote
    • Free
    • Web search and scraping
  13. Novada MCP

    MCP server

    One MCP server for web search, page extraction, crawling and platform scraping

    • 9 tools
    • Remote
    • Free trial
    • Web search and scraping
  14. Test whether GPTBot, ClaudeBot, PerplexityBot and 10 more crawlers can reach a page

    • 1 tool
    • Remote
    • Free
    • Marketing and SEO
  15. Check whether a half-remembered thing can be found before your agent answers

    • 4 tools
    • Remote
    • Free
    • Web search and scraping
  16. proxy-scraper

    MCP server

    Hourly-checked free HTTP and SOCKS proxy lists with a CLI and MCP tools to fetch pages

    Runs locally
    • Free
    • Web search and scraping
  17. Copy Markdown

    MCP server

    Turn any web page into clean Markdown, design tokens and a link list for LLMs

    Not checked yet
    • 4 tools
    • Remote
    • Free
    • Files and documents
  18. Vouch

    MCP server

    Check that links load and quotes really appear on a page, from your assistant

    Not checked yet
    • 2 tools
    • Remote
    • Free
    • Developer tools
  19. Pull Google Maps, reviews, web pages and public LinkedIn data into your assistant

    Runs locally
    • 4 tools
    • Free trial
    • Maps and travel
  20. Keryx

    MCP server

    Cited research answers with source budgets and visible USDC payment states

    Not checked yet
    • 3 tools
    • Remote
    • Free trial
    • Web search and scraping
  21. UnblockingAPI

    MCP server

    Fetch bot-protected and JavaScript-heavy pages as Markdown or template-parsed JSON

    Not checked yet
    • 3 tools
    • Remote
    • Free trial
    • Web search and scraping
  22. Find page-extraction services from a frozen catalogue; a time-limited free experiment

    Not checked yet
    • 2 tools
    • Remote
    • Free
    • Web search and scraping
  23. Agents Allowed

    MCP server

    Free lookup an agent can query to see if a site permits AI agents to browse, shop or book

    Not checked yet
    • 3 tools
    • Remote
    • Free
    • Web search and scraping
  24. Social Data API

    MCP server

    One API key for public TikTok data, with X, Instagram and Reddit planned

    Not checked yet
    • Remote
    • Free trial
    • Analytics and data
  25. Search immunology and virology literature, trials and grants across six databases at once

    Not checked yet
    • 3 tools
    • Remote
    • Free
    • Health and science
  26. Watch

    MCP server

    Watch a web page, CSS selector, JSON value or price and get changes by poll or webhook

    Not checked yet
    • 6 tools
    • Remote
    • Free
    • Web search and scraping
  27. sociallinks.dev

    MCP server

    Find a creator's other social accounts from one profile link, with confidence scores

    Not checked yet
    • 4 tools
    • Remote
    • Free trial
    • Marketing and SEO
  28. Search expiring and recently dropped domain names by drop date, rank and linking domains

    Not checked yet
    • 2 tools
    • Remote
    • Free
    • Marketing and SEO