Skip to content

AI tools, agents, MCP servers and skills for web search and scraping

1,212 MCP servers, 15 agent skills, 6 AI tools and 2 AI agents for web search and scraping, including Scrapling MCP Server, Competitor profiling and firecrawl. Each listing shows pricing, platforms and alternatives; use the kind links to see only one kind.

Showing 1–30 of 114

  1. NeuralVerge

    MCP server

    Structured, source-tagged business and people data from 300+ sources for agents

    • 200 tools
    • Remote
    • Free trial
    • 1 GitHub star
    • Web search and scraping
  2. Search AI tools, agents and MCP servers and get install configs from inside your AI assistant.

    • 4 tools
    • Remote
    • Free
    • Developer tools
  3. easyserp

    MCP server

    Structured Google and Bing search results for agents, with recoverable requests

    Runs locally
    • Free trial
    • Web search and scraping
  4. llms.ink

    MCP server

    Turn any website, GitHub repo, PDF or video link into llms.txt or llms-full.txt

    • 7 tools
    • Remote
    • Free
    • AI models and LLM tooling
  5. Search a catalogue of Apify Actors and n8n recipes for web-data jobs

    • 8 tools
    • Remote
    • Free
    • Web search and scraping
  6. Scraper Finder

    MCP server

    Look up the official API and ranked scraping tools for 172 websites

    • 3 tools
    • Remote
    • Free
    • Web search and scraping
  7. x-toolkit

    MCP server

    Read public X Articles, video transcripts and posts as plain text, no account needed

    • 4 tools
    • Remote
    • Free
    • Web search and scraping
  8. Fetch pages and search the web through a Singapore 4G/5G mobile IP from your agent

    • 4 tools
    • Remote
    • Free trial
    • Web search and scraping
  9. maviapi

    MCP server

    Live JSON from sites with no API, plus agent-built APIs for any website

    • 9 tools
    • Remote
    • Free trial
    • Web search and scraping
  10. CheckAnySite

    MCP server

    Ask an agent what a website is: AI builder traces, tech stack, traffic rank and trust

    • 6 tools
    • Remote
    • Free
    • Analytics and data
  11. Search a free directory of MCP servers and x402 services, or list your own

    • 12 tools
    • Remote
    • Free
    • Web search and scraping
  12. Hosted and open-source web scraper that returns clean Markdown with change tracking

    • Remote
    • Free trial
    • Web search and scraping
  13. Free check of whether GPTBot, ClaudeBot and PerplexityBot can really reach a website

    • 1 tool
    • Remote
    • Free
    • Web search and scraping
  14. Novada MCP

    MCP server

    One MCP server for web search, page extraction, crawling and platform scraping

    • 9 tools
    • Remote
    • Free trial
    • Web search and scraping
  15. Test whether GPTBot, ClaudeBot, PerplexityBot and 10 more crawlers can reach a page

    • 1 tool
    • Remote
    • Free
    • Marketing and SEO
  16. Check whether a half-remembered thing can be found before your agent answers

    • 4 tools
    • Remote
    • Free
    • Web search and scraping
  17. proxy-scraper

    MCP server

    Hourly-checked free HTTP and SOCKS proxy lists with a CLI and MCP tools to fetch pages

    Runs locally
    • Free
    • Web search and scraping
  18. Copy Markdown

    MCP server

    Turn any web page into clean Markdown, design tokens and a link list for LLMs

    Not checked yet
    • 4 tools
    • Remote
    • Free
    • Files and documents
  19. Vouch

    MCP server

    Check that links load and quotes really appear on a page, from your assistant

    Not checked yet
    • 2 tools
    • Remote
    • Free
    • Developer tools
  20. Pull Google Maps, reviews, web pages and public LinkedIn data into your assistant

    Runs locally
    • 4 tools
    • Free trial
    • Maps and travel
  21. OmniSeek

    MCP server

    Search podcasts, videos, Chinese forums and paper citations from your coding agent

    Not checked yet
    • Remote
    • Free
    • Web search and scraping
  22. Keryx

    MCP server

    Cited research answers with source budgets and visible USDC payment states

    Not checked yet
    • 3 tools
    • Remote
    • Free trial
    • Web search and scraping
  23. UnblockingAPI

    MCP server

    Fetch bot-protected and JavaScript-heavy pages as Markdown or template-parsed JSON

    Not checked yet
    • 3 tools
    • Remote
    • Free trial
    • Web search and scraping
  24. Find page-extraction services from a frozen catalogue; a time-limited free experiment

    Not checked yet
    • 2 tools
    • Remote
    • Free
    • Web search and scraping
  25. Agents Allowed

    MCP server

    Free lookup an agent can query to see if a site permits AI agents to browse, shop or book

    Not checked yet
    • 3 tools
    • Remote
    • Free
    • Web search and scraping
  26. Social Data API

    MCP server

    One API key for public TikTok data, with X, Instagram and Reddit planned

    Not checked yet
    • Remote
    • Free trial
    • Analytics and data
  27. Search immunology and virology literature, trials and grants across six databases at once

    Not checked yet
    • 3 tools
    • Remote
    • Free
    • Health and science
  28. Watch

    MCP server

    Watch a web page, CSS selector, JSON value or price and get changes by poll or webhook

    Not checked yet
    • 6 tools
    • Remote
    • Free
    • Web search and scraping