Skip to content

AI for web search and scraping

237 AI tools, agents, MCP servers and skills for web search and scraping, with pricing, platforms and alternatives for each.

Showing 61–90 of 237

  1. Spicrawl

    MCP server

    Scrape any URL to Markdown or JSON, with JavaScript rendering and batch jobs

    Not checked yet
    • 7 tools
    • Remote
    • Freemium
    • Web search and scraping
  2. UnblockingAPI

    MCP server

    Fetch bot-protected and JavaScript-heavy pages as Markdown or template-parsed JSON

    Not checked yet
    • 3 tools
    • Remote
    • Free trial
    • Web search and scraping
  3. Crawlora MCP

    MCP server

    Hosted MCP exposing 4,684 structured web-data tools across 534 platforms, returned as JSON

    Not checked yet
    • Remote
    • Freemium
    • Web search and scraping
  4. Fetch Router

    MCP server

    Web fetch for agents that checks pages for blocks and empty shells, bills only on success

    Not checked yet
    • 1 tool
    • Remote
    • Freemium
    • Web search and scraping
  5. TwitterAPIs

    MCP server

    X (Twitter) search, profiles, followers, posting and monitors through 120 MCP tools

    Not checked yet
    • 7 tools
    • Remote
    • Paid
    • Marketing and SEO
  6. Shotlane

    MCP server

    Give your agent a real Chrome for screenshots, Markdown, PDFs and phone-size page checks

    Not checked yet
    • 5 tools
    • Remote
    • Freemium
    • Browser automation
  7. monity.ai

    MCP server

    Ask ChatGPT or Claude to watch web pages, show changes and manage monity.ai monitors

    Not checked yet
    • Remote
    • Freemium
    • Web search and scraping
  8. PyEuropePMC

    MCP server

    Europe PMC literature search, full text and export for AI agents (Python, MIT)

    Runs locally
    • Open source
    • Health and science
  9. Read-only Google Play data for agents: apps, charts, reviews, permissions and data safety

    Runs locally
    • 8 tools
    • Open source
    • E-commerce
  10. Caelario

    MCP server

    Instagram, TikTok, YouTube, X and Facebook data pulls from Codex or Claude, paid by credit

    Runs locally
    • Paid
    • Web search and scraping
  11. Read-only Search Console data for assistants: queries, indexing, sitemaps

    Runs locally
    • Freemium
    • Web search and scraping
  12. doc-scraper

    MCP server

    Crawl documentation sites into local Markdown that agents search offline

    Runs locally
    • 4 tools
    • Open source
    • Web search and scraping
  13. Hosted Microsoft Advertising server: read reports, change campaigns with a preview

    Runs locally
    • 10 tools
    • Freemium
    • Web search and scraping
  14. Web2md

    MCP server

    Convert web pages and documents to Markdown and search a saved Library from AI tools

    Not checked yet
    • 12 tools
    • Remote
    • Freemium
    • Web search and scraping
  15. MCP Browser

    MCP server

    Browse login-protected and JavaScript-heavy pages through your own Chrome, Edge or Brave

    Runs locally
    • 9 tools
    • Open source
    • Browser automation
  16. GSC Magic

    MCP server

    Ask Claude or ChatGPT about your Search Console, Bing and GA4 data and SEO reports

    Not checked yet
    • 3 tools
    • Remote
    • Freemium
    • Web search and scraping
  17. Pay-per-call catalog of 500+ agent tools, paid in USDC over x402 or free by proof-of-work

    Not checked yet
    • Remote
    • Freemium
    • Web search and scraping
  18. FATSEARCH

    MCP server

    Turns web pages and PDFs into cached Markdown outlines read one section at a time

    Runs locally
    • Open source
    • Web search and scraping
  19. Web Intel

    MCP server

    Pay-per-call MCP server that turns web pages into Markdown, metadata and scored SEO audits

    Not checked yet
    • 8 tools
    • Remote
    • Freemium
    • Web search and scraping
  20. MCP

    MCP server

    Scrape pages and map sites from an agent, processed on EU servers

    Runs locally
    • 1 tool
    • Freemium
    • Web search and scraping
  21. Scrape.ly

    MCP server

    Find, run and read results from Scrape.ly Actors inside any MCP client

    Not checked yet
    • 14 tools
    • Remote
    • Freemium
    • Web search and scraping
  22. Live web search and clean-markdown page fetch for coding agents, keyless by default

    Not checked yet
    • 2 tools
    • Remote
    • Freemium
    • Web search and scraping
  23. BrowserSolver

    MCP server

    Anti-bot-aware scraping: crawl, render, screenshot and unlock pages via one API

    Not checked yet
    • 5 tools
    • Remote
    • Free trial
    • Web search and scraping
  24. Piloterr

    MCP server

    Search, inspect and call 391 scraping endpoints through four small MCP tools

    Not checked yet
    • 4 tools
    • Remote
    • Freemium
    • Web search and scraping
  25. Autom

    MCP server

    Structured Google, Bing and Brave search results for agents via the Autom SERP API

    Not checked yet
    • 6 tools
    • Remote
    • Free trial
    • Web search and scraping