Skip to content

AI tools, agents, MCP servers and skills for web search and scraping

1,212 MCP servers, 15 agent skills, 6 AI tools and 2 AI agents for web search and scraping, including Scrapling MCP Server, Competitor profiling and firecrawl. Each listing shows pricing, platforms and alternatives; use the kind links to see only one kind.

Showing 1–11 of 11

  1. Researches competitors into dated, source-backed profile files using scraping and SEO data

    • Open source
    • 60.9K GitHub stars
    • Sales and CRM
  2. Research five direct competitors and recommend how to position against them

    • Open source
    • 28.1K GitHub stars
    • Marketing and SEO
  3. Capture public webpages as local PNG, JPEG or PDF files via the Latchshot service

    • Open source
    • 41.3K GitHub stars
    • Web search and scraping
  4. Guides setting up Prometheus scraping, health probes, alerting and logs for Qdrant

    • Open source
    • 41.3K GitHub stars
    • Knowledge and memory
  5. Guides an agent through Xquik X API integrations for tweet search, lookups and exports

    • Open source
    • 41.3K GitHub stars
    • Web search and scraping
  6. Lets your agent write .NET code for Azure Maps geocoding, routing, tiles, weather and IP

    • Open source
    • 3.2K GitHub stars
    • Maps and travel
  7. Use when the user wants to fact-check an article or verify factual claims in a document

    • Open source
    • 770 GitHub stars
    • Web search and scraping
  8. Generates Puppeteer scripts for browser automation, scraping, and PDF generation

    • Open source
    • 392 GitHub stars
    • Browser automation
  9. Guides Qdrant monitoring setup including Prometheus scraping, Datadog integration, health probes, Hybrid Cloud metrics, alerting, and log ce

    • Open source
    • 269 GitHub stars
    • Knowledge and memory
  10. Multi-level research: built-in knowledge → web search → Tavily deep research API

    • Open source
    • 107 GitHub stars
    • Web search and scraping
  11. Use Exa for semantic/neural web search

    • Open source
    • 72 GitHub stars
    • Web search and scraping