Skip to content

Agent skills for web search and scraping

11 agent skills that give AI live web search, page fetching and structured data extraction. Each one shows what it can run and how to install it in Claude Code, Codex, Cursor and other agents.
  1. Researches competitors into dated, source-backed profile files using scraping and SEO data

    • Open source
    • 60.9K GitHub stars
    • Sales and CRM
  2. Research five direct competitors and recommend how to position against them

    • Open source
    • 28.1K GitHub stars
    • Marketing and SEO
  3. Capture public webpages as local PNG, JPEG or PDF files via the Latchshot service

    • Open source
    • 41.3K GitHub stars
    • Web search and scraping
  4. Guides setting up Prometheus scraping, health probes, alerting and logs for Qdrant

    • Open source
    • 41.3K GitHub stars
    • Knowledge and memory
  5. Guides an agent through Xquik X API integrations for tweet search, lookups and exports

    • Open source
    • 41.3K GitHub stars
    • Web search and scraping
  6. Lets your agent write .NET code for Azure Maps geocoding, routing, tiles, weather and IP

    • Open source
    • 3.2K GitHub stars
    • Maps and travel
  7. Use when the user wants to fact-check an article or verify factual claims in a document

    • Open source
    • 770 GitHub stars
    • Web search and scraping
  8. Generates Puppeteer scripts for browser automation, scraping, and PDF generation

    • Open source
    • 392 GitHub stars
    • Browser automation
  9. Guides Qdrant monitoring setup including Prometheus scraping, Datadog integration, health probes, Hybrid Cloud metrics, alerting, and log ce

    • Open source
    • 269 GitHub stars
    • Knowledge and memory
  10. Multi-level research: built-in knowledge → web search → Tavily deep research API

    • Open source
    • 107 GitHub stars
    • Web search and scraping
  11. Use Exa for semantic/neural web search

    • Open source
    • 72 GitHub stars
    • Web search and scraping

See every kind of AI for web search and scraping: tools, agents, MCP servers and skills.Ranked: the best AI for web search and scraping.