Skip to content
MCP server

Scrape Everything

Public social data from nine platforms as JSON tools, with credits refunded on failure

Runs locallyStatus and history
Install
Pricing
Freemium
Platforms
CLI, API, self-hosted
Runs
Locally
Version
0.1.0
Listing updated
2 days ago

About Scrape Everything

Scrape Everything is a freemium MCP server for web search and scraping. It runs locally on your machine and is started by your AI client.

Each endpoint of the Scrape Everything API becomes a tool: at startup the server reads the live catalogue from GET /v1/scrapers and registers names such as instagram_profile, tiktok_posts and youtube_transcript. New endpoints appear without a package update, and a bundled snapshot lets it start offline. Every tool description states its credit cost and returned fields.

Coverage is 48 endpoints across Instagram, TikTok, X, YouTube, Facebook, Telegram, Spotify, Pinterest and Twitch. A request costs 1 to 3 credits, new accounts get 100 free credits, and packs start at $39 for 25,000 credits with no subscription. Blocks, timeouts and platform-side errors are refunded, and cached results within a 1 to 14 day window are free.

Errors come back as tool errors with the code and request ID, and the server never retries on its own. Results are truncated at 100k characters by default. The README says it sends no telemetry. It needs an API key and can also run as a self-hosted streamable HTTP endpoint.

Install

Run in a terminal

claude mcp add mcp --env SCRAPEEVERYTHING_API_KEY='<SCRAPEEVERYTHING_API_KEY>' -- npx -y @scrapeeverything/mcp

Add to claude_desktop_config.json

{
  "mcpServers": {
    "mcp": {
      "command": "npx",
      "args": [
        "-y",
        "@scrapeeverything/mcp"
      ],
      "env": {
        "SCRAPEEVERYTHING_API_KEY": "<SCRAPEEVERYTHING_API_KEY>"
      }
    }
  }
}

Add to ~/.cursor/mcp.json

{
  "mcpServers": {
    "mcp": {
      "command": "npx",
      "args": [
        "-y",
        "@scrapeeverything/mcp"
      ],
      "env": {
        "SCRAPEEVERYTHING_API_KEY": "<SCRAPEEVERYTHING_API_KEY>"
      }
    }
  }
}

Add to .vscode/mcp.json

{
  "servers": {
    "mcp": {
      "type": "stdio",
      "command": "npx",
      "args": [
        "-y",
        "@scrapeeverything/mcp"
      ],
      "env": {
        "SCRAPEEVERYTHING_API_KEY": "<SCRAPEEVERYTHING_API_KEY>"
      }
    }
  }
}

Add to ~/.codeium/windsurf/mcp_config.json

{
  "mcpServers": {
    "mcp": {
      "command": "npx",
      "args": [
        "-y",
        "@scrapeeverything/mcp"
      ],
      "env": {
        "SCRAPEEVERYTHING_API_KEY": "<SCRAPEEVERYTHING_API_KEY>"
      }
    }
  }
}

Add to your client's MCP settings (most use this shape)

{
  "mcpServers": {
    "mcp": {
      "command": "npx",
      "args": [
        "-y",
        "@scrapeeverything/mcp"
      ],
      "env": {
        "SCRAPEEVERYTHING_API_KEY": "<SCRAPEEVERYTHING_API_KEY>"
      }
    }
  }
}

Configuration

  • SCRAPEEVERYTHING_API_KEYScrape Everything API key (ssk_live_...), from https://scrapeeverything.com/dashboard/keysRequired
  • SCRAPEEVERYTHING_API_URLOverride the API base URL (default https://api.scrapeeverything.com)

Tools this server provides (3)

Taken from the project documentation; the running server may differ.

instagram_profile
Returns a public Instagram profile.
tiktok_posts
Returns TikTok posts.
youtube_transcript
Returns a YouTube video transcript.

What it does

Tool per endpoint
Registers one tool per scraper from a live catalogue.
Cost shown up front
Descriptions list credit cost and returned fields.
Refunds on failure
Blocked requests and timeouts are refunded.
Cache control
A cache_days setting makes repeat lookups free.
Offline start
Falls back to a bundled snapshot if the catalogue cannot load.

Good for

  • Pull a creator's profile and recent posts for research
  • Fetch video transcripts to summarise
  • Compare follower counts across platforms
  • Feed public social data to an analysis agent

Pricing

Freemium

100 free credits; one-time packs from $39 for 25,000 credits, no subscription

Prices change. Check scrapeeverything.com before you buy.

Scrape Everything FAQ

How do I get a key?

Create one in the Scrape Everything dashboard; keys begin ssk_live_.

What are the free credits?

New accounts get 100, about 100 profile lookups.

What are credit pack prices?

Builder $39 for 25,000, Growth $119 for 100,000, Scale $449 for 500,000.

Does it retry failures?

No, the server never retries by itself.

Is Scrape Everything free?

Scrape Everything has a free plan, with paid plans for more usage or features.

How do I add Scrape Everything to Claude Code?

Run this command in your terminal: claude mcp add mcp --env SCRAPEEVERYTHING_API_KEY='<SCRAPEEVERYTHING_API_KEY>' -- npx -y @scrapeeverything/mcp

What are the best alternatives to Scrape Everything?

The closest alternatives to Scrape Everything are Scrapling MCP Server, Firecrawl MCP Server, SearXNG Search, NeuralVerge and AI-Powered directory.

Alternatives to Scrape Everything

  1. MCP server for AI clients to scrape sites with HTTP and stealth browser sessions

    Runs locally
    • 17 tools
    • Open source
    • 104K GitHub stars
    • Web search and scraping
  2. MCP server that lets AI agents search, scrape and interact with web pages

    • 3 tools
    • Remote
    • Freemium
    • 7.8K GitHub stars
    • Web search and scraping
  3. SearXNG Search

    MCP server

    MCP server for web search and page reading through a SearXNG instance

    Runs locally
    • 3 tools
    • Open source
    • 1.4K GitHub stars
    • Web search and scraping
  4. NeuralVerge

    MCP server

    Structured, source-tagged business and people data from 300+ sources for agents

    • 200 tools
    • Remote
    • Free trial
    • 1 GitHub star
    • Web search and scraping
  5. Search AI tools, agents and MCP servers and get install configs from inside your AI assistant.

    • 4 tools
    • Remote
    • Free
    • Developer tools
  6. Hosted MCP server that returns any Shopify store's products, prices and stock

    Not checked yet
    • 4 tools
    • Remote
    • Paid
    • E-commerce