# Diffbot

> Diffbot is a freemium MCP server for web search and scraping. Search the web, extract pages and query a knowledge graph through Diffbot's index. It can run locally on your machine or as a hosted remote server.

- **Kind:** MCP server
- **Pricing:** Freemium
- **Starting price:** $299 a month
- **Platforms:** API, CLI
- **Website:** https://www.diffbot.com
- **Repository:** https://github.com/diffbot/diffbot-mcp
- **MCP Registry name:** io.github.diffbot/diffbot-mcp
- **Categories:** web search and scraping, analytics and data
- **Listing updated:** 2026-11-14

## About

Diffbot's server swaps raw HTML or markdown for classified, structured JSON. Its extract tool identifies what kind of page it is fetching and returns a consistent schema tuned for low token use. search_web runs on Diffbot's own index and favours primary sources over coverage of them, with num_results and max_tokens controls and a page-cache reader that returns an already parsed copy for url: queries.

Beyond the web tools, it reaches a knowledge graph the page puts at over 10 billion entities. News can be searched by entity, topic, publisher, language, date or sentiment, organizations by industry and size, and resolve_entities maps names in text to graph IDs, returning a ready filter for fetching full records. Crawls run as background jobs you poll.

It runs as a local pypi package or a hosted endpoint with a Diffbot account; a free token exists.

## Features

- **Classified extraction:** Returns structured JSON by page type instead of raw HTML.
- **Source-ranked search:** Favours primary sources and supports result and token limits.
- **Page cache reader:** Gets Diffbot's parsed copy of a URL quickly.
- **Background crawls:** Walks a site from a seed URL as pollable jobs.
- **Entity resolution:** Links names in text to Knowledge Graph IDs.
- **Knowledge Graph search:** Queries news and organizations.

## Good for

- Ground an agent answer in current web sources
- Archive documentation by crawling a site
- Research companies by industry or size
- Link entities in a document to graph records

## Install

### Claude Code (Terminal)

```sh
claude mcp add --transport http diffbot-mcp https://mcp.diffbot.com/mcp
```

### Claude Desktop (Settings → Connectors → Add custom connector)

```sh
https://mcp.diffbot.com/mcp
```

### Cursor (~/.cursor/mcp.json)

```json
{
  "mcpServers": {
    "diffbot-mcp": {
      "url": "https://mcp.diffbot.com/mcp"
    }
  }
}
```

### VS Code (.vscode/mcp.json)

```json
{
  "servers": {
    "diffbot-mcp": {
      "type": "http",
      "url": "https://mcp.diffbot.com/mcp"
    }
  }
}
```

### Windsurf (~/.codeium/windsurf/mcp_config.json)

```json
{
  "mcpServers": {
    "diffbot-mcp": {
      "serverUrl": "https://mcp.diffbot.com/mcp"
    }
  }
}
```

### Other clients (your client's MCP settings (most use this shape))

```json
{
  "mcpServers": {
    "diffbot-mcp": {
      "type": "http",
      "url": "https://mcp.diffbot.com/mcp"
    }
  }
}
```

## Tools

- `extract`: Classify a page and extract structured JSON
- `search_web`: Search Diffbot's web index with source-ranked results
- `crawl`: Crawl a site from a seed URL as a background job
- `resolve_entities`: Recognize entities in text and resolve them to Knowledge Graph IDs
- `search_news`: Search news and articles by entity, topic, publisher, language, date or sentiment
- `search_organizations`: Search companies by industry and other attributes

## FAQ

### Is there a free plan?

Yes, 10,000 credits a month with no credit card.

### What do paid plans cost?

Startup is $299 a month and Plus is $899 a month; Enterprise is custom.

### How is usage billed?

In credits; extracting a page costs 1 credit and exporting a graph entity costs 25.

### How do I sign in?

The hosted server signs in with a Diffbot account; the local package can use DIFFBOT_TOKEN.

### Is Diffbot free?

Diffbot has a free plan, with paid plans for more usage or features. Paid plans start at $299 a month.

### How do I add Diffbot to Claude Code?

Run this command in your terminal: claude mcp add --transport http diffbot-mcp https://mcp.diffbot.com/mcp

### What are the best alternatives to Diffbot?

The closest alternatives to Diffbot are Scrapling MCP Server, Firecrawl MCP Server, Agent-Native Analytics, Google Ads + Meta Ads + SEO/GEO MCP and SearXNG Search.

## Alternatives

- [Scrapling MCP Server](https://ai-powered.com/mcp/scrapling-mcp-server): Scrapling MCP Server is an open-source MCP server for web search and scraping.
- [Firecrawl MCP Server](https://ai-powered.com/mcp/firecrawl-mcp-server): Firecrawl MCP Server is a freemium MCP server for web search and scraping.
- [Agent-Native Analytics](https://ai-powered.com/mcp/agent-native-analytics): Agent-Native Analytics is an open-source MCP server for analytics and data.
- [Google Ads + Meta Ads + SEO/GEO MCP](https://ai-powered.com/mcp/google-ads-meta-ads-seo-geo-mcp): Google Ads + Meta Ads + SEO/GEO MCP is a freemium MCP server for marketing and seo.
- [SearXNG Search](https://ai-powered.com/mcp/searxng-search): SearXNG Search is an open-source MCP server for web search and scraping.
- [Tapetide - Indian Stock Market MCP](https://ai-powered.com/mcp/tapetide-indian-stock-market-mcp): Tapetide - Indian Stock Market MCP is a freemium MCP server for finance and payments.
- [World Monitor](https://ai-powered.com/mcp/world-monitor): World Monitor is a freemium MCP server for analytics and data.
- [CompanyData](https://ai-powered.com/mcp/companydata): CompanyData is a paid MCP server for analytics and data.

---
Source: https://ai-powered.com/mcp/diffbot
