# vid2context

> vid2context is an open-source MCP server for design and media. Pulls transcripts, chapters and metadata from videos so agents can read and cite them. It runs locally on your machine and is started by your AI client.

- **Kind:** MCP server
- **Pricing:** Open source
- **Platforms:** CLI, API, Web
- **Website:** https://vid2context.com
- **Repository:** https://github.com/nirholas/vid2context
- **MCP Registry name:** io.github.nirholas/vid2context
- **Categories:** design and media, developer tools
- **Listing updated:** 2026-11-14

## About

Rather than needing a paid transcription API, it works down a fallback chain until text exists. It tries creator captions first, then platform auto-captions, then downloads the audio and runs speech-to-text. Each speech or language-model step is a rung with its own provider and credential, tried in tier order: local models, hosted free tiers using your own key, keyless hosts, and paid APIs last and only when a key is set. Every attempt is logged so you can see what ran.

Output comes as plain text with [m:ss] timestamps, JSON, Markdown, SRT, VTT or a zip, and several videos can be merged into one Markdown pack for upload to ChatGPT Projects or Claude Projects. The README lists YouTube videos, playlists and channels, anything yt-dlp supports, Vimeo, Loom, Wistia, Bilibili, Google Drive, Dropbox and OneDrive links, direct media URLs and local files as inputs.

The same engine ships as an MCP server on npm (vid2context-mcp), a CLI, an HTTP API and a library. API keys for Groq, Gemini, OpenAI, Ollama or a local speech-to-text server are all optional. This is a first release, 0.1.0.

## Features

- **Fallback transcription chain:** Uses captions when present, otherwise runs speech-to-text through local, free, keyless and paid rungs in order.
- **Cited timestamps:** Each transcript paragraph carries a time and link so agents can cite the exact moment.
- **Many sources:** Reads YouTube, Vimeo, podcast feeds, cloud-drive links, direct media files and anything yt-dlp supports.
- **Multiple output formats:** Exports text, JSON, Markdown, SRT, VTT or a zip bundle.
- **Context packs:** Combines many videos into one Markdown file for ChatGPT or Claude Projects.
- **Attempt log:** Records every resolve, metadata and caption step so failures are easy to trace.

## Good for

- Let an agent summarise a conference talk and cite the minute a claim was made
- Turn a playlist of car-buying videos into one searchable research pack
- Get a transcript of a podcast episode when no captions exist
- Export subtitles as SRT or VTT for a video

## Install

### Claude Code (Terminal)

```sh
claude mcp add vid2context --env GROQ_API_KEY='<GROQ_API_KEY>' --env GEMINI_API_KEY='<GEMINI_API_KEY>' --env OPENAI_API_KEY='<OPENAI_API_KEY>' -- npx -y vid2context-mcp
```

### Claude Desktop (claude_desktop_config.json)

```json
{
  "mcpServers": {
    "vid2context": {
      "command": "npx",
      "args": [
        "-y",
        "vid2context-mcp"
      ],
      "env": {
        "GROQ_API_KEY": "<GROQ_API_KEY>",
        "GEMINI_API_KEY": "<GEMINI_API_KEY>",
        "OPENAI_API_KEY": "<OPENAI_API_KEY>"
      }
    }
  }
}
```

### Cursor (~/.cursor/mcp.json)

```json
{
  "mcpServers": {
    "vid2context": {
      "command": "npx",
      "args": [
        "-y",
        "vid2context-mcp"
      ],
      "env": {
        "GROQ_API_KEY": "<GROQ_API_KEY>",
        "GEMINI_API_KEY": "<GEMINI_API_KEY>",
        "OPENAI_API_KEY": "<OPENAI_API_KEY>"
      }
    }
  }
}
```

### VS Code (.vscode/mcp.json)

```json
{
  "servers": {
    "vid2context": {
      "type": "stdio",
      "command": "npx",
      "args": [
        "-y",
        "vid2context-mcp"
      ],
      "env": {
        "GROQ_API_KEY": "<GROQ_API_KEY>",
        "GEMINI_API_KEY": "<GEMINI_API_KEY>",
        "OPENAI_API_KEY": "<OPENAI_API_KEY>"
      }
    }
  }
}
```

### Windsurf (~/.codeium/windsurf/mcp_config.json)

```json
{
  "mcpServers": {
    "vid2context": {
      "command": "npx",
      "args": [
        "-y",
        "vid2context-mcp"
      ],
      "env": {
        "GROQ_API_KEY": "<GROQ_API_KEY>",
        "GEMINI_API_KEY": "<GEMINI_API_KEY>",
        "OPENAI_API_KEY": "<OPENAI_API_KEY>"
      }
    }
  }
}
```

### Other clients (your client's MCP settings (most use this shape))

```json
{
  "mcpServers": {
    "vid2context": {
      "command": "npx",
      "args": [
        "-y",
        "vid2context-mcp"
      ],
      "env": {
        "GROQ_API_KEY": "<GROQ_API_KEY>",
        "GEMINI_API_KEY": "<GEMINI_API_KEY>",
        "OPENAI_API_KEY": "<OPENAI_API_KEY>"
      }
    }
  }
}
```

## FAQ

### Does it need an API key?

No. It works with zero configuration; keys for Groq, Gemini, OpenAI or a local Ollama server are optional.

### What happens when a video has no captions?

It downloads the audio and passes it through the speech-to-text rung chain.

### Is it free?

The site calls it free and open source, and paid APIs are only used when you set their key.

### Can it run offline?

Local whisper.cpp and Transformers.js are listed for offline speech recognition.

### Is vid2context free?

Yes. vid2context is open source, so you can use and self-host it for free.

### How do I add vid2context to Claude Code?

Run this command in your terminal: claude mcp add vid2context --env GROQ_API_KEY='<GROQ_API_KEY>' --env GEMINI_API_KEY='<GEMINI_API_KEY>' --env OPENAI_API_KEY='<OPENAI_API_KEY>' -- npx -y vid2context-mcp

### What are the best alternatives to vid2context?

The closest alternatives to vid2context are REA, HyperFrames by HeyGen, Codebase Memory, GitHub and Serena MCP: the IDE for your agent.

## Alternatives

- [REA](https://ai-powered.com/mcp/rea): REA is an open-source MCP server for developer tools.
- [HyperFrames by HeyGen](https://ai-powered.com/mcp/hyperframes-by-heygen): HyperFrames by HeyGen is a freemium MCP server for design and media.
- [Codebase Memory](https://ai-powered.com/mcp/codebase-memory): Codebase Memory is an open-source MCP server for knowledge and memory.
- [GitHub](https://ai-powered.com/mcp/github-2): GitHub is an open-source MCP server for developer tools.
- [Serena MCP: the IDE for your agent](https://ai-powered.com/mcp/serena-mcp-the-ide-for-your-agent): Serena MCP: the IDE for your agent is an open-source MCP server for developer tools.
- [XERJ](https://ai-powered.com/mcp/xerj): XERJ is an open-source MCP server for knowledge and memory.
- [ffmpeg-skill](https://ai-powered.com/mcp/ffmpeg-skill): ffmpeg-skill is an open-source MCP server for design and media.
- [Ouroboros](https://ai-powered.com/mcp/ouroboros): Ouroboros is an open-source MCP server for developer tools.

---
Source: https://ai-powered.com/mcp/vid2context
