Skip to content
MCP server

Frame Lens

Local MCP server that measures cuts, easing, palette and beats in video for agents

Runs locallyStatus and history
Install
Pricing
Open source
Platforms
CLI, macOS, Windows
Runs
Locally
Version
2.1.0
Listing updated
3 days ago

About Frame Lens

Frame Lens is an open-source MCP server for design and media. It runs locally on your machine and is started by your AI client.

Most agents that watch video get a few stills or captions and guess at motion. Frame Lens returns numbers instead: cuts to the exact frame, each move with its duration and fitted easing curve, an OKLab palette per shot, loudness, tempo and beat grid, and transcripts with word timings. Every figure is tagged as measured, derived or inferred.

In its own test it animated a square in HyperFrames, measured it back, and recovered the curve within 0.18 px; the README also reports 33 of 33 cuts found on the exact frame in synthetic clips at 24, 30 and 60 fps. Live websites, Lottie, Rive and Figma are read from their own data rather than from pixels. The tools named include track, export and compare: export writes a measured curve into CSS, Remotion, HyperFrames, After Effects or Lottie, and compare checks a render against the reference.

It is free and MIT licensed, runs locally on Node 20 with ffmpeg and yt-dlp fetched on first use with checksums, and needs no API key except for the optional Gemini YouTube tools.

Install

Run in a terminal

claude mcp add framelens --env GEMINI_API_KEY='<GEMINI_API_KEY>' -- npx -y framelens

Add to claude_desktop_config.json

{
  "mcpServers": {
    "framelens": {
      "command": "npx",
      "args": [
        "-y",
        "framelens"
      ],
      "env": {
        "GEMINI_API_KEY": "<GEMINI_API_KEY>"
      }
    }
  }
}

Add to ~/.cursor/mcp.json

{
  "mcpServers": {
    "framelens": {
      "command": "npx",
      "args": [
        "-y",
        "framelens"
      ],
      "env": {
        "GEMINI_API_KEY": "<GEMINI_API_KEY>"
      }
    }
  }
}

Add to .vscode/mcp.json

{
  "servers": {
    "framelens": {
      "type": "stdio",
      "command": "npx",
      "args": [
        "-y",
        "framelens"
      ],
      "env": {
        "GEMINI_API_KEY": "<GEMINI_API_KEY>"
      }
    }
  }
}

Add to ~/.codeium/windsurf/mcp_config.json

{
  "mcpServers": {
    "framelens": {
      "command": "npx",
      "args": [
        "-y",
        "framelens"
      ],
      "env": {
        "GEMINI_API_KEY": "<GEMINI_API_KEY>"
      }
    }
  }
}

Add to your client's MCP settings (most use this shape)

{
  "mcpServers": {
    "framelens": {
      "command": "npx",
      "args": [
        "-y",
        "framelens"
      ],
      "env": {
        "GEMINI_API_KEY": "<GEMINI_API_KEY>"
      }
    }
  }
}

Configuration

  • GEMINI_API_KEYOptional. Google Gemini API key, only for the Gemini YouTube tools; the local tools need no key.
  • GEMINI_MODEL_NAMEOptional. Gemini model for the Gemini tools.
  • FRAMELENS_WORKSPACEOptional. Folder for results; defaults to .framelens in the working folder (or ~/.framelens).
  • FRAMELENS_AUTO_INSTALLOptional. Set to 0 to stop the automatic, hash-checked download of a missing ffmpeg or yt-dlp.

Tools this server provides (3)

Taken from the project documentation; the running server may differ.

track
Measures moves and fits easing curves from a video.
export
Writes a measured curve into CSS, Remotion, HyperFrames, After Effects or Lottie.
compare
Checks your render against the reference.

What it does

Frame-exact cuts
Finds cuts, fades and dissolves with their frame positions.
Easing curves
Fits cubic-bezier or spring values to each measured move.
Audio analysis
Reports loudness, tempo, beat grid and word-timed transcripts.
Five export targets
Writes starter projects for CSS, Remotion, HyperFrames, After Effects and Lottie.
Token-saving frames
Sends an overview sheet first, then dense frames only around changes.

Good for

  • Rebuild a promo video's motion in Remotion
  • Turn a tutorial into a step-by-step guide with a frame per screen
  • Find where in a long talk a topic is discussed
  • Check whether cuts land on the beat
  • Compare a render against a reference animation

Pricing

Open source

Free, MIT

Prices change. Check makkov-design.github.io before you buy.

Frame Lens FAQ

Does it need an API key?

No, except the optional Gemini key for the Gemini YouTube tools.

What does it need installed?

Node.js 20 and ffmpeg; yt-dlp is downloaded and checksum-verified on first use.

Which sources can it read?

Local video files, YouTube and many other sites, live websites, Lottie, Rive and Figma.

What is the licence?

MIT, according to the site.

Is Frame Lens free?

Yes. Frame Lens is open source, so you can use and self-host it for free.

How do I add Frame Lens to Claude Code?

Run this command in your terminal: claude mcp add framelens --env GEMINI_API_KEY='<GEMINI_API_KEY>' -- npx -y framelens

What are the best alternatives to Frame Lens?

The closest alternatives to Frame Lens are HyperFrames by HeyGen, ffmpeg-skill, AvatarSay — Fictional Character & Talking Video MCP, ChartAnt and VfxSmith.

Alternatives to Frame Lens

  1. Hosted MCP connector for creating and rendering videos from HTML through AI chat

    • Remote
    • Freemium
    • 85.3K GitHub stars
    • Design and media
  2. ffmpeg-skill

    MCP server

    Local FFmpeg video and audio editing tools for coding agents over MCP

    Runs locally
    • Open source
    • 6.9K GitHub stars
    • Design and media
  3. ChartAnt

    MCP server

    Remote MCP server returning charts, maps and dashboards as hosted PNG links

    • 51 tools
    • Remote
    • Freemium
    • Design and media
  4. VfxSmith

    MCP server

    Search, generate, refine and export pixel art game effects from Claude Code or Codex

    Not checked yet
    • Remote
    • Freemium
    • Design and media
  5. CalderFlow

    MCP server

    Turn notes or specs into editable flowcharts, timelines and funnels from an AI assistant

    • 10 tools
    • Remote
    • Free
    • Design and media