Frame Lens
Local MCP server that measures cuts, easing, palette and beats in video for agents
- Pricing
- Open source
- Platforms
- CLI, macOS, Windows
- Runs
- Locally
- Version
- 2.1.0
- Listing updated
- 3 days ago
About Frame Lens
Frame Lens is an open-source MCP server for design and media. It runs locally on your machine and is started by your AI client.
Most agents that watch video get a few stills or captions and guess at motion. Frame Lens returns numbers instead: cuts to the exact frame, each move with its duration and fitted easing curve, an OKLab palette per shot, loudness, tempo and beat grid, and transcripts with word timings. Every figure is tagged as measured, derived or inferred.
In its own test it animated a square in HyperFrames, measured it back, and recovered the curve within 0.18 px; the README also reports 33 of 33 cuts found on the exact frame in synthetic clips at 24, 30 and 60 fps. Live websites, Lottie, Rive and Figma are read from their own data rather than from pixels. The tools named include track, export and compare: export writes a measured curve into CSS, Remotion, HyperFrames, After Effects or Lottie, and compare checks a render against the reference.
It is free and MIT licensed, runs locally on Node 20 with ffmpeg and yt-dlp fetched on first use with checksums, and needs no API key except for the optional Gemini YouTube tools.
Install
Run in a terminal
claude mcp add framelens --env GEMINI_API_KEY='<GEMINI_API_KEY>' -- npx -y framelensAdd to claude_desktop_config.json
{
"mcpServers": {
"framelens": {
"command": "npx",
"args": [
"-y",
"framelens"
],
"env": {
"GEMINI_API_KEY": "<GEMINI_API_KEY>"
}
}
}
}Add to ~/.cursor/mcp.json
{
"mcpServers": {
"framelens": {
"command": "npx",
"args": [
"-y",
"framelens"
],
"env": {
"GEMINI_API_KEY": "<GEMINI_API_KEY>"
}
}
}
}Add to .vscode/mcp.json
{
"servers": {
"framelens": {
"type": "stdio",
"command": "npx",
"args": [
"-y",
"framelens"
],
"env": {
"GEMINI_API_KEY": "<GEMINI_API_KEY>"
}
}
}
}Add to ~/.codeium/windsurf/mcp_config.json
{
"mcpServers": {
"framelens": {
"command": "npx",
"args": [
"-y",
"framelens"
],
"env": {
"GEMINI_API_KEY": "<GEMINI_API_KEY>"
}
}
}
}Add to your client's MCP settings (most use this shape)
{
"mcpServers": {
"framelens": {
"command": "npx",
"args": [
"-y",
"framelens"
],
"env": {
"GEMINI_API_KEY": "<GEMINI_API_KEY>"
}
}
}
}Configuration
GEMINI_API_KEYOptional. Google Gemini API key, only for the Gemini YouTube tools; the local tools need no key.GEMINI_MODEL_NAMEOptional. Gemini model for the Gemini tools.FRAMELENS_WORKSPACEOptional. Folder for results; defaults to .framelens in the working folder (or ~/.framelens).FRAMELENS_AUTO_INSTALLOptional. Set to 0 to stop the automatic, hash-checked download of a missing ffmpeg or yt-dlp.
Tools this server provides (3)
Taken from the project documentation; the running server may differ.
- track
- Measures moves and fits easing curves from a video.
- export
- Writes a measured curve into CSS, Remotion, HyperFrames, After Effects or Lottie.
- compare
- Checks your render against the reference.
What it does
- Frame-exact cuts
- Finds cuts, fades and dissolves with their frame positions.
- Easing curves
- Fits cubic-bezier or spring values to each measured move.
- Audio analysis
- Reports loudness, tempo, beat grid and word-timed transcripts.
- Five export targets
- Writes starter projects for CSS, Remotion, HyperFrames, After Effects and Lottie.
- Token-saving frames
- Sends an overview sheet first, then dense frames only around changes.
Good for
- Rebuild a promo video's motion in Remotion
- Turn a tutorial into a step-by-step guide with a frame per screen
- Find where in a long talk a topic is discussed
- Check whether cuts land on the beat
- Compare a render against a reference animation
Pricing
Open source
Free, MIT
Prices change. Check makkov-design.github.io before you buy.
Frame Lens FAQ
Does it need an API key?
No, except the optional Gemini key for the Gemini YouTube tools.
What does it need installed?
Node.js 20 and ffmpeg; yt-dlp is downloaded and checksum-verified on first use.
Which sources can it read?
Local video files, YouTube and many other sites, live websites, Lottie, Rive and Figma.
What is the licence?
MIT, according to the site.
Is Frame Lens free?
Yes. Frame Lens is open source, so you can use and self-host it for free.
How do I add Frame Lens to Claude Code?
Run this command in your terminal: claude mcp add framelens --env GEMINI_API_KEY='<GEMINI_API_KEY>' -- npx -y framelens
What are the best alternatives to Frame Lens?
The closest alternatives to Frame Lens are HyperFrames by HeyGen, ffmpeg-skill, AvatarSay — Fictional Character & Talking Video MCP, ChartAnt and VfxSmith.
Alternatives to Frame Lens

HyperFrames by HeyGen
MCP serverHosted MCP connector for creating and rendering videos from HTML through AI chat
- Remote
- Freemium
- 85.3K GitHub stars
- Design and media

ffmpeg-skill
MCP serverLocal FFmpeg video and audio editing tools for coding agents over MCP
Runs locally- Open source
- 6.9K GitHub stars
- Design and media

Generate fictional character portraits and lip-synced talking videos from text over MCP
- 10 tools
- Remote
- Freemium
- Design and media

ChartAnt
MCP serverRemote MCP server returning charts, maps and dashboards as hosted PNG links
- 51 tools
- Remote
- Freemium
- Design and media

VfxSmith
MCP serverSearch, generate, refine and export pixel art game effects from Claude Code or Codex
Not checked yet- Remote
- Freemium
- Design and media

CalderFlow
MCP serverTurn notes or specs into editable flowcharts, timelines and funnels from an AI assistant
- 10 tools
- Remote
- Free
- Design and media