Skip to content
MCP server

skillcheck

Check an agent skill against the ones you already have before you install it

Install
Pricing
Free
Platforms
API, CLI, Web
Runs
Remotely
Version
0.1.2
Listing updated
2 days ago

About skillcheck

skillcheck is a free MCP server for developer tools. It runs as a hosted remote server, so there is nothing to install locally.

Skills that pass an isolated eval can still lose requests in real use, because dozens of other skills and plugins sit beside them. The author reports prompts that fired 21 of 21 times in an isolated plugin eval but missed 5 times in the real harness. This project targets that gap.

The hosted remote server runs static checks on any public GitHub repo and needs no install. preflight_skill takes a GitHub URL plus the skills you already have, and reports name clashes that would shadow an installed skill, which of your skills the new one is most likely to take requests from, and how much the skill listing grows. check_skill_repo reports frontmatter errors, name mismatches, weak or slash-only descriptions, nested SKILL.md files, duplicate names and overlapping descriptions.

Real trigger measurement is separate: a one-file Python 3 script runs your prompts through your own claude and codex CLIs with everything loaded, then reports fire rates, false fires and which skill took the request. It uses your own CLI login and the README says nothing is sent to the author unless you opt in to an upload.

Install

Run in a terminal

claude mcp add --transport http skillcheck https://skillcheck-alpha.vercel.app/mcp

Add to Settings → Connectors → Add custom connector

https://skillcheck-alpha.vercel.app/mcp
Install in CursorOpens Cursor, which asks you to confirm. Or add it by hand:

Add to ~/.cursor/mcp.json

{
  "mcpServers": {
    "skillcheck": {
      "url": "https://skillcheck-alpha.vercel.app/mcp"
    }
  }
}
Install in VS CodeOpens VS Code, which asks you to confirm. Or add it by hand:

Add to .vscode/mcp.json

{
  "servers": {
    "skillcheck": {
      "type": "http",
      "url": "https://skillcheck-alpha.vercel.app/mcp"
    }
  }
}

Add to ~/.codeium/windsurf/mcp_config.json

{
  "mcpServers": {
    "skillcheck": {
      "serverUrl": "https://skillcheck-alpha.vercel.app/mcp"
    }
  }
}

Add to your client's MCP settings (most use this shape)

{
  "mcpServers": {
    "skillcheck": {
      "type": "http",
      "url": "https://skillcheck-alpha.vercel.app/mcp"
    }
  }
}

Tools this server provides (2)

Taken from the project documentation; the running server may differ.

preflight_skill
Shows which installed skills a new skill would clash with or take requests from.
check_skill_repo
Runs static checks on a public GitHub skill repo.

What it does

Preflight check
preflight_skill shows name clashes and likely rivals before a new skill is installed.
Repo linting
check_skill_repo flags frontmatter errors, weak descriptions, nested files and duplicate names.
Overlap detection
Finds pairs of skills whose descriptions overlap enough to compete.
Real trigger runs
The CLI repeats prompts through claude and codex to show fire rates and which skill took the request.
Before and after compare
Compares results after you rewrite a skill description.
Local and private
Runs use your own CLI login; uploads are opt-in and send only skill names and hit or miss rows.

Good for

  • Check a skill pack from GitHub before installing it
  • Find out which installed skill steals requests from your skill
  • Verify a description rewrite improved the trigger rate
  • Audit a published skill repo for frontmatter and naming mistakes

Pricing

Free

Free; runs locally with your own CLI login

Prices change. Check skillcheck-alpha.vercel.app before you buy.

skillcheck FAQ

Does the hosted server measure real triggering?

No. It runs static checks on public GitHub repos. Real trigger measurement needs the CLI, because it must run in your setup.

Is the server read-only?

Yes, the README describes it as a hosted, read-only MCP server.

Which agents are supported?

Skill discovery covers Claude Code, including user, project and plugin skills, and Codex skill folders.

What does the CLI need?

A single Python 3 file using the standard library, with PyYAML used for frontmatter checks if installed.

Is skillcheck free?

Yes. skillcheck is free to use.

How do I add skillcheck to Claude Code?

Run this command in your terminal: claude mcp add --transport http skillcheck https://skillcheck-alpha.vercel.app/mcp

What are the best alternatives to skillcheck?

The closest alternatives to skillcheck are REA, Codebase Memory, GitHub, Serena MCP: the IDE for your agent and XERJ.

Alternatives to skillcheck

  1. REA

    MCP server

    CLI and MCP server that lets coding agents reverse engineer apps and binaries

    Runs locally
    • Open source
    • 464K GitHub stars
    • Developer tools
  2. Codebase Memory

    MCP server

    Local MCP server that builds a code knowledge graph for AI coding agents

    Runs locally
    • Open source
    • 48.7K GitHub stars
    • Knowledge and memory
  3. GitHub

    MCP server

    Official MCP server connecting AI assistants to GitHub repos, issues and workflows

    Not checked yet
    • Remote
    • Open source
    • 34.5K GitHub stars
    • Developer tools
  4. MCP toolkit giving coding agents symbol-level code retrieval and editing

    Runs locally
    • Open source
    • 31.5K GitHub stars
    • Developer tools
  5. XERJ

    MCP server

    Local search engine for AI agents with cited answers over your code and docs

    Runs locally
    • Open source
    • 19.2K GitHub stars
    • Knowledge and memory
  6. Ouroboros

    MCP server

    Spec-first layer that pins requirements and verifies results of AI coding agent work

    Runs locally
    • Open source
    • 6.4K GitHub stars
    • Developer tools