Skip to content
Skill

Huggingface community evals

Run evaluations for Hugging Face Hub models using inspect-ai and lighteval on local hardware

Install
Scripts
Python
Platforms
Claude Code, Codex, Cursor
GitHub stars
11.4K
Last commit
4 days ago
License
Apache-2.0
Listing updated
today

When your agent uses it

Run evaluations for Hugging Face Hub models using inspect-ai and lighteval on local hardware. Use for backend selection, local GPU evals, and choosing between vLLM / Transformers / accelerate. Not for HF Jobs orchestration, model-card PRs, .eval_results publication, or community-evals automation.

From the skill's SKILL.md. Your agent reads this description to decide when to load the skill.

What it can access

From a static check of its 6 files (29 KB) on GitHub on 17 November 2026. Nothing was run. Read the files before you install a skill: it can tell your agent to run anything its tools allow.

Install

Copy the skill folder to ~/.claude/skills/huggingface-community-evals to use it in all your projects:

tmp=$(mktemp -d) &&
git clone --depth 1 https://github.com/huggingface/skills.git "$tmp" &&
mkdir -p ~/.claude/skills &&
rm -rf ~/.claude/skills/huggingface-community-evals &&
cp -R "$tmp/skills/huggingface-community-evals" ~/.claude/skills/huggingface-community-evals &&
rm -rf "$tmp"

For one project only, put the folder in .claude/skills/huggingface-community-evals inside it instead.

Claude Code docs on skills

Copy the skill folder to ~/.agents/skills/huggingface-community-evals to use it in every repository:

tmp=$(mktemp -d) &&
git clone --depth 1 https://github.com/huggingface/skills.git "$tmp" &&
mkdir -p ~/.agents/skills &&
rm -rf ~/.agents/skills/huggingface-community-evals &&
cp -R "$tmp/skills/huggingface-community-evals" ~/.agents/skills/huggingface-community-evals &&
rm -rf "$tmp"

For one repository only, put the folder in .agents/skills/huggingface-community-evals inside it instead.

Codex docs on skills

Copy the skill folder to ~/.cursor/skills/huggingface-community-evals to use it in every project:

tmp=$(mktemp -d) &&
git clone --depth 1 https://github.com/huggingface/skills.git "$tmp" &&
mkdir -p ~/.cursor/skills &&
rm -rf ~/.cursor/skills/huggingface-community-evals &&
cp -R "$tmp/skills/huggingface-community-evals" ~/.cursor/skills/huggingface-community-evals &&
rm -rf "$tmp"

For one project only, put the folder in .cursor/skills/huggingface-community-evals inside it instead.

Cursor docs on skills

Run in a terminal (add --scope workspace to install it for the current workspace only):

gemini skills install https://github.com/huggingface/skills.git --path skills/huggingface-community-evals

Or copy the folder to ~/.gemini/skills/huggingface-community-evals yourself.

Gemini CLI docs on skills

For GitHub Copilot in VS Code, copy the skill folder to ~/.copilot/skills/huggingface-community-evals:

tmp=$(mktemp -d) &&
git clone --depth 1 https://github.com/huggingface/skills.git "$tmp" &&
mkdir -p ~/.copilot/skills &&
rm -rf ~/.copilot/skills/huggingface-community-evals &&
cp -R "$tmp/skills/huggingface-community-evals" ~/.copilot/skills/huggingface-community-evals &&
rm -rf "$tmp"

For one project only, put the folder in .github/skills/huggingface-community-evals inside it instead.

VS Code docs on skills

Get the folder:

git clone --depth 1 https://github.com/huggingface/skills.git

Then copy skills/skills/huggingface-community-evals into your agent's skills folder as huggingface-community-evals. Agents that support SKILL.md read one folder per skill.

The SKILL.md format

Huggingface community evals FAQ

How do I install Huggingface community evals in Claude Code?

Copy the skill folder from GitHub to ~/.claude/skills/huggingface-community-evals to use it in all your projects, or to .claude/skills/huggingface-community-evals in one project.

Does Huggingface community evals run scripts?

Yes. It runs Python scripts. No network calls were found in its scripts. This comes from a static check of the files on GitHub; nothing was run. Read the files before you install it.

Which AI agents can use Huggingface community evals?

Claude Code, Codex, Cursor, Gemini CLI, GitHub Copilot, Windsurf and Goose. Each reads skills in the SKILL.md format from its own folder; the install steps on this page list them.

What are the best alternatives to Huggingface community evals?

The closest alternatives to Huggingface community evals are MCP builder, Academy guide, Claude API, Nano banana pro openrouter and Generate image.

More from huggingface/skills

  1. Use Hugging Face Hub via MCP server tools

    • Open source
    • 11.4K GitHub stars
  2. Hugging Face Hub CLI (`hf`) for downloading, uploading, and managing models, datasets, spaces, buckets, repos, papers, jobs, and more on the

    • Open source
    • 11.4K GitHub stars
    • AI models and LLM tooling
  3. Discover the user's local AWS context (active profile, region, account ID, caller identity) at the start of any AWS task

    • Open source
    • 11.4K GitHub stars
    • Cloud and infrastructure
  4. Set up an isolated Python environment for SageMaker / AWS work, with the right Python version and current boto3

    • Open source
    • 11.4K GitHub stars

Alternatives to Huggingface community evals

  1. Guide for creating high-quality MCP (Model Context Protocol) servers that enable LLMs to interact with external services through well-design

    • 196K GitHub stars
    • AI models and LLM tooling
  2. Stop and check this skill before finishing any reply to a question about how to use Claude or a Claude product — it recommends matching cour

    • 196K GitHub stars
    • AI models and LLM tooling
  3. Reference for the Claude API / Anthropic SDK — model ids, pricing, params, streaming, tool use, MCP, agents, caching, token counting, model

    • 196K GitHub stars
    • AI models and LLM tooling
  4. Generate or edit images via OpenRouter with the Gemini 3 Pro Image model

    • Open source
    • 41.3K GitHub stars
    • Design and media
  5. Generate images using AI

    • Open source
    • 41.3K GitHub stars
    • Design and media
  6. Build and run evaluators for AI/LLM applications using Phoenix.

    • Open source
    • 41.3K GitHub stars
    • AI models and LLM tooling