Skip to content
Skill

Power analysis

Use when the user is planning a two-arm comparison (an A/B test, a simple RCT, a behavioral study, or a two-model/two-config evaluation) and

Install
Scripts
Python
Platforms
Claude Code, Codex, Cursor
GitHub stars
183
Last commit
5 months ago
License
MIT
Listing updated
today

When your agent uses it

Use when the user is planning a two-arm comparison (an A/B test, a simple RCT, a behavioral study, or a two-model/two-config evaluation) and needs to size it and preregister it before collecting data — finding the per-group sample size that hits target statistical power for the smallest effect worth detecting, auditing the design against a validity checklist, and locking it in a preregistration. Only for a single two-arm comparison with one primary outcome. Not for factorial, repeated-measures, clustered/multilevel, time-series, adaptive, or survival designs; not for analyzing data already collected; not for choosing the outcome or manipulation from domain knowledge.

From the skill's SKILL.md. Your agent reads this description to decide when to load the skill.

What it can access

From a static check of its 3 files (14 KB) on GitHub on 17 November 2026. Nothing was run. Read the files before you install a skill: it can tell your agent to run anything its tools allow.

Install

This skill ships in the agent-loops plugin. In Claude Code, add the marketplace and install the plugin (it may include other skills too):

/plugin marketplace add gaasher/Agent-Loop-Skills
/plugin install agent-loops@agent-loop-skills

Or copy only this skill to ~/.claude/skills/power-analysis:

tmp=$(mktemp -d) &&
git clone --depth 1 https://github.com/gaasher/Agent-Loop-Skills.git "$tmp" &&
mkdir -p ~/.claude/skills &&
rm -rf ~/.claude/skills/power-analysis &&
cp -R "$tmp/loops/power-analysis" ~/.claude/skills/power-analysis &&
rm -rf "$tmp"

For one project only, put the folder in .claude/skills/power-analysis inside it instead.

Claude Code docs on skills

Copy the skill folder to ~/.agents/skills/power-analysis to use it in every repository:

tmp=$(mktemp -d) &&
git clone --depth 1 https://github.com/gaasher/Agent-Loop-Skills.git "$tmp" &&
mkdir -p ~/.agents/skills &&
rm -rf ~/.agents/skills/power-analysis &&
cp -R "$tmp/loops/power-analysis" ~/.agents/skills/power-analysis &&
rm -rf "$tmp"

For one repository only, put the folder in .agents/skills/power-analysis inside it instead.

Codex docs on skills

Copy the skill folder to ~/.cursor/skills/power-analysis to use it in every project:

tmp=$(mktemp -d) &&
git clone --depth 1 https://github.com/gaasher/Agent-Loop-Skills.git "$tmp" &&
mkdir -p ~/.cursor/skills &&
rm -rf ~/.cursor/skills/power-analysis &&
cp -R "$tmp/loops/power-analysis" ~/.cursor/skills/power-analysis &&
rm -rf "$tmp"

For one project only, put the folder in .cursor/skills/power-analysis inside it instead.

Cursor docs on skills

Run in a terminal (add --scope workspace to install it for the current workspace only):

gemini skills install https://github.com/gaasher/Agent-Loop-Skills.git --path loops/power-analysis

Or copy the folder to ~/.gemini/skills/power-analysis yourself.

Gemini CLI docs on skills

For GitHub Copilot in VS Code, copy the skill folder to ~/.copilot/skills/power-analysis:

tmp=$(mktemp -d) &&
git clone --depth 1 https://github.com/gaasher/Agent-Loop-Skills.git "$tmp" &&
mkdir -p ~/.copilot/skills &&
rm -rf ~/.copilot/skills/power-analysis &&
cp -R "$tmp/loops/power-analysis" ~/.copilot/skills/power-analysis &&
rm -rf "$tmp"

For one project only, put the folder in .github/skills/power-analysis inside it instead.

VS Code docs on skills

Get the folder:

git clone --depth 1 https://github.com/gaasher/Agent-Loop-Skills.git

Then copy Agent-Loop-Skills/loops/power-analysis into your agent's skills folder as power-analysis. Agents that support SKILL.md read one folder per skill.

The SKILL.md format

Power analysis FAQ

How do I install Power analysis in Claude Code?

Copy the skill folder from GitHub to ~/.claude/skills/power-analysis to use it in all your projects, or to .claude/skills/power-analysis in one project. Or install the agent-loops plugin, which includes it: /plugin marketplace add gaasher/Agent-Loop-Skills, then /plugin install agent-loops@agent-loop-skills.

Does Power analysis run scripts?

Yes. It runs Python scripts. No network calls were found in its scripts. This comes from a static check of the files on GitHub; nothing was run. Read the files before you install it.

Which AI agents can use Power analysis?

Claude Code, Codex, Cursor, Gemini CLI, GitHub Copilot, Windsurf and Goose. Each reads skills in the SKILL.md format from its own folder; the install steps on this page list them.

More from gaasher/Agent-Loop-Skills

  1. Use when the user wants to evolve an ML model/program through population-based search rather than a single sequential refine loop — a genera

    • Open source
    • 183 GitHub stars
  2. Use when the user has a known, already-observed anomaly in their data — a metric spike or drop, an outlier, an unexpected number — and wants

    • Open source
    • 183 GitHub stars
  3. Use when the user has concrete failing cases in code or a guardrail/classifier/filter/prompt/API they own — a red-team failure catalogue OR

    • Open source
    • 183 GitHub stars
    • Developer tools
  4. Use when the user has a results draft or a set of data-backed claims and wants each one adversarially verified against the underlying datase

    • Open source
    • 183 GitHub stars
  5. Use when the user wants an iterative, self-checking exploratory analysis of a dataset — surfacing findings that are each verified by re-runn

    • Open source
    • 183 GitHub stars
    • Analytics and data
  6. Use when the user wants two approaches raced head-to-head on a single shared metric — e.g

    • Open source
    • 183 GitHub stars