
Power analysis
Use when the user is planning a two-arm comparison (an A/B test, a simple RCT, a behavioral study, or a two-model/two-config evaluation) and
- Scripts
- Python
- Platforms
- Claude Code, Codex, Cursor
- GitHub stars
- 183
- Last commit
- 5 months ago
- License
- MIT
- Listing updated
- today
When your agent uses it
Use when the user is planning a two-arm comparison (an A/B test, a simple RCT, a behavioral study, or a two-model/two-config evaluation) and needs to size it and preregister it before collecting data — finding the per-group sample size that hits target statistical power for the smallest effect worth detecting, auditing the design against a validity checklist, and locking it in a preregistration. Only for a single two-arm comparison with one primary outcome. Not for factorial, repeated-measures, clustered/multilevel, time-series, adaptive, or survival designs; not for analyzing data already collected; not for choosing the outcome or manipulation from domain knowledge.
From the skill's SKILL.md. Your agent reads this description to decide when to load the skill.
What it can access
- Runs Python scripts(see the files on GitHub)
- No network calls found in its scripts(see the files on GitHub)
- License: MIT(see the files on GitHub)
From a static check of its 3 files (14 KB) on GitHub on 17 November 2026. Nothing was run. Read the files before you install a skill: it can tell your agent to run anything its tools allow.
Install
This skill ships in the agent-loops plugin. In Claude Code, add the marketplace and install the plugin (it may include other skills too):
/plugin marketplace add gaasher/Agent-Loop-Skills
/plugin install agent-loops@agent-loop-skillsOr copy only this skill to ~/.claude/skills/power-analysis:
tmp=$(mktemp -d) &&
git clone --depth 1 https://github.com/gaasher/Agent-Loop-Skills.git "$tmp" &&
mkdir -p ~/.claude/skills &&
rm -rf ~/.claude/skills/power-analysis &&
cp -R "$tmp/loops/power-analysis" ~/.claude/skills/power-analysis &&
rm -rf "$tmp"For one project only, put the folder in .claude/skills/power-analysis inside it instead.
Copy the skill folder to ~/.agents/skills/power-analysis to use it in every repository:
tmp=$(mktemp -d) &&
git clone --depth 1 https://github.com/gaasher/Agent-Loop-Skills.git "$tmp" &&
mkdir -p ~/.agents/skills &&
rm -rf ~/.agents/skills/power-analysis &&
cp -R "$tmp/loops/power-analysis" ~/.agents/skills/power-analysis &&
rm -rf "$tmp"For one repository only, put the folder in .agents/skills/power-analysis inside it instead.
Copy the skill folder to ~/.cursor/skills/power-analysis to use it in every project:
tmp=$(mktemp -d) &&
git clone --depth 1 https://github.com/gaasher/Agent-Loop-Skills.git "$tmp" &&
mkdir -p ~/.cursor/skills &&
rm -rf ~/.cursor/skills/power-analysis &&
cp -R "$tmp/loops/power-analysis" ~/.cursor/skills/power-analysis &&
rm -rf "$tmp"For one project only, put the folder in .cursor/skills/power-analysis inside it instead.
Run in a terminal (add --scope workspace to install it for the current workspace only):
gemini skills install https://github.com/gaasher/Agent-Loop-Skills.git --path loops/power-analysisOr copy the folder to ~/.gemini/skills/power-analysis yourself.
For GitHub Copilot in VS Code, copy the skill folder to ~/.copilot/skills/power-analysis:
tmp=$(mktemp -d) &&
git clone --depth 1 https://github.com/gaasher/Agent-Loop-Skills.git "$tmp" &&
mkdir -p ~/.copilot/skills &&
rm -rf ~/.copilot/skills/power-analysis &&
cp -R "$tmp/loops/power-analysis" ~/.copilot/skills/power-analysis &&
rm -rf "$tmp"For one project only, put the folder in .github/skills/power-analysis inside it instead.
Get the folder:
git clone --depth 1 https://github.com/gaasher/Agent-Loop-Skills.gitThen copy Agent-Loop-Skills/loops/power-analysis into your agent's skills folder as power-analysis. Agents that support SKILL.md read one folder per skill.
Power analysis FAQ
How do I install Power analysis in Claude Code?
Copy the skill folder from GitHub to ~/.claude/skills/power-analysis to use it in all your projects, or to .claude/skills/power-analysis in one project. Or install the agent-loops plugin, which includes it: /plugin marketplace add gaasher/Agent-Loop-Skills, then /plugin install agent-loops@agent-loop-skills.
Does Power analysis run scripts?
Yes. It runs Python scripts. No network calls were found in its scripts. This comes from a static check of the files on GitHub; nothing was run. Read the files before you install it.
Which AI agents can use Power analysis?
Claude Code, Codex, Cursor, Gemini CLI, GitHub Copilot, Windsurf and Goose. Each reads skills in the SKILL.md format from its own folder; the install steps on this page list them.
More from gaasher/Agent-Loop-Skills

Use when the user wants to evolve an ML model/program through population-based search rather than a single sequential refine loop — a genera
- Open source
- 183 GitHub stars

Use when the user has a known, already-observed anomaly in their data — a metric spike or drop, an outlier, an unexpected number — and wants
- Open source
- 183 GitHub stars

Use when the user has concrete failing cases in code or a guardrail/classifier/filter/prompt/API they own — a red-team failure catalogue OR
- Open source
- 183 GitHub stars
- Developer tools

Use when the user has a results draft or a set of data-backed claims and wants each one adversarially verified against the underlying datase
- Open source
- 183 GitHub stars

Use when the user wants an iterative, self-checking exploratory analysis of a dataset — surfacing findings that are each verified by re-runn
- Open source
- 183 GitHub stars
- Analytics and data

Use when the user wants two approaches raced head-to-head on a single shared metric — e.g
- Open source
- 183 GitHub stars