# Power analysis

> Power analysis is an open-source agent skill. Use when the user is planning a two-arm comparison (an A/B test, a simple RCT, a behavioral study, or a two-model/two-config evaluation) and. It is available on Claude Code, Codex, Cursor, Gemini CLI, GitHub Copilot, Windsurf and Goose.

- **Kind:** Skill
- **Pricing:** Open source
- **Platforms:** Claude Code, Codex, Cursor, Gemini CLI, GitHub Copilot, Windsurf, Goose
- **Website:** https://github.com/gaasher/Agent-Loop-Skills/tree/main/loops/power-analysis
- **Repository:** https://github.com/gaasher/agent-loop-skills
- **GitHub stars:** 183
- **License:** MIT
- **Skill name:** power-analysis
- **Collection:** https://github.com/gaasher/Agent-Loop-Skills
- **Listing updated:** 2026-11-17

## About

Use when the user is planning a two-arm comparison (an A/B test, a simple RCT, a behavioral study, or a two-model/two-config evaluation) and needs to size it and preregister it before collecting data — finding the per-group sample size that hits target statistical power for the smallest effect worth detecting, auditing the design against a validity checklist, and locking it in a preregistration. Only for a single two-arm comparison with one primary outcome. Not for factorial, repeated-measures, clustered/multilevel, time-series, adaptive, or survival designs; not for analyzing data already collected; not for choosing the outcome or manipulation from domain knowledge.

## When your agent uses it

> Use when the user is planning a two-arm comparison (an A/B test, a simple RCT, a behavioral study, or a two-model/two-config evaluation) and needs to size it and preregister it before collecting data — finding the per-group sample size that hits target statistical power for the smallest effect worth detecting, auditing the design against a validity checklist, and locking it in a preregistration. Only for a single two-arm comparison with one primary outcome. Not for factorial, repeated-measures, clustered/multilevel, time-series, adaptive, or survival designs; not for analyzing data already collected; not for choosing the outcome or manipulation from domain knowledge.

## What it can access

From a static check of the files on GitHub; nothing was run.

- [Runs Python scripts](https://github.com/gaasher/Agent-Loop-Skills/tree/HEAD/loops/power-analysis)
- [No network calls found in its scripts](https://github.com/gaasher/Agent-Loop-Skills/tree/HEAD/loops/power-analysis)
- [License: MIT](https://github.com/gaasher/Agent-Loop-Skills/tree/HEAD/loops/power-analysis)

## Install

### Claude Code

This skill ships in the `agent-loops` plugin. In Claude Code, add the marketplace and install the plugin (it may include other skills too):

```sh
/plugin marketplace add gaasher/Agent-Loop-Skills
/plugin install agent-loops@agent-loop-skills
```

Or copy only this skill to `~/.claude/skills/power-analysis`:

```sh
tmp=$(mktemp -d) &&
git clone --depth 1 https://github.com/gaasher/Agent-Loop-Skills.git "$tmp" &&
mkdir -p ~/.claude/skills &&
rm -rf ~/.claude/skills/power-analysis &&
cp -R "$tmp/loops/power-analysis" ~/.claude/skills/power-analysis &&
rm -rf "$tmp"
```

For one project only, put the folder in `.claude/skills/power-analysis` inside it instead.

### Codex

Copy the skill folder to `~/.agents/skills/power-analysis` to use it in every repository:

```sh
tmp=$(mktemp -d) &&
git clone --depth 1 https://github.com/gaasher/Agent-Loop-Skills.git "$tmp" &&
mkdir -p ~/.agents/skills &&
rm -rf ~/.agents/skills/power-analysis &&
cp -R "$tmp/loops/power-analysis" ~/.agents/skills/power-analysis &&
rm -rf "$tmp"
```

For one repository only, put the folder in `.agents/skills/power-analysis` inside it instead.

### Cursor

Copy the skill folder to `~/.cursor/skills/power-analysis` to use it in every project:

```sh
tmp=$(mktemp -d) &&
git clone --depth 1 https://github.com/gaasher/Agent-Loop-Skills.git "$tmp" &&
mkdir -p ~/.cursor/skills &&
rm -rf ~/.cursor/skills/power-analysis &&
cp -R "$tmp/loops/power-analysis" ~/.cursor/skills/power-analysis &&
rm -rf "$tmp"
```

For one project only, put the folder in `.cursor/skills/power-analysis` inside it instead.

### Gemini CLI

Run in a terminal (add `--scope workspace` to install it for the current workspace only):

```sh
gemini skills install https://github.com/gaasher/Agent-Loop-Skills.git --path loops/power-analysis
```

Or copy the folder to `~/.gemini/skills/power-analysis` yourself.

### VS Code

For GitHub Copilot in VS Code, copy the skill folder to `~/.copilot/skills/power-analysis`:

```sh
tmp=$(mktemp -d) &&
git clone --depth 1 https://github.com/gaasher/Agent-Loop-Skills.git "$tmp" &&
mkdir -p ~/.copilot/skills &&
rm -rf ~/.copilot/skills/power-analysis &&
cp -R "$tmp/loops/power-analysis" ~/.copilot/skills/power-analysis &&
rm -rf "$tmp"
```

For one project only, put the folder in `.github/skills/power-analysis` inside it instead.

### Other agents

Get the folder:

```sh
git clone --depth 1 https://github.com/gaasher/Agent-Loop-Skills.git
```

Then copy `Agent-Loop-Skills/loops/power-analysis` into your agent's skills folder as `power-analysis`. Agents that support SKILL.md read one folder per skill.

## FAQ

### How do I install Power analysis in Claude Code?

Copy the skill folder from GitHub to ~/.claude/skills/power-analysis to use it in all your projects, or to .claude/skills/power-analysis in one project. Or install the agent-loops plugin, which includes it: /plugin marketplace add gaasher/Agent-Loop-Skills, then /plugin install agent-loops@agent-loop-skills.

### Does Power analysis run scripts?

Yes. It runs Python scripts. No network calls were found in its scripts. This comes from a static check of the files on GitHub; nothing was run. Read the files before you install it.

### Which AI agents can use Power analysis?

Claude Code, Codex, Cursor, Gemini CLI, GitHub Copilot, Windsurf and Goose. Each reads skills in the SKILL.md format from its own folder; the install steps on this page list them.

---
Source: https://ai-powered.com/skills/power-analysis
