TurnSignal for Playwright
Read-only Playwright CI results for agents: new versus known failures and flaky tests
- Pricing
- Freemium
- Platforms
- CLI, Web
- Runs
- Locally
- Version
- 0.6.6
- Listing updated
- 1 day ago
About TurnSignal for Playwright
TurnSignal for Playwright is a freemium MCP server for browser automation. It runs locally on your machine and is started by your AI client.
TurnSignal is a Playwright reporting service, and this server gives a coding agent read access to its results. After a red run the agent can ask whether a failure is new on the branch, was already failing on the default branch, is known flaky, or never reported at all because a shard crashed. Flaky tests come with evidence over 7 to 90 days and the exact runs and attempts behind each label.
The reporter behind the data writes results to disk in CI before sending them, so a killed runner leaves a list of missing tests with the likely cause and the lowest free memory seen. It fails open: if the API is down, tests run as normal and the exit code is untouched. Common secret formats are redacted in errors and traces before leaving CI.
The server runs locally as an npm package over stdio and needs a project token from app.turnsignal.ai, used read-only. A TURNSIGNAL_API_URL variable points it at a self-hosted server. The site says every feature is free during the public beta.
Install
Run in a terminal
claude mcp add turnsignal --env TURNSIGNAL_TOKEN='<TURNSIGNAL_TOKEN>' -- npx -y turnsignalAdd to claude_desktop_config.json
{
"mcpServers": {
"turnsignal": {
"command": "npx",
"args": [
"-y",
"turnsignal"
],
"env": {
"TURNSIGNAL_TOKEN": "<TURNSIGNAL_TOKEN>"
}
}
}
}Add to ~/.cursor/mcp.json
{
"mcpServers": {
"turnsignal": {
"command": "npx",
"args": [
"-y",
"turnsignal"
],
"env": {
"TURNSIGNAL_TOKEN": "<TURNSIGNAL_TOKEN>"
}
}
}
}Add to .vscode/mcp.json
{
"servers": {
"turnsignal": {
"type": "stdio",
"command": "npx",
"args": [
"-y",
"turnsignal"
],
"env": {
"TURNSIGNAL_TOKEN": "<TURNSIGNAL_TOKEN>"
}
}
}
}Add to ~/.codeium/windsurf/mcp_config.json
{
"mcpServers": {
"turnsignal": {
"command": "npx",
"args": [
"-y",
"turnsignal"
],
"env": {
"TURNSIGNAL_TOKEN": "<TURNSIGNAL_TOKEN>"
}
}
}
}Add to your client's MCP settings (most use this shape)
{
"mcpServers": {
"turnsignal": {
"command": "npx",
"args": [
"-y",
"turnsignal"
],
"env": {
"TURNSIGNAL_TOKEN": "<TURNSIGNAL_TOKEN>"
}
}
}
}Configuration
TURNSIGNAL_TOKENProject token from app.turnsignal.ai (read-only use)RequiredTURNSIGNAL_API_URLOnly for a self-hosted server (default https://app.turnsignal.ai)
What it does
- Failure classification
- Labels failures as new, also failing on main, known flaky or missing.
- Missing-test detection
- Lists tests a crashed shard never finished, with the likely reason.
- Flaky history
- Shows how often a test was flaky over 7 to 90 days, with the runs behind it.
- PR verdicts
- The service posts a plain-language verdict as a sticky GitHub PR comment.
- Fails open
- The reporter never changes your CI exit code if the API is down.
- Secret redaction
- Common token and password formats are redacted before upload.
Good for
- Ask an agent whether a PR broke a test or it was already failing
- Triage flaky Playwright tests with run evidence
- Find tests lost to a crashed CI shard
- Review test history before merging
Pricing
Freemium, from $44 a month
Free during the public beta; planned Team plan $44/mo ($24/mo billed yearly), Business $74/mo
Prices change. Check turnsignal.ai before you buy.
TurnSignal for Playwright FAQ
What credentials does the server need?
A project token from app.turnsignal.ai, set as TURNSIGNAL_TOKEN and used read-only.
Is it free?
The site says every feature is free during the public beta, with limits of 3,000 runs and 300,000 test results a month per organization.
Will it break my CI if it is down?
No. The reporter fails open and results stay on disk for a later upload.
Can I self-host the API?
The registry entry lists a TURNSIGNAL_API_URL variable for a self-hosted server.
Is TurnSignal for Playwright free?
TurnSignal for Playwright has a free plan, with paid plans for more usage or features. Paid plans start at $44 a month.
How do I add TurnSignal for Playwright to Claude Code?
Run this command in your terminal: claude mcp add turnsignal --env TURNSIGNAL_TOKEN='<TURNSIGNAL_TOKEN>' -- npx -y turnsignal
What are the best alternatives to TurnSignal for Playwright?
The closest alternatives to TurnSignal for Playwright are REA, Browser Use, Scrapling MCP Server, Codebase Memory and GitHub.
Alternatives to TurnSignal for Playwright

REA
MCP serverCLI and MCP server that lets coding agents reverse engineer apps and binaries
Runs locally- Open source
- 464K GitHub stars
- Developer tools

Browser Use
MCP serverBrowser agents and cloud browsers for AI, with an MCP server for web tasks
- 7 tools
- Remote
- Freemium
- 121K GitHub stars
- Browser automation

Scrapling MCP Server
MCP serverMCP server for AI clients to scrape sites with HTTP and stealth browser sessions
Runs locally- 17 tools
- Open source
- 104K GitHub stars
- Web search and scraping

Codebase Memory
MCP serverLocal MCP server that builds a code knowledge graph for AI coding agents
Runs locally- Open source
- 48.7K GitHub stars
- Knowledge and memory

GitHub
MCP serverOfficial MCP server connecting AI assistants to GitHub repos, issues and workflows
Not checked yet- Remote
- Open source
- 34.5K GitHub stars
- Developer tools

Serena MCP: the IDE for your agent
MCP serverMCP toolkit giving coding agents symbol-level code retrieval and editing
Runs locally- Open source
- 31.5K GitHub stars
- Developer tools