Skip to content
MCP server

TurnSignal for Playwright

Read-only Playwright CI results for agents: new versus known failures and flaky tests

Runs locallyStatus and history
Install
Pricing
Freemium
Platforms
CLI, Web
Runs
Locally
Version
0.6.6
Listing updated
1 day ago

About TurnSignal for Playwright

TurnSignal for Playwright is a freemium MCP server for browser automation. It runs locally on your machine and is started by your AI client.

TurnSignal is a Playwright reporting service, and this server gives a coding agent read access to its results. After a red run the agent can ask whether a failure is new on the branch, was already failing on the default branch, is known flaky, or never reported at all because a shard crashed. Flaky tests come with evidence over 7 to 90 days and the exact runs and attempts behind each label.

The reporter behind the data writes results to disk in CI before sending them, so a killed runner leaves a list of missing tests with the likely cause and the lowest free memory seen. It fails open: if the API is down, tests run as normal and the exit code is untouched. Common secret formats are redacted in errors and traces before leaving CI.

The server runs locally as an npm package over stdio and needs a project token from app.turnsignal.ai, used read-only. A TURNSIGNAL_API_URL variable points it at a self-hosted server. The site says every feature is free during the public beta.

Install

Run in a terminal

claude mcp add turnsignal --env TURNSIGNAL_TOKEN='<TURNSIGNAL_TOKEN>' -- npx -y turnsignal

Add to claude_desktop_config.json

{
  "mcpServers": {
    "turnsignal": {
      "command": "npx",
      "args": [
        "-y",
        "turnsignal"
      ],
      "env": {
        "TURNSIGNAL_TOKEN": "<TURNSIGNAL_TOKEN>"
      }
    }
  }
}

Add to ~/.cursor/mcp.json

{
  "mcpServers": {
    "turnsignal": {
      "command": "npx",
      "args": [
        "-y",
        "turnsignal"
      ],
      "env": {
        "TURNSIGNAL_TOKEN": "<TURNSIGNAL_TOKEN>"
      }
    }
  }
}

Add to .vscode/mcp.json

{
  "servers": {
    "turnsignal": {
      "type": "stdio",
      "command": "npx",
      "args": [
        "-y",
        "turnsignal"
      ],
      "env": {
        "TURNSIGNAL_TOKEN": "<TURNSIGNAL_TOKEN>"
      }
    }
  }
}

Add to ~/.codeium/windsurf/mcp_config.json

{
  "mcpServers": {
    "turnsignal": {
      "command": "npx",
      "args": [
        "-y",
        "turnsignal"
      ],
      "env": {
        "TURNSIGNAL_TOKEN": "<TURNSIGNAL_TOKEN>"
      }
    }
  }
}

Add to your client's MCP settings (most use this shape)

{
  "mcpServers": {
    "turnsignal": {
      "command": "npx",
      "args": [
        "-y",
        "turnsignal"
      ],
      "env": {
        "TURNSIGNAL_TOKEN": "<TURNSIGNAL_TOKEN>"
      }
    }
  }
}

Configuration

  • TURNSIGNAL_TOKENProject token from app.turnsignal.ai (read-only use)Required
  • TURNSIGNAL_API_URLOnly for a self-hosted server (default https://app.turnsignal.ai)

What it does

Failure classification
Labels failures as new, also failing on main, known flaky or missing.
Missing-test detection
Lists tests a crashed shard never finished, with the likely reason.
Flaky history
Shows how often a test was flaky over 7 to 90 days, with the runs behind it.
PR verdicts
The service posts a plain-language verdict as a sticky GitHub PR comment.
Fails open
The reporter never changes your CI exit code if the API is down.
Secret redaction
Common token and password formats are redacted before upload.

Good for

  • Ask an agent whether a PR broke a test or it was already failing
  • Triage flaky Playwright tests with run evidence
  • Find tests lost to a crashed CI shard
  • Review test history before merging

Pricing

Freemium, from $44 a month

Free during the public beta; planned Team plan $44/mo ($24/mo billed yearly), Business $74/mo

Prices change. Check turnsignal.ai before you buy.

TurnSignal for Playwright FAQ

What credentials does the server need?

A project token from app.turnsignal.ai, set as TURNSIGNAL_TOKEN and used read-only.

Is it free?

The site says every feature is free during the public beta, with limits of 3,000 runs and 300,000 test results a month per organization.

Will it break my CI if it is down?

No. The reporter fails open and results stay on disk for a later upload.

Can I self-host the API?

The registry entry lists a TURNSIGNAL_API_URL variable for a self-hosted server.

Is TurnSignal for Playwright free?

TurnSignal for Playwright has a free plan, with paid plans for more usage or features. Paid plans start at $44 a month.

How do I add TurnSignal for Playwright to Claude Code?

Run this command in your terminal: claude mcp add turnsignal --env TURNSIGNAL_TOKEN='<TURNSIGNAL_TOKEN>' -- npx -y turnsignal

What are the best alternatives to TurnSignal for Playwright?

The closest alternatives to TurnSignal for Playwright are REA, Browser Use, Scrapling MCP Server, Codebase Memory and GitHub.

Alternatives to TurnSignal for Playwright

  1. REA

    MCP server

    CLI and MCP server that lets coding agents reverse engineer apps and binaries

    Runs locally
    • Open source
    • 464K GitHub stars
    • Developer tools
  2. Browser Use

    MCP server

    Browser agents and cloud browsers for AI, with an MCP server for web tasks

    • 7 tools
    • Remote
    • Freemium
    • 121K GitHub stars
    • Browser automation
  3. MCP server for AI clients to scrape sites with HTTP and stealth browser sessions

    Runs locally
    • 17 tools
    • Open source
    • 104K GitHub stars
    • Web search and scraping
  4. Codebase Memory

    MCP server

    Local MCP server that builds a code knowledge graph for AI coding agents

    Runs locally
    • Open source
    • 48.7K GitHub stars
    • Knowledge and memory
  5. GitHub

    MCP server

    Official MCP server connecting AI assistants to GitHub repos, issues and workflows

    Not checked yet
    • Remote
    • Open source
    • 34.5K GitHub stars
    • Developer tools
  6. MCP toolkit giving coding agents symbol-level code retrieval and editing

    Runs locally
    • Open source
    • 31.5K GitHub stars
    • Developer tools