
Creates, runs, and analyzes Arize experiments for evaluating and comparing model performance
- Open source
- 41.3K GitHub stars

Creates, runs, and analyzes Arize experiments for evaluating and comparing model performance

Adds Arize AX tracing to an LLM application for the first time

Generates deep links to the Arize UI for traces, spans, sessions, datasets, labeling queues, evaluators, and annotation configs

Optimizes, improves, and debugs LLM prompts using production trace data, evaluations, and annotations

Downloads, exports, and inspects existing Arize traces and spans to understand what an LLM app is doing or debug runtime issues

Aspire skill covering the Aspire CLI, AppHost orchestration, service discovery, integrations, MCP server, VS Code extension, Dev Containers,

Create ASP.NET Minimal API endpoints with proper OpenAPI documentation

Enforce output quality, evidence verification, and quality gates across security audits

Analyze a screen recording of a manual process and produce targeted, working automation scripts

Autonomous iterative experimentation loop for any programming task

Setup and initialization guide for developing AWS CDK (Cloud Development Kit) applications in Python

Reusable investigation patterns for AWS CloudWatch: Logs Insights query templates, alarm-to-deployment correlation, blast-radius narrowing d

Analyze AWS resources used in the app (IaC files and/or resources in a target account/region) and optimize costs - creating GitHub issues fo

Analyze AWS resource health, diagnose issues from CloudWatch logs and metrics, and create a remediation plan for identified problems.


Perform an AWS Well-Architected Framework review of the current workload IaC and architecture, generating findings and GitHub issues for imp

Analyze Azure resources used in the app (IaC files and/or resources in a target rg) and optimize costs - creating GitHub issues for identifi

Manage Azure Container Registry via the az acr CLI including registries, images, cloud builds, ACR Tasks, authentication, tokens, geo-replic

Performs comprehensive preflight validation of Bicep deployments to Azure, including template syntax validation, what-if analysis, and permi

Design, create, review, migrate, or troubleshoot Azure Developer CLI (azd) projects using current Microsoft guidance

Manage Azure DevOps resources via CLI including projects, repos, pipelines, builds, pull requests, work items, artifacts, and service endpoi

Create, inspect, validate, test, run, debug, package, and deploy Azure Logic Apps Standard projects using the Azure CLI logicapp extension

Fetches real-time Azure retail pricing using the Azure Retail Prices API (prices.azure.com) and estimates Copilot Studio agent credit consum

Analyze Azure resource health, diagnose issues from logs and telemetry, and create a remediation plan for identified problems.

Analyze Azure resource groups and generate detailed Mermaid architecture diagrams showing the relationships between individual resources

When user is asking for guidance for which role to assign to an identity given desired permissions, this agent helps them understand the rol

Design and plan end-to-end Azure IoT and Smart City solutions: requirements, architecture, security, operations, cost, and a phased delivery

Helps create, configure, and deploy Azure Static Web Apps using the SWA CLI

Perform an Azure Well-Architected Framework review of the current workload IaC and architecture, generating findings and GitHub issues for i

Expert-level Windows batch file (.bat/.cmd) skill for writing, debugging, and maintaining CMD scripts