
Arize evaluator
SkillCreates Arize LLM-as-judge evaluators and runs them on traces or experiment results
- Open source
- 41.3K GitHub stars
- AI models and LLM tooling


Creates Arize LLM-as-judge evaluators and runs them on traces or experiment results

Lets an agent create, list, update and delete Arize AI LLM provider integrations

Exports and inspects Arize traces, spans and sessions to debug what an LLM app is doing

Adds Arize AX tracing to an LLM app in two phases: read-only analysis, then implementation

Creates, exports and appends to Arize evaluation datasets using the ax command line

Builds clickable Arize UI links for traces, spans, sessions, datasets and evaluators

Guides agents through debugging LLM apps with Phoenix traces, datasets and experiments

Improves LLM prompts using trace data, eval scores and experiments in Arize

Runs a model over an Arize dataset, saves the results as an experiment and compares runs

Lets your agent run Azure AI Text Analytics for sentiment, entities, PII and more

Guides an agent through building LLM eval pipelines with datasets, evaluators and pixie

Turns raw videos into chain-of-thought QA training data using VLM and LLM teacher models
The closest alternatives to Arize annotation are Arize evaluator, Arize AI provider integration, Arize trace, Arize instrumentation and Arize dataset.
Yes. Arize evaluator, Arize AI provider integration, Arize trace have a free or open-source option.