Skip to content

Alternatives to Arize evaluator

Agent skills that do a similar job to Arize evaluator, ranked by how closely they match what it does. Arize evaluator is an open-source agent skill for ai models and llm tooling.

Top 12 alternatives

  1. Guides an agent through building LLM eval pipelines with datasets, evaluators and pixie

    • Open source
    • 41.3K GitHub stars
    • AI models and LLM tooling
  2. Lets your agent manage Arize annotation configs, review queues and span labels

    • Open source
    • 41.3K GitHub stars
    • AI models and LLM tooling
  3. Improves LLM prompts using trace data, eval scores and experiments in Arize

    • Open source
    • 41.3K GitHub stars
    • AI models and LLM tooling
  4. Guides building, running and validating LLM evaluators with the Phoenix framework

    • Open source
    • 41.3K GitHub stars
    • AI models and LLM tooling
  5. Guides agents through self-critique, reflection loops and LLM-as-judge evaluation

    • Open source
    • 41.3K GitHub stars
    • AI models and LLM tooling
  6. Adds Arize AX tracing to an LLM app in two phases: read-only analysis, then implementation

    • Open source
    • 41.3K GitHub stars
    • AI models and LLM tooling
  7. Runs a model over an Arize dataset, saves the results as an experiment and compares runs

    • Open source
    • 41.3K GitHub stars
    • AI models and LLM tooling
  8. Lets an agent create, list, update and delete Arize AI LLM provider integrations

    • Open source
    • 41.3K GitHub stars
    • AI models and LLM tooling
  9. Exports and inspects Arize traces, spans and sessions to debug what an LLM app is doing

    • Open source
    • 41.3K GitHub stars
    • AI models and LLM tooling
  10. Evaluate and iteratively improve AI agents on Google Cloud with an eval flywheel

    • Open source
    • 24.4K GitHub stars
    • AI models and LLM tooling
  11. Creates, exports and appends to Arize evaluation datasets using the ax command line

    • Open source
    • 41.3K GitHub stars
    • AI models and LLM tooling

Arize evaluator alternatives: questions

What are the best alternatives to Arize evaluator?

The closest alternatives to Arize evaluator are Eval driven dev, Arize annotation, Arize prompt optimization, Phoenix evals and Agentic eval.

Is there a free alternative to Arize evaluator?

Yes. Eval driven dev, Arize annotation, Arize prompt optimization have a free or open-source option.

Compare head to head