Skip to content

evalpair status

We have not checked this server yet.

Answered (30 days)
—
Last seen working
—
Last commit
—
Licence
Not stated

Live checks

This server runs on your own machine, so we don't run it. The status below comes from its repository.

Tools (5)

Taken from the project documentation; the running server may differ.

list_suites
Lists runnable suites with name, item count, checker and what they measure.
run_eval
Runs a suite against one model and saves the run, reusing cached replies.
list_runs
Lists saved runs, newest first.
show_run
Shows a run's score with its interval, noise floor and failed replies.
compare_runs
Compares two runs paired by item, with flips each way and change versus noise floor.