Modelwatch vs XERJ
Modelwatch is a freemium MCP server for ai models and llm tooling. XERJ is an open-source MCP server for knowledge and memory.
- XERJ is open source, while Modelwatch is freemium.
- Modelwatch is best for set up a refusal canary against an llm endpoint.
- XERJ is best for search local code and docs from an agent.
- What it is
- Modelwatch is a freemium MCP server for ai models and llm tooling.XERJ is an open-source MCP server for knowledge and memory.
- Best for
- Set up a refusal canary against an LLM endpointSearch local code and docs from an agent
- Kind
- MCP serverMCP server
- Pricing
- Freemium, from $99 a monthOpen source
- Platforms
- Web, API, CLI, SlackCLI, Linux, macOS, self-hosted, API
- Runs
- LocallyLocally
- GitHub stars
- 19.2K
- Last commit
- Nov 2026
- License
- Apache-2.0
- Open source
- Good for
- Set up a refusal canary against an LLM endpoint; Find out when a provider quietly changes a model; Re-baseline after switching model versionsSearch local code and docs from an agent; Give an agent persistent memory notes; Look up real API definitions
What Modelwatch does
Scheduled drift specs
Replay prompts hourly, daily or weekly against a baseline.
Five-axis scoring
Weights semantic, format, refusal, length and contains checks.
Baseline reset
Re-baseline after an intentional model swap.
Drift events and history
Read recent events and per-spec run history.
Bring your own key
Uses your provider key with no token markup.
Tool monitoring
A decorator tracks latency and response structure of tools.
What XERJ does
Single binary
Search, vectors, facts and memory in one Rust program.
Evidence-backed answers
Answers come with the program and evidence used.
Runs locally
Works offline on a CPU, on a laptop or server.
Elasticsearch-compatible API
Exposes an API compatible with Elasticsearch.
Reference coding
Index open-source repos so agents consult real definitions.
MCP integration
Stdio MCP server connects to a running node.
Modelwatch vs XERJ: questions
Is Modelwatch or XERJ cheaper?
XERJ is the cheaper option: it is open source.
What is the difference between Modelwatch and XERJ?
Modelwatch is a freemium MCP server for ai models and llm tooling. XERJ is an open-source MCP server for knowledge and memory. XERJ is open source, while Modelwatch is freemium.
