Jetson LLM benchmark vs Litert google tensor
Jetson LLM benchmark is an open-source agent skill for ai models and llm tooling. Litert google tensor is an open-source agent skill for ai models and llm tooling.
- Litert google tensor has more GitHub stars (24,379 vs 4,037).
- Jetson LLM benchmark is best for measure time to first token and throughput for a model served by vllm on a jetson.
- Litert google tensor is best for check whether a .tflite model is already compiled for the pixel tpu.
- What it is
- Jetson LLM benchmark is an open-source agent skill for ai models and llm tooling.Litert google tensor is an open-source agent skill for ai models and llm tooling.
- Best for
- Measure time to first token and throughput for a model served by vLLM on a JetsonCheck whether a .tflite model is already compiled for the Pixel TPU
- Kind
- SkillSkill
- Pricing
- Open sourceOpen source
- Platforms
- Claude Code, Codex, Cursor, Gemini CLI, GitHub Copilot, Windsurf, GooseClaude Code, Codex, Cursor, Gemini CLI, GitHub Copilot, Windsurf, Goose
- GitHub stars
- 4K24.4K
- Last commit
- Nov 2026Nov 2026
- License
- Apache-2.0Apache-2.0
- Open source
- Good for
- Measure time to first token and throughput for a model served by vLLM on a Jetson; Compare a model's speed before and after changing power mode or runtime flags; Benchmark a GGUF model with llama.cpp on a Jetson Orin or ThorCheck whether a .tflite model is already compiled for the Pixel TPU; Compile a TFLite model for Tensor G5 or G6; Measure NPU latency and memory against a CPU baseline on a Pixel
What Jetson LLM benchmark does
Runtime-specific benchmark wrappers
Separate scripts measure vLLM, Ollama and llama.cpp so each runtime uses its correct client path.
Structured JSON output
Each run returns one JSON object with latency, throughput and device metadata for comparison.
Concurrency sweep for vLLM
The vLLM wrapper measures several concurrency levels and reports a run entry for each.
Device and power warnings
Results flag non-maximum power modes, background GPU load and thermal throttling during a run.
Jetson-specific interpretation
Guidance covers memory bandwidth limits, cache effects after upgrades and comparing quantizations.
Error handling guidance
Documented exit codes and preflight checks explain how to fix unreachable servers or missing models.
What Litert google tensor does
Compiled model check
Detects whether a .tflite file is already compiled for a Google Tensor target and reports the SoC.
Ahead-of-time compilation
Compiles models for Tensor G5 or G6 locally on Linux or remotely on Google Colab.
On-device benchmarking
Runs benchmark_model over adb and reports NPU latency, memory, TPU tile time and energy.
Android AI pack packaging
Builds a Google Play AI pack with a Tensor NPU runtime module and Kotlin loader for Gradle apps.
Project update planning
Prepares update plans for apps that already ship Tensor builds, listing files to replace.
On-device verification
Builds and installs the app on a Pixel and reads the loader result to confirm NPU use.
Jetson LLM benchmark vs Litert google tensor: questions
Is Jetson LLM benchmark or Litert google tensor cheaper?
Both are open source. Compare current plans on each official site.
What is the difference between Jetson LLM benchmark and Litert google tensor?
Jetson LLM benchmark is an open-source agent skill for ai models and llm tooling. Litert google tensor is an open-source agent skill for ai models and llm tooling. Litert google tensor has more GitHub stars (24,379 vs 4,037).

