Open OpenAI-compatible LLM inference engine for AWS Trainium2 with NKI megakernels
- Open source
- 54 Hacker News points
- Developer tools

Open OpenAI-compatible LLM inference engine for AWS Trainium2 with NKI megakernels
OpenAI-compatible gateway to around 1,000 LLMs with routing, cost tracking and team
AI chat over your team's code snippets library, with codebase indexing and multiple LLMs

Open-source AI gateway in Go that routes LLM calls with budgets, fallbacks and MCP

Ruby library with one API for 23 AI providers, tools and Rails conventions
Self-hosted proxy that logs token use, cost and latency for LLM API calls and enforces key
Postgres backend with built-in RAG and agents for AI apps and coding agents
Hosted Linux, Windows and Mac desktops that AI agents can operate, billed by hour or month
API-based AI models for moderating, classifying and searching image, video, audio and text

Open-source gateway routing apps to 250+ LLMs with retries, fallbacks and caching
The closest alternatives to Prime Intellect are TrnRT, Eden AI, codesnippets, bifrost and ruby_llm.
Yes. TrnRT, codesnippets, bifrost have a free or open-source option.