Tunes a local vLLM or llama.cpp server by measuring one flag change at a time
- Open source
- 4 Hacker News points
- Developer tools
Tunes a local vLLM or llama.cpp server by measuring one flag change at a time
Experimental browser IDE for steering LLM text generation in realtime
Open OpenAI-compatible LLM inference engine for AWS Trainium2 with NKI megakernels
Self-hosted benchmark that scores local language models as agents on 40 tool-use tasks
Local reverse proxy that redacts names and secrets before prompts reach LLM APIs
The closest alternatives to laplacesscissors are Tensward, spaceship, TrnRT, Werkbank and Aiproxy.
Yes. Tensward, spaceship, TrnRT have a free or open-source option.