#local-inference (5 Repositories)
Ranked open-source repositories tagged with #local-inference, scored by pull request acceptance likelihood and maintainer engagement velocity.
70.9%
30.2h
5 repositories tagged #local-inference
ardanlabs/kronk
Go With Your Own Intelligence! Use Go for hardware accelerated local inference with llama.cpp, whisper.cpp, and stable-diffusion.cpp directly integrated into your Go applications. Kronk provides a high-level API and production ready model server.
mozilla-ai/llamafile
Distribute and run LLMs with a single file.
ollaya-dev/ollaya
Run open decision models locally: pull and serve Laya, decider, NLI and GLiClass behind a TypeSafe-compatible API. Ollama for decision models.
alesha-pro/tools
Tools, ComfyUI workflows and benchmark configs from a 4x RTX 3090 local-inference rig
Tiiny-AI/PowerInfer
High-speed Large Language Model Serving for Local Deployment