#npu (9 Repositories)
Ranked open-source repositories tagged with #npu, scored by pull request acceptance likelihood and maintainer engagement velocity.
48.7%
31.7h
9 repositories tagged #npu
ROCm/FastFlowLM
Run LLMs on AMD Ryzen™ AI NPUs in minutes. Just like Ollama - but purpose-built and deeply optimized for the AMD NPUs.
ModelEngine-Group/unified-cache-management
Persist and reuse KV Cache to speedup your LLM.
lemonade-sdk/lemonade
Lemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and NPUs. Join our discord: https://discord.gg/5xXzkMu8Zk
Xilinx/XRT
Run Time for AIE and FPGA based platforms
microsoft/ai-dev-gallery
An open-source project for Windows developers to learn how to add AI with local models and APIs to Windows apps.
OpenSparX/MasterAgent
Build AI agents that run 100% on-device. Sub-100ms latency on Qualcomm NPU. Zero cloud dependency.
moonshine-ai/useful-transformers
Efficient Inference of Transformer models
cornell-zhang/allo
Allo Accelerator Design and Programming Framework (PLDI'24)
embedeep/Free-TPU
Free TPU for FPGA with compiler supporting Pytorch/Caffe/Darknet/NCNN. An AI processor for using Xilinx FPGA to solve image classification, detection, and segmentation problem.