#npu (12 Repositories)
Ranked open-source repositories tagged with #npu, scored by pull request acceptance likelihood and maintainer engagement velocity.
56.4%
62.3h
12 repositories tagged #npu
ModelEngine-Group/unified-cache-management
Persist and reuse KV Cache to speedup your LLM.
lemonade-sdk/lemonade
Lemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and NPUs. Join our discord: https://discord.gg/5xXzkMu8Zk
Xilinx/XRT
Run Time for AIE and FPGA based platforms
FastFlowLM/FastFlowLM
Run LLMs on AMD Ryzen™ AI NPUs in minutes. Just like Ollama - but purpose-built and deeply optimized for the AMD NPUs.
krrishnarraj/clpeak
Peak compute, memory bandwidth and latency of CPUs, GPUs and NPUs: the same tests through every API that reaches a device. Command line and app for Windows, macOS, Linux and Android
microsoft/ai-dev-gallery
An open-source project for Windows developers to learn how to add AI with local models and APIs to Windows apps.
ROCm/FastFlowLM
Run LLMs on AMD Ryzen™ AI NPUs in minutes; purpose-built and deeply optimized for the AMD NPUs.
cornell-zhang/allo
Allo Accelerator Design and Programming Framework (PLDI'24)
youyve/nputop
An interactive Ascend-NPU process viewer
OpenSparX/MasterAgent
Build AI agents that run 100% on-device. Sub-100ms latency on Qualcomm NPU. Zero cloud dependency.
moonshine-ai/useful-transformers
Efficient Inference of Transformer models
embedeep/Free-TPU
Free TPU for FPGA with compiler supporting Pytorch/Caffe/Darknet/NCNN. An AI processor for using Xilinx FPGA to solve image classification, detection, and segmentation problem.