#cuda-kernels (12 Repositories)
Ranked open-source repositories tagged with #cuda-kernels, scored by pull request acceptance likelihood and maintainer engagement velocity.
52.3%
78.0h
12 repositories tagged #cuda-kernels
NVIDIA/cccl
CUDA Core Compute Libraries
openinfer-project/openinfer
Pure Rust + CUDA LLM inference engine — no PyTorch, OpenAI-compatible, serves Qwen3 to Kimi-K2
flashrt-project/FlashRT
FlashRT is a high-performance realtime inference engine for small-batch, latency-sensitive AI workloads. The flagship integration is production VLA control for Pi0, Pi0.5, GROOT N1.6, and Pi0-FAST. Also support llm e.g, qwen3.6-27B
NVIDIA/cudnn-frontend
cuDNN Frontend is NVIDIA's modern, open-source entry point to the cuDNN library and a growing collection of high-performance open-source kernels.
InternLM/lmdeploy
LMDeploy is a toolkit for compressing, deploying, and serving LLMs.
Luce-Org/lucebox
LLM speculative inference server for heterogeneous hardware & consumer GPUs
pegainfer-project/pegainfer
Pure Rust + CUDA LLM inference engine — no PyTorch, OpenAI-compatible, serves Qwen3 to Kimi-K2
chelsea0x3b/cudarc
Safe rust wrapper around CUDA toolkit
Rust-GPU/rust-cuda
Ecosystem of libraries and tools for writing and executing fast GPU code fully in Rust.
NVIDIA/cuda-samples
Samples for CUDA Developers which demonstrates features in CUDA Toolkit
mni-ml/framework
A machine learning library with a TypeScript API and Rust backend. CUDA and WebGPU compatibility. Built to understand how ML frameworks and models work internally.
harrism/hemi
Simple utilities to enable code reuse and portability between CUDA C/C++ and standard C/C++.