#kvcache (7 Repositories)
Ranked open-source repositories tagged with #kvcache, scored by pull request acceptance likelihood and maintainer engagement velocity.
46.9%
2.6h
7 repositories tagged #kvcache
kvcache-ai/Mooncake
Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.
alibaba/tair-kvcache
Alibaba Cloud's high-performance KVCache system for LLM inference, with components for global cache management, inference simulation(HiSim), and more.
ModelEngine-Group/unified-cache-management
Persist and reuse KV Cache to speedup your LLM.
ovg-project/kvcached
Virtualized Elastic KV Cache for Dynamic GPU Sharing and Beyond
agentic-in/inferoa
Inference-native Tokenmaxxing Agent Harness for Loop Engineering
Zefan-Cai/R-KV
[Neurips 2025] R-KV: Redundancy-aware KV Cache Compression for Reasoning Models
AstraNetLab/CacheRoute
CacheRoute is an innovative LLM scheduling scheme dedicated to enabling flexible KV cache reuse across LLM systems, improving task performance and system efficiency.