Topic Hub
#distributed-inference (3 Repositories)
Ranked open-source repositories tagged with #distributed-inference, scored by pull request acceptance likelihood and maintainer engagement velocity.
Topic Avg Merge Rate
72.4%
Avg Review Latency
37.5h
Filter by language
3 repositories tagged #distributed-inference
A TierPython 5.6k
gpustack/gpustack
A GPU cluster manager for high-performance AI model serving (vLLM, SGLang) and on-demand SSH-accessible GPU instances.
88.6%
Merge Rate
2d
First Review
65%
1st-Timers
27
Maintainers
A TierShell 4.1k 12 GFIs
llm-d/llm-d
Achieve state of the art inference performance with modern accelerators on Kubernetes
71.1%
Merge Rate
1d
First Review
62%
1st-Timers
75
Maintainers
A TierPython 6.2k 5 GFIs
flashinfer-ai/flashinfer
FlashInfer: Kernel Library for LLM Serving
57.4%
Merge Rate
21h
First Review
51%
1st-Timers
136
Maintainers