Topic Hub
#inference-optimization (3 Repositories)
Ranked open-source repositories tagged with #inference-optimization, scored by pull request acceptance likelihood and maintainer engagement velocity.
Topic Avg Merge Rate
0.0%
Avg Review Latency
42.2h
Filter by language
3 repositories tagged #inference-optimization
D TierC++ 512
brontoguana/krasis
Krasis is a Hybrid LLM runtime which focuses on efficient running of larger models on consumer grade VRAM limited hardware
0.0%
Merge Rate
5d
First Review
0%
1st-Timers
0
Maintainers
D TierMAMarkdown 209
amitshekhariitbhu/llm-inference-engineering
Learn LLM Inference Engineering step by step - from KV cache, PagedAttention, and continuous batching to vLLM, SGLang, and GPUs.
0.0%
Merge Rate
-
First Review
0%
1st-Timers
0
Maintainers
D TierTypeScript 391
modular/llm-inference-handbook
Everything you need to know about LLM inference
0.0%
Merge Rate
-
First Review
0%
1st-Timers
0
Maintainers