Back to Topics Directory
Topic Hub

#text-generation-inference (2 Repositories)

Ranked open-source repositories tagged with #text-generation-inference, scored by pull request acceptance likelihood and maintainer engagement velocity.

Topic Avg Merge Rate

25.0%

Avg Review Latency

11.3h

Filter by language

2 repositories tagged #text-generation-inference

B TierPython 340

huggingface/optimum-benchmark

🏋️ A unified multi-backend utility for benchmarking Transformers, Timm, PEFT, Diffusers and Sentence-Transformers with full support of Optimum's hardware optimizations & quantization schemes.

50.0%
Merge Rate
23h
First Review
0%
1st-Timers
0
Maintainers
D TierGo 309

InftyAI/llmaz

☸️ Easy, advanced inference platform for large language models on Kubernetes. 🌟 Star to support our work!

0.0%
Merge Rate
-
First Review
0%
1st-Timers
0
Maintainers