#serving (10 Repositories)
Ranked open-source repositories tagged with #serving, scored by pull request acceptance likelihood and maintainer engagement velocity.
34.9%
48.2h
10 repositories tagged #serving
volcano-sh/volcano
A Cloud Native Batch System (Project under CNCF)
dingodb/dingo
A multi-modal vector database that supports upserts and vector queries using unified SQL (MySQL-Compatible) on structured and unstructured data, while meeting the requirements of high concurrency and ultra-low latency.
openvinotoolkit/model_server
A scalable inference server for models optimized with OpenVINO™
deepjavalibrary/djl-serving
A universal scalable machine learning model deployment solution
skyzh/tiny-llm
learn LLM inference system on Apple Silicon for systems engineers: build a tiny vLLM + Qwen
tensorflow/serving
A flexible, high-performance serving system for machine learning models
Lightning-AI/LitServe
A minimal Python framework for building custom AI inference servers with full control over logic, batching, and scaling.
zzsza/Boostcamp-AI-Tech-Product-Serving
부스트캠프 AI Tech - Product Serving 자료
SeldonIO/seldon-core
An MLOps framework to package, deploy, monitor and manage thousands of production machine learning models
PaddlePaddle/Serving
A flexible, high-performance carrier for machine learning models（『飞桨』服务化部署框架）