Back to Topics Directory
Topic Hub

#inference-gateway (2 Repositories)

Ranked open-source repositories tagged with #inference-gateway, scored by pull request acceptance likelihood and maintainer engagement velocity.

Topic Avg Merge Rate

50.1%

Avg Review Latency

69.7h

Filter by language

2 repositories tagged #inference-gateway

B TierRust 121

api7/aisix

Open-source AI gateway for LLMs & AI agents, built in Rust. One OpenAI-compatible API for OpenAI, Anthropic, Gemini, Bedrock & more — routing, guardrails, caching, rate limits, observability.

26.7%
Merge Rate
8h
First Review
0%
1st-Timers
6
Maintainers
B TierRust 489

smg-project/smg

Engine-agnostic LLM gateway in Rust. Full OpenAI & Anthropic API compatibility across vLLM, TRT-LLM, TokenSpeed, SGLang, OpenAI, Gemini & more. Industry-first gRPC pipeline, KV cache-aware routing, chat history, tokenization caching, Responses API, embeddings, WASM plugins, MCP, and multi-tenant auth.

73.5%
Merge Rate
5d
First Review
48%
1st-Timers
19
Maintainers
Best Inference-gateway Open Source Repositories & C-Rank™ | GetMerged