#llmops (30 Repositories)
Ranked open-source repositories tagged with #llmops, scored by pull request acceptance likelihood and maintainer engagement velocity.
64.5%
20.0h
30 repositories tagged #llmops
rhesis-ai/rhesis
The collaboration layer for AI teams: domain experts annotate and review agent behavior, engineers improve the agent from what they find.
Arize-ai/openinference
OpenTelemetry Instrumentation for AI Observability
vllm-project/vllm-ascend
Community maintained hardware plugin for vLLM on Huawei Ascend
ShenSeanChen/waku-agent
Waku Waku! Waku Agent is a local-first AI agent harness you actually own, including loop, memory, eval, all in code built to stay legible as it grows.
openlit/openlit
OpenLIT is the open-source agent harness engineering platform: trace, evaluate, guard, and improve everything around the model in your AI agents, on OTEL.
comet-ml/opik
Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards.
Arize-ai/phoenix
AI Observability & Evaluation
ferro-labs/ai-gateway
Unified AI Gateway for 30+ LLMs (OpenAI, Anthropic, Bedrock, Azure etc) with Caching, Guardrails, A/B test & cost controls. Go-native Fastest & Scalable AI Gateway LiteLLM & Kong AI Gateway alternative.
langfuse/langfuse
🪢 Open source agent evals & observability: Trace, evaluate, and improve LLM applications with one open platform.
fkiene/llmtrim
Local proxy that compresses your LLM API requests so you pay less, with no change to the answers. Trims wasted tokens from prompts, history, tool output, and code before they're sent: -31% input / -74% output, measured live. Any provider, no extra model calls. Also an MCP server and embeddable library (Rust, Python, Ruby, Kotlin, Swift, JS/TS).
truera/trulens
Evaluation and Tracking for LLM Experiments and AI Agents
future-agi/future-agi
Open-source, end-to-end platform for evaluating, observing, and improving LLM and AI agent applications. Tracing · Evals · Simulations · Datasets · Gateway · Guardrails. Self-hostable. Apache 2.0.
dynamiq-ai/dynamiq
Dynamiq is an orchestration framework for agentic AI and LLM applications
Keesan12/martin-loop
Make AI coding agents safe to scale autonomously: assign work, cap spend, enforce policy, verify output, roll back failures, learn from loops, and prove ROI across every repo.
BerriAI/litellm
The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]
traceloop/openllmetry
Open-source observability for your GenAI or LLM application, based on OpenTelemetry
langfuse/langfuse-js
🪢 Langfuse JS/TS SDK
promptfoo/promptfoo
Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, DeepSeek, and more. Simple declarative configs with command line and CI/CD integration. Used by OpenAI and Anthropic.
0xPlaygrounds/rig
⚙️🦀 Build modular and scalable LLM Applications in Rust
alibaba/rtp-llm
RTP-LLM: Alibaba's high-performance LLM inference engine for diverse applications.
ComposioHQ/composio
Composio powers 1000+ toolkits, tool search, context management, authentication, and a sandboxed workbench to help you build AI agents that turn intent into action.
Giskard-AI/giskard-oss
🐢 Open-Source Evaluation & Testing library for LLM Agents
katanemo/plano
Plano is an AI-native proxy server and data plane for agentic apps. Smart LLM routing, observability, agent orchestration, and guardrails so you stay focused on your agents core logic.
mcp-router/mcp-router
MCP Router — development, support and security updates ended 2026-09-18. Historical source and final release for existing users.
bionic-gpt/bionic-gpt
Bionic is sovereign Agentic AI for the enterprise — Runs on-premise and can securely work with your sensitive data and systems.
TensorOpsAI/LLMstudio
Framework to bring LLM applications to production
coze-dev/coze-loop
Next-generation AI Agent Optimization Platform: Cozeloop addresses challenges in AI agent development by providing full-lifecycle management capabilities from development, debugging, and evaluation to monitoring.
tensorchord/envd
🏕️ Reproducible development environment for humans and agents
Rodiun/frugon
Free, local, open-source LLM cost analyzer - see where your LLM bill leaks, on your machine.
bentoml/BentoML
The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!