Back to Topics Directory
Topic Hub

#llm-eval (4 Repositories)

Ranked open-source repositories tagged with #llm-eval, scored by pull request acceptance likelihood and maintainer engagement velocity.

Topic Avg Merge Rate

66.5%

Avg Review Latency

23.6h

Filter by language

4 repositories tagged #llm-eval

A TierPython 11.8k

Arize-ai/phoenix

AI Observability & Evaluation

76.8%
Merge Rate
-
First Review
41%
1st-Timers
64
Maintainers
A TierPython 5.9k 1 GFIs

Giskard-AI/giskard-oss

🐢 Open-Source Evaluation & Testing library for LLM Agents

60.6%
Merge Rate
-
First Review
35%
1st-Timers
25
Maintainers
A TierTypeScript 25.8k

promptfoo/promptfoo

Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, DeepSeek, and more. Simple declarative configs with command line and CI/CD integration. Used by OpenAI and Anthropic.

65.2%
Merge Rate
1d
First Review
40%
1st-Timers
56
Maintainers
A TierPython 7.4k

open-compass/opencompass

OpenCompass is an LLM evaluation platform, supporting a wide range of models (Llama3, Mistral, InternLM2,GPT-4,LLaMa2, Qwen,GLM, Claude, etc) over 100+ datasets.

63.4%
Merge Rate
2d
First Review
39%
1st-Timers
16
Maintainers