Open-source evaluation toolkit of large multi-modality models (LMMs), support 220+ LMMs, 80+ benchmarks
C-Rank Grade: B (Solid) - 46/100
External PR Merge Rate: 31%
Response Time: 2d
First Timer Success: 38%
open-compass/VLMEvalKit has a recorded first-timer success rate of 37.5%. Repositories ranked B typically provide actionable feedback during code reviews and actively nurture new community contributors.
Maintainers in open-compass/VLMEvalKit respond to incoming external pull requests in approximately 36.7 hours on average. Keeping PRs focused on single tasks and ensuring tests pass helps maintainers review faster.
The C-Rank™ system evaluates GitHub projects on a 0–100 scale using real data: PR merge rates, review turnaround time, active maintainer presence, and first-time contributor success. A score of 46.2 places open-compass/VLMEvalKit in the B tier.
The external contributor pull request merge rate for open-compass/VLMEvalKit is 30.9%, based on public PR activity from non-core contributors.
open-compass/VLMEvalKit does not currently have active "good first issue" tags indexed, but accepts external contributions through standard GitHub issue tracking.
Average Response Latency
Tracks hours until a maintainer leaves a review, comment, or PR response.
External Acceptance Rate
Percentage of community pull requests successfully merged into main.
First PR Conversion
Rate at which developers submitting their first repository PR succeed.
Show contributors that your repository actively reviews and merges external pull requests.
[](https://getmerged.abhishekco.de/open-compass/VLMEvalKit?utm_source=github&utm_medium=badge)
Enter your branch size and test coverage below to forecast review turnaround and get 1-click git splitting commands.
No cached good first issues currently tracked for open-compass/VLMEvalKit.
Rate what actually matters after opening a pull request here.
Rate your first-hand PR experience (review speed, maintainer responsiveness, and onboarding ease) to help other contributors.
When evaluating whether to contribute to open-compass/VLMEvalKit, response velocity and maintainer engagement are crucial. GetMerged continuously tracks pull request trajectories, first-comment latency, and code review rounds to help developers avoid submitting pull requests to backlogged repositories.
Currently, maintainers of open-compass/VLMEvalKit acknowledge new external contributions in approximately 1 days+. Out of all submitted pull requests from non-core authors in the last 180-day window, 30.9% were successfully merged into the primary branch.
open-compass/VLMEvalKit has a recorded first-timer success rate of 37.5%. Repositories ranked Solid typically provide actionable feedback during code reviews and actively nurture new community contributors.
The initial maintainer response time averages ~1 days+. Keeping PRs scoped to single concerns and ensuring CI checks succeed will optimize review turnaround.
The C-Rank™ index scores repositories on a 0 to 100 scale using an objective formula: external PR merge rates, initial response speed, active maintainer count, and first-time contributor retention. A score of 46.2 places open-compass/VLMEvalKit in the Solid tier.
The external pull request merge rate is 30.9%. GetMerged isolates non-core community contributions so external developers get an accurate benchmark of PR acceptance probability.
open-compass/VLMEvalKit does not have open beginner labels indexed currently, but external PRs for bugs and documentation improvements are evaluated via normal issue triage.
All metrics displayed for open-compass/VLMEvalKit are automatically retrieved via the public GitHub API and recalculated daily. Insider pull requests submitted by repository owners or organization members are excluded from merge rate calculations to preserve objective external contributor statistics.