Open-source evaluation toolkit of large multi-modality models (LMMs), support 220+ LMMs, 80+ benchmarks
C-Rank Grade: A (Welcoming) - 59/100
External PR Merge Rate: 34%
Response Time: -
First Timer Success: 18%
open-compass/VLMEvalKit has a recorded first-timer success rate of 18.2%. Repositories ranked A typically provide actionable feedback during code reviews and actively nurture new community contributors.
Maintainers in open-compass/VLMEvalKit respond to incoming external pull requests in approximately 0.0 hours on average. Keeping PRs focused on single tasks and ensuring tests pass helps maintainers review faster.
The C-Rank™ system evaluates GitHub projects on a 0–100 scale using real data: PR merge rates, review turnaround time, active maintainer presence, and first-time contributor success. A score of 58.7 places open-compass/VLMEvalKit in the A tier.
The external contributor pull request merge rate for open-compass/VLMEvalKit is 34.2%, based on public PR activity from non-core contributors.
open-compass/VLMEvalKit does not currently have active "good first issue" tags indexed, but accepts external contributions through standard GitHub issue tracking.
Highly welcoming maintainers in open-compass/VLMEvalKit. Prompt code reviews with positive guidance for new contributors.
Discussions in open-compass/VLMEvalKit focus heavily on practical implementation feedback, code formatting standards, and issue reproduction details.
Unlinked PRs without issue context and changes that fail automated test suites face the highest review friction.
Average Response Latency
Tracks hours until a maintainer leaves a review, comment, or PR response.
External Acceptance Rate
Percentage of community pull requests successfully merged into main.
First PR Conversion
Rate at which developers submitting their first repository PR succeed.
Show contributors that your repository actively reviews and merges external pull requests.
[](https://getmerged.abhishekco.de/open-compass/VLMEvalKit?utm_source=github&utm_medium=badge)
Historical health & responsiveness evolution
External PR acceptance
First PR success rate
50% receive response in
90% receive response in
Maintainer review activity heatmap & prime window prediction
Calculating local time...
Calculating local time...
Detected: UTC
Maintainers are most responsive around 11:00 UTC (11:00 UTC in your timezone). Recommended submission window is Wednesday - Friday from 08:00 to 12:00 UTC (08:00 - 12:00 UTC local).
Maintainer Strategy: Maintainer Sweet Spot: PRs under 150 lines merge in ~16 hours (43% approval). Large PRs (>500 lines) take ~115 hours (15% approval). Keep your diff compact for rapid review.
No cached good first issues currently tracked for open-compass/VLMEvalKit.
Rate what actually matters after opening a pull request here.
Rate your first-hand PR experience (review speed, maintainer responsiveness, and onboarding ease) to help other contributors.
When evaluating whether to contribute to open-compass/VLMEvalKit, response velocity and maintainer engagement are crucial. GetMerged continuously tracks pull request trajectories, first-comment latency, and code review rounds to help developers avoid submitting pull requests to backlogged repositories.
Currently, maintainers of open-compass/VLMEvalKit acknowledge new external contributions in approximately -. Out of all submitted pull requests from non-core authors in the last 180-day window, 34.2% were successfully merged into the primary branch.
open-compass/VLMEvalKit has a recorded first-timer success rate of 18.2%. Repositories ranked Welcoming typically provide actionable feedback during code reviews and actively nurture new community contributors.
The initial maintainer response time averages ~-. Keeping PRs scoped to single concerns and ensuring CI checks succeed will optimize review turnaround.
The C-Rank™ index scores repositories on a 0 to 100 scale using an objective formula: external PR merge rates, initial response speed, active maintainer count, and first-time contributor retention. A score of 58.7 places open-compass/VLMEvalKit in the Welcoming tier.
The external pull request merge rate is 34.2%. GetMerged isolates non-core community contributions so external developers get an accurate benchmark of PR acceptance probability.
open-compass/VLMEvalKit does not have open beginner labels indexed currently, but external PRs for bugs and documentation improvements are evaluated via normal issue triage.
All metrics displayed for open-compass/VLMEvalKit are automatically retrieved via the public GitHub API and recalculated daily. Insider pull requests submitted by repository owners or organization members are excluded from merge rate calculations to preserve objective external contributor statistics.