castorini/rank_llm - Open Source PR Review Scorecard

RankLLM is a Python toolkit for reproducible information retrieval research using rerankers, with a focus on listwise reranking.

C-Rank Grade: A (Welcoming) - 58/100

External PR Merge Rate: 71%

Response Time: <1h

First Timer Success: 100%

Frequently Asked Questions

Is castorini/rank_llm welcoming to first-time open-source contributors?

castorini/rank_llm has a recorded first-timer success rate of 100.0%. Repositories ranked A typically provide actionable feedback during code reviews and actively nurture new community contributors.

How fast can I expect code review feedback on my pull request?

Maintainers in castorini/rank_llm respond to incoming external pull requests in approximately 0.3 hours on average. Keeping PRs focused on single tasks and ensuring tests pass helps maintainers review faster.

What does the 58.0 C-Rank™ score (A Tier) represent?

The C-Rank™ system evaluates GitHub projects on a 0–100 scale using real data: PR merge rates, review turnaround time, active maintainer presence, and first-time contributor success. A score of 58.0 places castorini/rank_llm in the A tier.

What is the external contributor pull request merge rate for castorini/rank_llm?

The external contributor pull request merge rate for castorini/rank_llm is 71.0%, based on public PR activity from non-core contributors.

Are there Good First Issues available in castorini/rank_llm?

castorini/rank_llm does not currently have active "good first issue" tags indexed, but accepts external contributions through standard GitHub issue tracking.

castorini
castorini/rank_llmAWelcoming651
GitHub
Back to Explorer
castorini

castorini/rank_llm

651
AWelcoming(58/100)Python

RankLLM is a Python toolkit for reproducible information retrieval research using rerankers, with a focus on listwise reranking.

Compare
Jump to:

AI Maintainer Review Guidelines

Review Persona

Active Open-Source Maintainer

Warmth Score
7.8/10
Patience Score
8.2/10
Nitpick Rate
20%

Active maintainer team in castorini/rank_llm welcoming community pull requests and bug fixes.

Top PR Submission Do's

  • Ensure code complies with repository style conventions
  • Keep PRs focused and well-documented

Top PR Friction Pitfalls (Don'ts)

  • Do not submit unlinked PRs without context
  • Do not break existing automated test suites
Response Velocity
<1 hour
⚡ Fast reviewer response

Average Response Latency

Tracks hours until a maintainer leaves a review, comment, or PR response.

Merge Efficiency
71.0%
Moderate PR acceptance rate

External Acceptance Rate

Percentage of community pull requests successfully merged into main.

First-Timer Success
100.0%
Strong first-timer PR acceptance rate

First PR Conversion

Rate at which developers submitting their first repository PR succeed.

Active Maintainers
2 core
Small core review team
Diagnostic Health HUD
71.0%
Merge Gauge
100.0%
1st-Timer
Community Vibe88/100

Embed C-Rank Badge

Show contributors that your repository actively reviews and merges external pull requests.

GetMerged C-Rank badge for castorini/rank_llm
[![GetMerged C-Rank](https://getmerged.abhishekco.de/api/badge/castorini/rank_llm)](https://getmerged.abhishekco.de/castorini/rank_llm?utm_source=github&utm_medium=badge)

Active Good First Issues (0)

View on GitHub

No cached good first issues currently tracked for castorini/rank_llm.

View all good first issues directly on GitHub

Looking for more Python beginner tasks?Explore Python GFI

Contributor Community Vibe Feedback

Rate what actually matters after opening a pull request here.

Have you contributed to this repo?

Rate your first-hand PR experience (review speed, maintainer responsiveness, and onboarding ease) to help other contributors.

3 ratings required
Maintainer helpfulness
Review speed
Beginner friendliness

Contributor Compatibility & Review Speed Analysis for castorini/rank_llm

When evaluating whether to contribute to castorini/rank_llm, response velocity and maintainer engagement are crucial. GetMerged continuously tracks pull request trajectories, first-comment latency, and code review rounds to help developers avoid submitting pull requests to backlogged repositories.

Currently, maintainers of castorini/rank_llm acknowledge new external contributions in approximately <1 hour. Out of all submitted pull requests from non-core authors in the last 180-day window, 71.0% were successfully merged into the primary branch.

Frequently Asked Questions - Contributing to castorini/rank_llm

01

Is castorini/rank_llm welcoming to first-time open-source contributors?

castorini/rank_llm has a recorded first-timer success rate of 100.0%. Repositories ranked Welcoming typically provide actionable feedback during code reviews and actively nurture new community contributors.

02

How fast can I expect code review feedback on my pull request?

The initial maintainer response time averages ~<1 hour. Keeping PRs scoped to single concerns and ensuring CI checks succeed will optimize review turnaround.

03

What does the 58.0 C-Rank™ score represent?

The C-Rank™ index scores repositories on a 0 to 100 scale using an objective formula: external PR merge rates, initial response speed, active maintainer count, and first-time contributor retention. A score of 58.0 places castorini/rank_llm in the Welcoming tier.

04

What is the external contributor pull request merge rate for castorini/rank_llm?

The external pull request merge rate is 71.0%. GetMerged isolates non-core community contributions so external developers get an accurate benchmark of PR acceptance probability.

05

Are there beginner Good First Issues open in castorini/rank_llm?

castorini/rank_llm does not have open beginner labels indexed currently, but external PRs for bugs and documentation improvements are evaluated via normal issue triage.

GetMerged C-Rank™ Indexing Standard

All metrics displayed for castorini/rank_llm are automatically retrieved via the public GitHub API and recalculated daily. Insider pull requests submitted by repository owners or organization members are excluded from merge rate calculations to preserve objective external contributor statistics.