reframe-hpc/reframe - Open Source PR Review Scorecard

A powerful Python framework for writing and running portable regression tests and benchmarks for HPC systems.

C-Rank Grade: A (Welcoming) - 66/100

External PR Merge Rate: 88%

Response Time: 11h

First Timer Success: 100%

Frequently Asked Questions

Is reframe-hpc/reframe welcoming to first-time open-source contributors?

reframe-hpc/reframe has a recorded first-timer success rate of 100.0%. Repositories ranked A typically provide actionable feedback during code reviews and actively nurture new community contributors.

How fast can I expect code review feedback on my pull request?

Maintainers in reframe-hpc/reframe respond to incoming external pull requests in approximately 11.0 hours on average. Keeping PRs focused on single tasks and ensuring tests pass helps maintainers review faster.

What does the 66.4 C-Rank™ score (A Tier) represent?

The C-Rank™ system evaluates GitHub projects on a 0–100 scale using real data: PR merge rates, review turnaround time, active maintainer presence, and first-time contributor success. A score of 66.4 places reframe-hpc/reframe in the A tier.

What is the external contributor pull request merge rate for reframe-hpc/reframe?

The external contributor pull request merge rate for reframe-hpc/reframe is 87.5%, based on public PR activity from non-core contributors.

Are there Good First Issues available in reframe-hpc/reframe?

reframe-hpc/reframe currently has 2 active issue(s) tagged with beginner-friendly labels like "good first issue", "beginner", or "up-for-grabs".

reframe-hpc
reframe-hpc/reframeA•Welcoming283
GitHub
Back to Explorer
reframe-hpc

reframe-hpc/reframe

283
Active (30d)A•Welcoming(66/100)Python

A powerful Python framework for writing and running portable regression tests and benchmarks for HPC systems.

GitHub
Compare••
Jump to:

AI Maintainer Review Guidelines

Review Persona

Active Open-Source Maintainer

Warmth Score
7.8/10
Patience Score
8.2/10
Nitpick Rate
20%

Active maintainer team in reframe-hpc/reframe welcoming community pull requests and bug fixes.

Top PR Submission Do's

  • •Ensure code complies with repository style conventions
  • •Keep PRs focused and well-documented

Top PR Friction Pitfalls (Don'ts)

  • •Do not submit unlinked PRs without context
  • •Do not break existing automated test suites
Response Velocity
10 hours
Standard maintainer review cycle

Average Response Latency

Tracks hours until a maintainer leaves a review, comment, or PR response.

Merge Efficiency
87.5%
High acceptance rate for external PRs

External Acceptance Rate

Percentage of community pull requests successfully merged into main.

First-Timer Success
100.0%
Strong first-timer PR acceptance rate

First PR Conversion

Rate at which developers submitting their first repository PR succeed.

Active Maintainers
5 core
Small core review team
Diagnostic Health HUD
87.5%
Merge Gauge
100.0%
1st-Timer
Community Vibe87/100

Embed C-Rank Badge

Show contributors that your repository actively reviews and merges external pull requests.

GetMerged C-Rank badge for reframe-hpc/reframe
[![GetMerged C-Rank](https://getmerged.abhishekco.de/api/badge/reframe-hpc/reframe)](https://getmerged.abhishekco.de/reframe-hpc/reframe?utm_source=github&utm_medium=badge)

Active Good First Issues (3)

View on GitHub

[2026-09-08T16:05:03.799945] debug: reframe: Loading user configuration [2026-09-08T16:05:03.800691] debug: reframe: Loading the builtin configuration [2026-09-08T16:05:03.800969] debug: reframe: Loading configuration file: '/gpfs/home5/satishk/projects/eessi_reframe/settings_example.py' [2026-09-08T16:05:03.823138] debug: reframe: '16_nodes' does not match '^[a-zA-Z_](?:[a-zA-Z0-9_-])*$' Failed validating 'pattern' in schema['properties']['systems']['items']['properties']['partitions']['items']['properties']['features']['items']: {'type': 'string', 'pattern': '^[a-zA-Z_](?:[a-zA-Z0-9_-])*$'} On instance['systems'][0]['partitions'][3]['features'][13]: '16_nodes' [2026-09-08T16:05:03.823379] error: reframe: �[31mERROR: failed to load configuration: could not validate configuration files: `<builtin>`, `/gpfs/home5/satishk/projects/eessi_reframe/settings_example.py`: '16_nodes' does not match '^[a-zA-Z_](?:[a-zA-Z0-9_-])*$'�[0m [2026-09-08T16:05:03.823557] info: reframe: Log

📅 Opened Sep 8, 2026💬 17 comments
Quality: 60/100Contribute

@vkarak - let me know if this makes sense, I quickly gathered below from an external cluster: Description ReFrame can hang / wait indefinitely when a Slurm job fails during node startup/prolog handling and Slurm accounting records the top-level job as REQUEUED, even though the job is no longer active. In this case, the job hit a prolog/startup issue on a GPU node. The job then entered CG while epilog handling was still active, and I cancelled it manually. After cancellation: squeue no longer showed the job scontrol show job reported the job id as invalid sacct continued to report the top-level job as REQUEUED ReFrame continued polling ? Environment ReFrame version: master branch f1744f0 Scheduler: Slurm Launcher: srun Test type: RunOnlyRegressionTest Test command: simple nvidia-smi query Logs $ /path/to/reframe -C sites/site-config.py -c checks/nvidia_smi.py --system cluster:gpu_preflight -r [2026-07-17T12:45:56.983732] info: reframe: [ReFrame Setup] [2026-07-17T12:45:56.983968]

📅 Opened Jul 17, 2026💬 1 comment
Quality: 40/100Contribute

I have a module whose behavior I can modify by setting an environment variable before loading it. This module loads an environment, that again provides other modules. I.e. interactively, I'd do: export X=foo module load Y/1.1 # the load behaviour is affected by the value of X module avail bar # bar is available in this environment (but only if X=foo) I'd like reframe.utility.find_modules to be able to find bar. I've noticed that I cannot simply specify environment.env_vars because those only get set after reframe.core.runtime.loadenv has already called the module commands. So, I figured I'll just leverage prepare_cmds instead: 'environments': [ { 'prepare_cmds': ['export X=foo'], 'modules': ['Y/1.1'] } Alas, this didn't work. Looking at the code, I can see why: the prepare_cmds are appended to the returned commands here, but they are not executed when loadenv() is called. According to my AI friend, they are only emitted to the job script that reframe stages

📅 Opened Jul 13, 2026💬 2 comments
Quality: 40/100Contribute
Looking for more Python beginner tasks?Explore Python GFI

Contributor Community Vibe Feedback

Rate what actually matters after opening a pull request here.

Have you contributed to this repo?

Rate your first-hand PR experience (review speed, maintainer responsiveness, and onboarding ease) to help other contributors.

3 ratings required
Maintainer helpfulness
Review speed
Beginner friendliness

Contributor Compatibility & Review Speed Analysis for reframe-hpc/reframe

When evaluating whether to contribute to reframe-hpc/reframe, response velocity and maintainer engagement are crucial. GetMerged continuously tracks pull request trajectories, first-comment latency, and code review rounds to help developers avoid submitting pull requests to backlogged repositories.

Currently, maintainers of reframe-hpc/reframe acknowledge new external contributions in approximately 10 hours. Out of all submitted pull requests from non-core authors in the last 180-day window, 87.5% were successfully merged into the primary branch.

Frequently Asked Questions - Contributing to reframe-hpc/reframe

01

Is reframe-hpc/reframe welcoming to first-time open-source contributors?

reframe-hpc/reframe has a recorded first-timer success rate of 100.0%. Repositories ranked Welcoming typically provide actionable feedback during code reviews and actively nurture new community contributors.

02

How fast can I expect code review feedback on my pull request?

The initial maintainer response time averages ~10 hours. Keeping PRs scoped to single concerns and ensuring CI checks succeed will optimize review turnaround.

03

What does the 66.4 C-Rank™ score represent?

The C-Rank™ index scores repositories on a 0 to 100 scale using an objective formula: external PR merge rates, initial response speed, active maintainer count, and first-time contributor retention. A score of 66.4 places reframe-hpc/reframe in the Welcoming tier.

04

What is the external contributor pull request merge rate for reframe-hpc/reframe?

The external pull request merge rate is 87.5%. GetMerged isolates non-core community contributions so external developers get an accurate benchmark of PR acceptance probability.

05

Are there beginner Good First Issues open in reframe-hpc/reframe?

Yes, reframe-hpc/reframe currently has 2 active issue(s) tagged with beginner-friendly labels. You can inspect these directly from the repository issues tab.

GetMerged C-Rank™ Indexing Standard

All metrics displayed for reframe-hpc/reframe are automatically retrieved via the public GitHub API and recalculated daily. Insider pull requests submitted by repository owners or organization members are excluded from merge rate calculations to preserve objective external contributor statistics.