#benchmarking (30 Repositories)

Marker-Inc-Korea/AutoRAG

AutoRAG: Now your agent can find anything in your computer. It gets smarter if you are using it frequently.

dotnet/BenchmarkDotNet

Powerful .NET library for benchmarking

reframe-hpc/reframe

A powerful Python framework for writing and running portable regression tests and benchmarks for HPC systems.

Blackwellboy/model-serving-minefield

Community registry of LLM serving-path traps that produce confidently wrong measurements: templates, tool parsers, reasoning fields, quant kernel paths, CUDA toolchains, KV allocation, eval harnesses, versioning. Symptom-first, with the check that catches each.

SouthpawIN/turbofit

Adaptive local inference for Hermes — TurboFit Check, evidence-built TurboFit List, repaired discovery/benchmark campaigns, Qwen 3.8 DFlash2, Bonsai DSpark, FreeToken, and Sirvir.

intel/optimization-zone

Data Center and Client workload and software optimizations for Intel hardware.

nosqlbench/nosqlbench

The open source, pluggable, nosql benchmarking suite.

locustio/locust

Write scalable load tests in plain Python 🚗💨

munich-quantum-toolkit/bench

MQT Bench - A Tool for Benchmarking Quantum Software Tools

sosy-lab/benchexec

BenchExec: A Framework for Reliable Benchmarking and Resource Measurement

psf/pyperf

Toolkit to run Python benchmarks

ktwu01/benchmark-radar

Track 20,710+ AI benchmark, eval, dataset, and data-quality records from 39 public sources, with linked evidence and daily updates.

ianarawjo/evalstats

Statistical analysis for LLM evaluations, from model and prompt comparisons to inference resilient to LLM judge bias, including at small sample sizes. All defaults battle-tested in Monte Carlo simulations.

bencherdev/bencher

🐰 Bencher - Continuous Benchmarking

flightlessmango/MangoHud

A Vulkan and OpenGL overlay for monitoring FPS, temperatures, CPU/GPU load and more.

SimonWaldherr/golang-benchmarks

Go(lang) benchmarks - (measure the speed of golang)

rsasaki0109/lidar_slam_ros2

ROS 2 LiDAR SLAM for pointcloud-map authoring, benchmarking, and Autoware-compatible map workflows.

rabbitmq/rabbitmq-perf-test

A load testing tool

vhive-serverless/vHive

vHive: Open-source framework for serverless experimentation

hendriknielaender/zBench

📊 zig benchmark

aiverify-foundation/moonshot

Moonshot - A simple and modular tool to evaluate and red-team any LLM application.

aliesbelik/awesome-jmeter

A collection of resources covering different aspects of JMeter usage.

JonMagon/KDiskMark

A simple open-source disk benchmark tool for Linux distros

Jij-Inc/OpenJij

OpenJij : Framework for the Ising model and QUBO.

atesgoral/hrm-solutions

Human Resource Machine solutions and size/speed hacks

criterion-rs/criterion.rs

NVIDIA-ISAAC-ROS/ros2_benchmark

Benchmark the performance of your ROS 2 graphs

spcl/serverless-benchmarks

SeBS: serverless benchmarking suite for automatic performance analysis of FaaS platforms.

openml/openml-python

OpenML's Python API for a World of Data and More 💫

ProjectPhysX/OpenCL-Benchmark

A small OpenCL benchmark program to measure peak GPU/CPU performance.