The official evaluation suite and dynamic data release for MixEval.

benchmark evaluation benchmarking-suite evaluation-framework benchmarking-framework foundation-models large-language-models large-language-model llm-inference llm-evaluation large-multimodal-models llm-evaluation-framework benchmark-mixture mixeval

• Updated Nov 10, 2024
• Python

GERBIL - General Entity annotatoR Benchmark

benchmarking named-entity-recognition entity-linking benchmarking-framework entity-annotation

• Updated Jul 5, 2026
• Java

Benchmark framework of compute-in-memory based accelerators for deep neural network (on-chip training chip focused)

benchmarking-framework dnn-neurosim xiaochen-peng memory-accelerators chip-training

• Updated Feb 21, 2024
• C++

MLOS is a project to enable autotuning for systems.

infrastructure performance-engineering benchmarking data-science autotuning benchmarking-framework optimize-systems

• Updated Nov 11, 2026
• Python

Python Multi-Process Execution Pool: concurrent asynchronous execution pool with custom resource constraints (memory, timeouts, affinity, CPU cores and caching), load balancing and profiling capabilities of the external apps on NUMA architecture

multiprocessing parallel-computing numa monitoring-server cache-control task-queue application-framework parallel-processing execution-pool benchmarking-framework load-balancing in-memory-computations

• Updated Aug 28, 2019
• Python

SustainDC is a set of Python environments for Data Center simulation and control using Heterogeneous Multi Agent Reinforcement Learning. Includes customizable environments for workload scheduling, cooling optimization, and battery management, with integration into Gymnasium.

python benchmarking benchmark machine-learning sustainability data-center energy-efficiency gymnasium benchmarking-framework carbon-footprint multi-agent-reinforcement-learning battery-management sustainable-computing gymnasium-environment data-center-management workload-scheduling cooling-optimization heterogeneous-reinforcement-learning reinforcement-learningmulti-agent-systems

• Updated Aug 25, 2025
• HTML

A toolkit for auto-generation of OpenAI Gym environments from RDDL description files.

visualization benchmarking simulator reinforcement-learning planner simulation visualisation planning visualizer gym benchmark-framework gymnasium evaluation-framework benchmarking-framework planning-domain-definition-language model-based planners gym-environments rddl rddl-domains

• Updated Nov 9, 2026
• Python

NPBench - A Benchmarking Suite for High-Performance NumPy

python numpy benchmarking-suite benchmarking-framework

• Updated Sep 2, 2026
• Python

Benchmark framework of compute-in-memory based accelerators for deep neural network (on-chip training chip focused)

benchmarking-framework dnn-neurosim xiaochen-peng memory-accelerators chip-training

• Updated Jun 1, 2021
• C++

PIMeval simulator and PIMbench suite

open-source benchmark simulator architecture cuda-kernels benchmark-suite benchmarking-framework modeling-and-simulation near-data-processing processing-in-memory

• Updated Aug 11, 2026
• C++

A guidance for the design and evaluation of motion planners for quadrotors in Environments with Varying Complexities

motion-planning benchmarking-framework

• Updated Aug 13, 2024

Arline Benchmarks platform allows to benchmark various algorithms for quantum circuit mapping/compression against each other on a list of predefined hardware types and target circuit classes

python benchmarking benchmark quantum quantum-computing benchmarks benchmarking-framework quantum-benchmarks

• Updated Mar 2, 2022
• Python

Benchmarking machine learning inferencing on embedded hardware.

raspberry-pi benchmark machine-learning benchmarking-framework movidius jetson-nano coral-tpu tiny-ml small-ai

• Updated Jul 18, 2025
• Python

Command execution time meter

benchmark performance performance-testing benchmarking-framework

• Updated Aug 7, 2026
• C#

The greatest collection of the worst code

mysql redis benchmarking laravel performance performance-analysis benchmarking-framework laravel-eloquent

• Updated Jul 17, 2026
• PHP

Benchmark framework of compute-in-memory based accelerators for deep neural network (inference engine focused)

benchmarking-framework dnn-neurosim xiaochen-peng iedm

• Updated Jun 1, 2021
• C++

Benchmarking framework for Feature Selection and Feature Ranking algorithms 🚀

python benchmarking machine-learning scikit-learn feature-selection hydra benchmarks automl benchmarking-framework feature-ranking wandb feature-rankers

• Updated Apr 12, 2023
• Python

Telco pIPeline benchmarking SYstem

benchmarking dpdk vpp openvswitch ovs lagopus benchmarking-framework moongen bess

• Updated Nov 6, 2026
• Python

Benchmarking optimization solvers.

benchmark optimization constrained-optimization benchmarks benchmarking-suite benchmark-framework optimization-tools numerical-optimization nonlinear-optimization benchmark-suite benchmarking-framework unconstrained-optimization blackbox-optimization derivative-free-optimization zeroth-order-optimization

• Updated Nov 9, 2026
• Python

Write Benchmarks like Tests

smalltalk squeak benchmarks pharo benchmarking-framework

• Updated Sep 8, 2021
• Smalltalk