Skip to content

Add AlphaEvolve benchmark documentation #92

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
nikivanstein merged 1 commit into from
Jan 20, 2026
Merged

Add AlphaEvolve benchmark documentation #92

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
11 changes: 11 additions & 0 deletions README.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -28,6 +28,7 @@
- [Installation](#-installation)
- [Quick Start](#-quick-start)
- [Webapp](#-webapp)
- [AlphaEvolve Benchmarks](#alphaevolve-benchmarks)
- [Contributing](#-contributing)
- [License](#-license)
- [Citation](#-citation)
Expand Down Expand Up @@ -62,6 +63,16 @@ BLADE incorporates several benchmark function sets to provide a comprehensive ev

In addition, several real-world applications are included such as several photonics problems.

### AlphaEvolve Benchmarks

BLADE bundles benchmark instances inspired by the Google DeepMind
AlphaEvolve paper. The ready-to-run reference scripts live in
[`run_benchmarks/`](./run_benchmarks), while the reusable benchmark
definitions are organized under [`iohblade/benchmarks`](./iohblade/benchmarks)
by domain (analysis, combinatorics, geometry, matrix multiplication, number
theory, packing, and Fourier). Each domain folder includes a short README that
summarizes the task and instances.

### Included Search Methods

The suite contains the state-of-the-art LLM-assisted search algorithms:
Expand Down
23 changes: 23 additions & 0 deletions docs/benchmarks.rst
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,23 @@
AlphaEvolve Benchmarks
======================

BLADE includes benchmark instances inspired by the Google DeepMind
AlphaEvolve paper. These instances are available in two complementary forms:

- ``run_benchmarks/`` provides standalone reference scripts for running each
task directly.
- ``iohblade/benchmarks`` packages the same tasks for programmatic use in
experiments and pipelines.

The packaged benchmarks are grouped by domain:

- Analysis (auto-correlation inequalities)
- Combinatorics (Erdos min-overlap)
- Geometry (Heilbronn problems, kissing number, and distance ratios)
- Matrix multiplication
- Number theory (sums vs differences)
- Packing (rectangle, hexagon, and unit square packing)
- Fourier (uncertainty inequalities)

Each domain folder contains a README with task-specific details and citations
to the original sources.
1 change: 1 addition & 0 deletions docs/index.rst
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -185,6 +185,7 @@ If you use BLADE in your research, please consider citing the associated paper:

Introduction
Installation
benchmarks
webapp
modules
notebooks/simple_experiment
Expand Down
Loading