Skip to content

Latest commit

 

History

History

postprocessing

Benchmarking Results

This page summarizes the results of the postprocessing notebooks found in this folder.

Results are summarized over datasets.

Problems

problem_sizes

We analyze two types of problems:

Black-box Regression Problems: problems for which the ground-truth model is not known/ not sought. Includes a mix of real-world and synthetic datasets from PMLB. 122 total.

Ground-truth Regression Problems: problems for which the ground-truth model known. Includes datasets from the Feynman Symbolic Regression Database and dynamical systems from the ODE-Strogatz Database. 130 total.

Results for Black-box Regression

bb_overall

Accuracy-Complexity Trade-offs

Considering the accuracy and simplicity of models simultaneously, this figure illustrates the trade-offs made by each method. Methods lower and to the left produce models with better trade-offs between accuracy and simplicity.

pareto_rankings

Results for Ground-truth Problems

Symbolically-verfied Solutions

How often a method finds a model symbolically equivalent to the ground-truth process

solution_rates

Accuracy Solutions

How often a method finds a model with test set R2>0.999

accuracy_solution_rates