Open
Description
Benchmark comparison has identified performance shifts at:
- commit ccfe4ee (Unpin dask 2 #6342).
Please review the report below and take corrective/congratulatory action as appropriate :slightly_smiling_face:
⏱️ Performance Benchmark Report: ccfe4ee
Performance shifts
| Change | Before [ed45606b] <main~2> | After [ccfe4ee9] <main~1> | Ratio | Benchmark (Parameter) |
|----------|------------------------------|-----------------------------|---------|------------------------------------------------------------------------|
| - | 37.0±2ms | 30.2±2ms | 0.82 | aggregate_collapse.Aggregation.time_aggregated_by_GMEAN(False) |
| - | 499±100ms | 379±50ms | 0.76 | aggregate_collapse.Aggregation.time_aggregated_by_PERCENTILE(False) |
| - | 510±40ms | 368±40ms | 0.72 | aggregate_collapse.Aggregation.time_aggregated_by_PERCENTILE(True) |
| - | 35.8±2ms | 29.2±1ms | 0.82 | aggregate_collapse.Aggregation.time_aggregated_by_PROPORTION(False) |
| - | 37.4±2ms | 29.7±2ms | 0.79 | aggregate_collapse.Aggregation.time_aggregated_by_PROPORTION(True) |
| - | 24.7±2ms | 17.6±0.9ms | 0.71 | aggregate_collapse.Aggregation.time_collapsed_by_COUNT(False) |
| - | 29.2±0.8ms | 21.3±1ms | 0.73 | aggregate_collapse.Aggregation.time_collapsed_by_COUNT(True) |
| - | 23.0±2ms | 15.5±1ms | 0.68 | aggregate_collapse.Aggregation.time_collapsed_by_GMEAN(False) |
| - | 27.3±1ms | 19.5±1ms | 0.72 | aggregate_collapse.Aggregation.time_collapsed_by_GMEAN(True) |
| - | 22.7±0.9ms | 15.6±1ms | 0.69 | aggregate_collapse.Aggregation.time_collapsed_by_HMEAN(False) |
| - | 27.2±1ms | 19.6±0.9ms | 0.72 | aggregate_collapse.Aggregation.time_collapsed_by_HMEAN(True) |
| - | 23.3±0.4ms | 16.3±1ms | 0.7 | aggregate_collapse.Aggregation.time_collapsed_by_MAX(False) |
| - | 28.1±1ms | 20.5±1ms | 0.73 | aggregate_collapse.Aggregation.time_collapsed_by_MAX(True) |
| - | 37.2±2ms | 30.5±0.6ms | 0.82 | aggregate_collapse.Aggregation.time_collapsed_by_MAX_RUN(False) |
| - | 23.9±0.6ms | 16.5±0.8ms | 0.69 | aggregate_collapse.Aggregation.time_collapsed_by_MEAN(False) |
| - | 28.1±1ms | 20.8±0.9ms | 0.74 | aggregate_collapse.Aggregation.time_collapsed_by_MEAN(True) |
| - | 26.2±0.7ms | 19.4±1ms | 0.74 | aggregate_collapse.Aggregation.time_collapsed_by_MEDIAN(False) |
| - | 31.0±0.9ms | 23.1±2ms | 0.75 | aggregate_collapse.Aggregation.time_collapsed_by_MEDIAN(True) |
| - | 23.4±0.9ms | 16.3±0.9ms | 0.7 | aggregate_collapse.Aggregation.time_collapsed_by_MIN(False) |
| - | 27.7±0.8ms | 20.0±0.9ms | 0.72 | aggregate_collapse.Aggregation.time_collapsed_by_MIN(True) |
| - | 22.3±0.3ms | 15.3±1ms | 0.69 | aggregate_collapse.Aggregation.time_collapsed_by_PROPORTION(False) |
| - | 26.7±0.4ms | 19.7±1ms | 0.74 | aggregate_collapse.Aggregation.time_collapsed_by_PROPORTION(True) |
| - | 25.6±0.8ms | 18.3±1ms | 0.72 | aggregate_collapse.Aggregation.time_collapsed_by_RMS(False) |
| - | 29.8±0.3ms | 23.1±1ms | 0.78 | aggregate_collapse.Aggregation.time_collapsed_by_RMS(True) |
| - | 25.2±0.3ms | 17.9±1ms | 0.71 | aggregate_collapse.Aggregation.time_collapsed_by_STD_DEV(False) |
| - | 29.5±0.3ms | 21.8±0.9ms | 0.74 | aggregate_collapse.Aggregation.time_collapsed_by_STD_DEV(True) |
| - | 24.6±0.4ms | 17.4±1ms | 0.7 | aggregate_collapse.Aggregation.time_collapsed_by_VARIANCE(False) |
| - | 28.9±0.5ms | 21.3±1ms | 0.74 | aggregate_collapse.Aggregation.time_collapsed_by_VARIANCE(True) |
| - | 29.6±0.4ms | 22.1±2ms | 0.75 | aggregate_collapse.WeightedAggregation.time_w_collapsed_by_MEAN(False) |
| - | 33.6±0.3ms | 26.0±2ms | 0.77 | aggregate_collapse.WeightedAggregation.time_w_collapsed_by_MEAN(True) |
| - | 31.3±0.6ms | 24.0±2ms | 0.77 | aggregate_collapse.WeightedAggregation.time_w_collapsed_by_RMS(False) |
| - | 35.6±0.6ms | 27.8±2ms | 0.78 | aggregate_collapse.WeightedAggregation.time_w_collapsed_by_RMS(True) |
| - | 25.3±0.3ms | 19.3±1ms | 0.76 | aggregate_collapse.WeightedAggregation.time_w_collapsed_by_SUM(False) |
| - | 29.7±0.4ms | 22.9±1ms | 0.77 | aggregate_collapse.WeightedAggregation.time_w_collapsed_by_SUM(True) |
| Change | Before [ed45606b] <main~2> | After [ccfe4ee9] <main~1> | Ratio | Benchmark (Parameter) |
|----------|------------------------------|-----------------------------|---------|-------------------------------------------------------------------------------------------|
| + | 19.2±0.2ms | 26.8±2ms | 1.4 | load.LoadAndRealise.time_realise((1280, 960, 5), False, 'NetCDF') |
| + | 13±0M | 25±0.09M | 1.92 | mesh.utils.regions_combine.CombineRegionsCreateCube.tracemalloc_create_combined_cube(500) |
| + | 24.4±2M | 29.7±1M | 1.22 | stats.PearsonR.tracemalloc_lazy |
Full benchmark results
Benchmarks that have improved:
| Change | Before [ed45606b] <main~2> | After [ccfe4ee9] <main~1> | Ratio | Benchmark (Parameter) |
|----------|------------------------------|-----------------------------|---------|------------------------------------------------------------------------|
| - | 37.0±2ms | 30.2±2ms | 0.82 | aggregate_collapse.Aggregation.time_aggregated_by_GMEAN(False) |
| - | 499±100ms | 379±50ms | 0.76 | aggregate_collapse.Aggregation.time_aggregated_by_PERCENTILE(False) |
| - | 510±40ms | 368±40ms | 0.72 | aggregate_collapse.Aggregation.time_aggregated_by_PERCENTILE(True) |
| - | 35.8±2ms | 29.2±1ms | 0.82 | aggregate_collapse.Aggregation.time_aggregated_by_PROPORTION(False) |
| - | 37.4±2ms | 29.7±2ms | 0.79 | aggregate_collapse.Aggregation.time_aggregated_by_PROPORTION(True) |
| - | 24.7±2ms | 17.6±0.9ms | 0.71 | aggregate_collapse.Aggregation.time_collapsed_by_COUNT(False) |
| - | 29.2±0.8ms | 21.3±1ms | 0.73 | aggregate_collapse.Aggregation.time_collapsed_by_COUNT(True) |
| - | 23.0±2ms | 15.5±1ms | 0.68 | aggregate_collapse.Aggregation.time_collapsed_by_GMEAN(False) |
| - | 27.3±1ms | 19.5±1ms | 0.72 | aggregate_collapse.Aggregation.time_collapsed_by_GMEAN(True) |
| - | 22.7±0.9ms | 15.6±1ms | 0.69 | aggregate_collapse.Aggregation.time_collapsed_by_HMEAN(False) |
| - | 27.2±1ms | 19.6±0.9ms | 0.72 | aggregate_collapse.Aggregation.time_collapsed_by_HMEAN(True) |
| - | 23.3±0.4ms | 16.3±1ms | 0.7 | aggregate_collapse.Aggregation.time_collapsed_by_MAX(False) |
| - | 28.1±1ms | 20.5±1ms | 0.73 | aggregate_collapse.Aggregation.time_collapsed_by_MAX(True) |
| - | 37.2±2ms | 30.5±0.6ms | 0.82 | aggregate_collapse.Aggregation.time_collapsed_by_MAX_RUN(False) |
| - | 23.9±0.6ms | 16.5±0.8ms | 0.69 | aggregate_collapse.Aggregation.time_collapsed_by_MEAN(False) |
| - | 28.1±1ms | 20.8±0.9ms | 0.74 | aggregate_collapse.Aggregation.time_collapsed_by_MEAN(True) |
| - | 26.2±0.7ms | 19.4±1ms | 0.74 | aggregate_collapse.Aggregation.time_collapsed_by_MEDIAN(False) |
| - | 31.0±0.9ms | 23.1±2ms | 0.75 | aggregate_collapse.Aggregation.time_collapsed_by_MEDIAN(True) |
| - | 23.4±0.9ms | 16.3±0.9ms | 0.7 | aggregate_collapse.Aggregation.time_collapsed_by_MIN(False) |
| - | 27.7±0.8ms | 20.0±0.9ms | 0.72 | aggregate_collapse.Aggregation.time_collapsed_by_MIN(True) |
| - | 22.3±0.3ms | 15.3±1ms | 0.69 | aggregate_collapse.Aggregation.time_collapsed_by_PROPORTION(False) |
| - | 26.7±0.4ms | 19.7±1ms | 0.74 | aggregate_collapse.Aggregation.time_collapsed_by_PROPORTION(True) |
| - | 25.6±0.8ms | 18.3±1ms | 0.72 | aggregate_collapse.Aggregation.time_collapsed_by_RMS(False) |
| - | 29.8±0.3ms | 23.1±1ms | 0.78 | aggregate_collapse.Aggregation.time_collapsed_by_RMS(True) |
| - | 25.2±0.3ms | 17.9±1ms | 0.71 | aggregate_collapse.Aggregation.time_collapsed_by_STD_DEV(False) |
| - | 29.5±0.3ms | 21.8±0.9ms | 0.74 | aggregate_collapse.Aggregation.time_collapsed_by_STD_DEV(True) |
| - | 24.6±0.4ms | 17.4±1ms | 0.7 | aggregate_collapse.Aggregation.time_collapsed_by_VARIANCE(False) |
| - | 28.9±0.5ms | 21.3±1ms | 0.74 | aggregate_collapse.Aggregation.time_collapsed_by_VARIANCE(True) |
| - | 29.6±0.4ms | 22.1±2ms | 0.75 | aggregate_collapse.WeightedAggregation.time_w_collapsed_by_MEAN(False) |
| - | 33.6±0.3ms | 26.0±2ms | 0.77 | aggregate_collapse.WeightedAggregation.time_w_collapsed_by_MEAN(True) |
| - | 31.3±0.6ms | 24.0±2ms | 0.77 | aggregate_collapse.WeightedAggregation.time_w_collapsed_by_RMS(False) |
| - | 35.6±0.6ms | 27.8±2ms | 0.78 | aggregate_collapse.WeightedAggregation.time_w_collapsed_by_RMS(True) |
| - | 25.3±0.3ms | 19.3±1ms | 0.76 | aggregate_collapse.WeightedAggregation.time_w_collapsed_by_SUM(False) |
| - | 29.7±0.4ms | 22.9±1ms | 0.77 | aggregate_collapse.WeightedAggregation.time_w_collapsed_by_SUM(True) |
Benchmarks that have stayed the same:
| Change | Before [ed45606b] <main~2> | After [ccfe4ee9] <main~1> | Ratio | Benchmark (Parameter) |
|----------|------------------------------|-----------------------------|---------|---------------------------------------------------------------------------------------------|
| | 59.6±3ms | 51.5±3ms | 0.86 | aggregate_collapse.Aggregation.time_aggregated_by_COUNT(False) |
| | 59.2±3ms | 52.4±4ms | 0.89 | aggregate_collapse.Aggregation.time_aggregated_by_COUNT(True) |
| | 199±20ms | 187±20ms | 0.94 | aggregate_collapse.Aggregation.time_aggregated_by_FAST_PERCENTILE(False) |
| | 201±30ms | 187±20ms | 0.93 | aggregate_collapse.Aggregation.time_aggregated_by_FAST_PERCENTILE(True) |
| | 37.8±4ms | 31.1±2ms | ~0.82 | aggregate_collapse.Aggregation.time_aggregated_by_GMEAN(True) |
| | 37.1±2ms | 31.1±2ms | 0.84 | aggregate_collapse.Aggregation.time_aggregated_by_HMEAN(False) |
| | 37.5±2ms | 31.3±1ms | 0.83 | aggregate_collapse.Aggregation.time_aggregated_by_HMEAN(True) |
| | 51.0±3ms | 44.2±2ms | 0.87 | aggregate_collapse.Aggregation.time_aggregated_by_MAX(False) |
| | 51.9±2ms | 44.5±4ms | 0.86 | aggregate_collapse.Aggregation.time_aggregated_by_MAX(True) |
| | 137±8ms | 130±20ms | 0.95 | aggregate_collapse.Aggregation.time_aggregated_by_MAX_RUN(False) |
| | 138±10ms | 128±20ms | 0.93 | aggregate_collapse.Aggregation.time_aggregated_by_MAX_RUN(True) |
| | 55.5±4ms | 46.8±3ms | 0.84 | aggregate_collapse.Aggregation.time_aggregated_by_MEAN(False) |
| | 55.9±5ms | 47.7±3ms | 0.85 | aggregate_collapse.Aggregation.time_aggregated_by_MEAN(True) |
| | 63.3±5ms | 55.8±6ms | 0.88 | aggregate_collapse.Aggregation.time_aggregated_by_MEDIAN(False) |
| | 63.5±4ms | 56.8±5ms | 0.89 | aggregate_collapse.Aggregation.time_aggregated_by_MEDIAN(True) |
| | 51.4±4ms | 43.9±2ms | 0.85 | aggregate_collapse.Aggregation.time_aggregated_by_MIN(False) |
| | 52.1±4ms | 45.0±2ms | 0.86 | aggregate_collapse.Aggregation.time_aggregated_by_MIN(True) |
| | 1.10±0.01s | 1.07±0.03s | 0.97 | aggregate_collapse.Aggregation.time_aggregated_by_PEAK(False) |
| | 1.10±0.01s | 1.07±0.02s | 0.98 | aggregate_collapse.Aggregation.time_aggregated_by_PEAK(True) |
| | 66.4±1ms | 58.8±5ms | 0.89 | aggregate_collapse.Aggregation.time_aggregated_by_RMS(False) |
| | 67.0±2ms | 59.2±4ms | 0.88 | aggregate_collapse.Aggregation.time_aggregated_by_RMS(True) |
| | 70.6±2ms | 60.3±8ms | 0.85 | aggregate_collapse.Aggregation.time_aggregated_by_STD_DEV(False) |
| | 70.6±2ms | 62.0±7ms | 0.88 | aggregate_collapse.Aggregation.time_aggregated_by_STD_DEV(True) |
| | 65.5±1ms | 57.5±5ms | 0.88 | aggregate_collapse.Aggregation.time_aggregated_by_VARIANCE(False) |
| | 64.8±2ms | 57.3±3ms | 0.88 | aggregate_collapse.Aggregation.time_aggregated_by_VARIANCE(True) |
| | 130±7ms | 126±20ms | 0.97 | aggregate_collapse.Aggregation.time_collapsed_by_FAST_PERCENTILE(False) |
| | 146±10ms | 142±10ms | 0.97 | aggregate_collapse.Aggregation.time_collapsed_by_FAST_PERCENTILE(True) |
| | 41.1±1ms | 34.5±2ms | 0.84 | aggregate_collapse.Aggregation.time_collapsed_by_MAX_RUN(True) |
| | 542±4ms | 530±5ms | 0.98 | aggregate_collapse.Aggregation.time_collapsed_by_PEAK(False) |
| | 549±4ms | 538±3ms | 0.98 | aggregate_collapse.Aggregation.time_collapsed_by_PEAK(True) |
| | 151±10ms | 138±20ms | 0.91 | aggregate_collapse.Aggregation.time_collapsed_by_PERCENTILE(False) |
| | 165±7ms | 153±20ms | 0.93 | aggregate_collapse.Aggregation.time_collapsed_by_PERCENTILE(True) |
| | 92.5±1ms | 83.1±7ms | 0.90 | aggregate_collapse.WeightedAggregation.time_w_aggregated_by_MEAN(False) |
| | 93.4±0.9ms | 82.8±5ms | 0.89 | aggregate_collapse.WeightedAggregation.time_w_aggregated_by_MEAN(True) |
| | 104±2ms | 95.3±8ms | 0.91 | aggregate_collapse.WeightedAggregation.time_w_aggregated_by_RMS(False) |
| | 104±0.9ms | 96.5±8ms | 0.93 | aggregate_collapse.WeightedAggregation.time_w_aggregated_by_RMS(True) |
| | 61.2±0.5ms | 54.4±4ms | 0.89 | aggregate_collapse.WeightedAggregation.time_w_aggregated_by_SUM(False) |
| | 62.0±0.6ms | 55.2±4ms | 0.89 | aggregate_collapse.WeightedAggregation.time_w_aggregated_by_SUM(True) |
| | 317±5ms | 275±20ms | 0.87 | aggregate_collapse.WeightedAggregation.time_w_collapsed_by_WPERCENTILE(False) |
| | 331±3ms | 286±20ms | 0.86 | aggregate_collapse.WeightedAggregation.time_w_collapsed_by_WPERCENTILE(True) |
| | 1.11±0.01ms | 1.09±0.04ms | 0.98 | cube.CubeCreation.time_create(False, 'construct') |
| | 379±5μs | 377±7μs | 1.00 | cube.CubeCreation.time_create(False, 'instantiate') |
| | 931±20μs | 947±6μs | 1.02 | cube.CubeCreation.time_create(True, 'construct') |
| | 555±10μs | 562±10μs | 1.01 | cube.CubeCreation.time_create(True, 'instantiate') |
| | 226±1ms | 225±20ms | 1.00 | cube.CubeEquality.time_equality(False, False, 'all_equal') |
| | 119±2ms | 118±10ms | 0.99 | cube.CubeEquality.time_equality(False, False, 'coord_inequality') |
| | 252±2ms | 252±20ms | 1.00 | cube.CubeEquality.time_equality(False, False, 'data_inequality') |
| | 16.2±0.2μs | 16.4±0.2μs | 1.01 | cube.CubeEquality.time_equality(False, False, 'metadata_inequality') |
| | 309±2ms | 308±40ms | 1.00 | cube.CubeEquality.time_equality(False, True, 'all_equal') |
| | 205±1ms | 201±20ms | 0.98 | cube.CubeEquality.time_equality(False, True, 'coord_inequality') |
| | 335±3ms | 335±40ms | 1.00 | cube.CubeEquality.time_equality(False, True, 'data_inequality') |
| | 16.6±0.2μs | 16.5±0.3μs | 1.00 | cube.CubeEquality.time_equality(False, True, 'metadata_inequality') |
| | 226±1ms | 225±20ms | 1.00 | cube.CubeEquality.time_equality(True, False, 'all_equal') |
| | 117±0.8ms | 117±10ms | 1.00 | cube.CubeEquality.time_equality(True, False, 'coord_inequality') |
| | 251±2ms | 249±20ms | 0.99 | cube.CubeEquality.time_equality(True, False, 'data_inequality') |
| | 51.1±0.9μs | 50.2±0.7μs | 0.98 | cube.CubeEquality.time_equality(True, False, 'metadata_inequality') |
| | 308±5ms | 306±40ms | 0.99 | cube.CubeEquality.time_equality(True, True, 'all_equal') |
| | 204±2ms | 203±30ms | 1.00 | cube.CubeEquality.time_equality(True, True, 'coord_inequality') |
| | 336±2ms | 332±40ms | 0.99 | cube.CubeEquality.time_equality(True, True, 'data_inequality') |
| | 52.3±0.4μs | 53.6±0.7μs | 1.03 | cube.CubeEquality.time_equality(True, True, 'metadata_inequality') |
| | 805±8μs | 810±40μs | 1.01 | import_iris.Iris.time__concatenate |
| | 182±4μs | 191±10μs | 1.05 | import_iris.Iris.time__constraints |
| | 111±0.4μs | 113±0.7μs | 1.02 | import_iris.Iris.time__data_manager |
| | 88.8±0.5μs | 90.9±0.9μs | 1.02 | import_iris.Iris.time__deprecation |
| | 160±1μs | 163±3μs | 1.02 | import_iris.Iris.time__lazy_data |
| | 913±5μs | 914±30μs | 1.00 | import_iris.Iris.time__merge |
| | 72.3±0.6μs | 73.7±1μs | 1.02 | import_iris.Iris.time__representation |
| | 597±7μs | 605±10μs | 1.01 | import_iris.Iris.time_analysis |
| | 137±1μs | 139±1μs | 1.02 | import_iris.Iris.time_analysis__area_weighted |
| | 105±0.2μs | 109±2μs | 1.04 | import_iris.Iris.time_analysis__grid_angles |
| | 244±2μs | 261±8μs | 1.07 | import_iris.Iris.time_analysis__interpolation |
| | 186±1μs | 189±2μs | 1.02 | import_iris.Iris.time_analysis__regrid |
| | 108±2μs | 109±4μs | 1.01 | import_iris.Iris.time_analysis__scipy_interpolate |
| | 134±3μs | 136±1μs | 1.02 | import_iris.Iris.time_analysis_calculus |
| | 323±3μs | 322±2μs | 1.00 | import_iris.Iris.time_analysis_cartography |
| | 90.7±0.3μs | 91.8±1μs | 1.01 | import_iris.Iris.time_analysis_geomerty |
| | 209±2μs | 212±3μs | 1.01 | import_iris.Iris.time_analysis_maths |
| | 93.8±0.6μs | 94.5±0.5μs | 1.01 | import_iris.Iris.time_analysis_stats |
| | 167±0.9μs | 174±3μs | 1.04 | import_iris.Iris.time_analysis_trajectory |
| | 306±4μs | 316±30μs | 1.03 | import_iris.Iris.time_aux_factory |
| | 78.1±0.3μs | 79.5±0.8μs | 1.02 | import_iris.Iris.time_common |
| | 156±1μs | 161±3μs | 1.03 | import_iris.Iris.time_common_lenient |
| | 1.36±0.01ms | 1.37±0.09ms | 1.01 | import_iris.Iris.time_common_metadata |
| | 164±1μs | 168±10μs | 1.02 | import_iris.Iris.time_common_mixin |
| | 1.16±0ms | 1.18±0.01ms | 1.02 | import_iris.Iris.time_common_resolve |
| | 194±2μs | 200±1μs | 1.03 | import_iris.Iris.time_config |
| | 122±0.6μs | 126±1μs | 1.02 | import_iris.Iris.time_coord_categorisation |
| | 379±3μs | 383±9μs | 1.01 | import_iris.Iris.time_coord_systems |
| | 758±6μs | 769±90μs | 1.01 | import_iris.Iris.time_coords |
| | 642±5μs | 651±80μs | 1.01 | import_iris.Iris.time_cube |
| | 238±5μs | 235±7μs | 0.99 | import_iris.Iris.time_exceptions |
| | 72.7±0.2μs | 73.3±0.9μs | 1.01 | import_iris.Iris.time_experimental |
| | 180±2μs | 180±0.9μs | 1.00 | import_iris.Iris.time_fileformats |
| | 248±2μs | 255±3μs | 1.03 | import_iris.Iris.time_fileformats__ff |
| | 2.51±0.01ms | 2.54±0.3ms | 1.01 | import_iris.Iris.time_fileformats__ff_cross_references |
| | 75.1±0.2μs | 74.9±0.6μs | 1.00 | import_iris.Iris.time_fileformats__pp_lbproc_pairs |
| | 110±0.5μs | 113±3μs | 1.03 | import_iris.Iris.time_fileformats_abf |
| | 423±5μs | 429±20μs | 1.01 | import_iris.Iris.time_fileformats_cf |
| | 4.78±0.03ms | 4.78±1ms | 1.00 | import_iris.Iris.time_fileformats_dot |
| | 70.4±0.3μs | 71.2±1μs | 1.01 | import_iris.Iris.time_fileformats_name |
| | 252±2μs | 252±3μs | 1.00 | import_iris.Iris.time_fileformats_name_loaders |
| | 112±0.5μs | 114±1μs | 1.02 | import_iris.Iris.time_fileformats_netcdf |
| | 118±3μs | 124±3μs | 1.05 | import_iris.Iris.time_fileformats_nimrod |
| | 202±2μs | 205±3μs | 1.01 | import_iris.Iris.time_fileformats_nimrod_load_rules |
| | 786±3μs | 802±50μs | 1.02 | import_iris.Iris.time_fileformats_pp |
| | 177±4μs | 180±2μs | 1.01 | import_iris.Iris.time_fileformats_pp_load_rules |
| | 131±3μs | 136±2μs | 1.03 | import_iris.Iris.time_fileformats_pp_save_rules |
| | 539±5μs | 552±6μs | 1.02 | import_iris.Iris.time_fileformats_rules |
| | 217±0.9μs | 220±3μs | 1.01 | import_iris.Iris.time_fileformats_structured_array_identification |
| | 77.9±0.8μs | 79.2±0.8μs | 1.02 | import_iris.Iris.time_fileformats_um |
| | 156±4μs | 156±6μs | 1.00 | import_iris.Iris.time_fileformats_um__fast_load |
| | 134±3μs | 136±6μs | 1.01 | import_iris.Iris.time_fileformats_um__fast_load_structured_fields |
| | 70.3±0.9μs | 73.9±1μs | 1.05 | import_iris.Iris.time_fileformats_um__ff_replacement |
| | 77.4±0.3μs | 79.2±0.8μs | 1.02 | import_iris.Iris.time_fileformats_um__optimal_array_structuring |
| | 941±4μs | 943±20μs | 1.00 | import_iris.Iris.time_fileformats_um_cf_map |
| | 133±1μs | 138±4μs | 1.04 | import_iris.Iris.time_io |
| | 172±1μs | 174±7μs | 1.01 | import_iris.Iris.time_io_format_picker |
| | 204±0.9μs | 211±3μs | 1.03 | import_iris.Iris.time_iris |
| | 123±0.9μs | 125±3μs | 1.01 | import_iris.Iris.time_iterate |
| | 8.00±0.1ms | 8.20±0.2ms | 1.03 | import_iris.Iris.time_palette |
| | 1.74±0.03ms | 1.80±0.06ms | 1.03 | import_iris.Iris.time_plot |
| | 213±2μs | 218±1μs | 1.02 | import_iris.Iris.time_quickplot |
| | 2.21±0.01ms | 2.22±0.4ms | 1.00 | import_iris.Iris.time_std_names |
| | 1.79±0.02ms | 1.83±0.01ms | 1.02 | import_iris.Iris.time_symbols |
| | 85.2±0.9ms | 85.6±1ms | 1.00 | import_iris.Iris.time_tests |
| | 244±2μs | 251±2μs | 1.03 | import_iris.Iris.time_third_party_cartopy |
| | 4.96±0.02ms | 4.95±0.3ms | 1.00 | import_iris.Iris.time_third_party_cf_units |
| | 117±1μs | 116±0.5μs | 0.99 | import_iris.Iris.time_third_party_cftime |
| | 2.67±0.01ms | 2.78±0.3ms | 1.04 | import_iris.Iris.time_third_party_matplotlib |
| | 1.28±0.02ms | 1.30±0.01ms | 1.01 | import_iris.Iris.time_third_party_numpy |
| | 170±1μs | 168±2μs | 0.99 | import_iris.Iris.time_third_party_scipy |
| | 96.5±0.8μs | 100±2μs | 1.04 | import_iris.Iris.time_time |
| | 335±3μs | 341±10μs | 1.02 | import_iris.Iris.time_util |
| | 69.3±0.8μs | 70.0±0.4μs | 1.01 | iterate.IZip.time_izip |
| | 9.99±0.02ms | 9.84±0.2ms | 0.99 | load.LoadAndRealise.time_load((1280, 960, 5), False, 'FF') |
| | 14.8±0.2ms | 15.0±1ms | 1.01 | load.LoadAndRealise.time_load((1280, 960, 5), False, 'NetCDF') |
| | 10.1±0.03ms | 9.94±0.5ms | 0.98 | load.LoadAndRealise.time_load((1280, 960, 5), False, 'PP') |
| | 9.99±0.08ms | 9.89±0.4ms | 0.99 | load.LoadAndRealise.time_load((1280, 960, 5), True, 'FF') |
| | 12.6±0.1ms | 12.9±0.8ms | 1.02 | load.LoadAndRealise.time_load((1280, 960, 5), True, 'NetCDF') |
| | 10.1±0.04ms | 9.87±0.5ms | 0.97 | load.LoadAndRealise.time_load((1280, 960, 5), True, 'PP') |
| | 1.57±0.02s | 1.53±0.03s | 0.97 | load.LoadAndRealise.time_load((2, 2, 1000), False, 'FF') |
| | 11.5±0.06ms | 11.8±0.9ms | 1.03 | load.LoadAndRealise.time_load((2, 2, 1000), False, 'NetCDF') |
| | 1.60±0.02s | 1.54±0.01s | 0.97 | load.LoadAndRealise.time_load((2, 2, 1000), False, 'PP') |
| | 1.59±0.02s | 1.53±0.01s | 0.96 | load.LoadAndRealise.time_load((2, 2, 1000), True, 'FF') |
| | 11.5±0.05ms | 11.9±0.8ms | 1.03 | load.LoadAndRealise.time_load((2, 2, 1000), True, 'NetCDF') |
| | 1.59±0.01s | 1.54±0.01s | 0.97 | load.LoadAndRealise.time_load((2, 2, 1000), True, 'PP') |
| | 5.26±0.04ms | 5.14±0.05ms | 0.98 | load.LoadAndRealise.time_load((50, 50, 2), False, 'FF') |
| | 11.2±0.2ms | 11.5±0.2ms | 1.03 | load.LoadAndRealise.time_load((50, 50, 2), False, 'NetCDF') |
| | 5.20±0.02ms | 5.14±0.2ms | 0.99 | load.LoadAndRealise.time_load((50, 50, 2), False, 'PP') |
| | 5.21±0.03ms | 5.14±0.3ms | 0.99 | load.LoadAndRealise.time_load((50, 50, 2), True, 'FF') |
| | 11.2±0.06ms | 11.4±0.5ms | 1.02 | load.LoadAndRealise.time_load((50, 50, 2), True, 'NetCDF') |
| | 5.21±0.04ms | 5.13±0.07ms | 0.98 | load.LoadAndRealise.time_load((50, 50, 2), True, 'PP') |
| | 22.0±0.3ms | 23.5±3ms | 1.07 | load.LoadAndRealise.time_realise((1280, 960, 5), False, 'FF') |
| | 11.2±0.9ms | 11.7±2ms | 1.04 | load.LoadAndRealise.time_realise((1280, 960, 5), False, 'PP') |
| | 27.2±6ms | 27.3±0.8ms | 1.00 | load.LoadAndRealise.time_realise((1280, 960, 5), True, 'FF') |
| | 68.4±0.7ms | 72.2±2ms | 1.05 | load.LoadAndRealise.time_realise((1280, 960, 5), True, 'NetCDF') |
| | 26.7±0.5ms | 26.3±1ms | 0.99 | load.LoadAndRealise.time_realise((1280, 960, 5), True, 'PP') |
| | 538±2ms | 499±100ms | 0.93 | load.LoadAndRealise.time_realise((2, 2, 1000), False, 'FF') |
| | 2.70±0.07ms | 3.02±0.4ms | 1.12 | load.LoadAndRealise.time_realise((2, 2, 1000), False, 'NetCDF') |
| | 540±4ms | 495±80ms | 0.92 | load.LoadAndRealise.time_realise((2, 2, 1000), False, 'PP') |
| | 546±2ms | 540±100ms | 0.99 | load.LoadAndRealise.time_realise((2, 2, 1000), True, 'FF') |
| | 2.60±0.03ms | 3.07±0.3ms | 1.18 | load.LoadAndRealise.time_realise((2, 2, 1000), True, 'NetCDF') |
| | 548±2ms | 532±200ms | 0.97 | load.LoadAndRealise.time_realise((2, 2, 1000), True, 'PP') |
| | 1.59±0.04ms | 1.60±0.2ms | 1.00 | load.LoadAndRealise.time_realise((50, 50, 2), False, 'FF') |
| | 2.61±0.06ms | 3.03±0.5ms | 1.16 | load.LoadAndRealise.time_realise((50, 50, 2), False, 'NetCDF') |
| | 1.64±0.04ms | 1.66±0.2ms | 1.01 | load.LoadAndRealise.time_realise((50, 50, 2), False, 'PP') |
| | 1.68±0.04ms | 1.61±0.1ms | 0.96 | load.LoadAndRealise.time_realise((50, 50, 2), True, 'FF') |
| | 2.74±0.09ms | 3.01±0.4ms | 1.10 | load.LoadAndRealise.time_realise((50, 50, 2), True, 'NetCDF') |
| | 1.65±0.02ms | 1.60±0.1ms | 0.97 | load.LoadAndRealise.time_realise((50, 50, 2), True, 'PP') |
| | 346±3ms | 347±6ms | 1.00 | load.ManyCubes.time_many_cube_load |
| | 83.9±1ms | 84.3±2ms | 1.01 | load.ManyVars.time_many_var_load |
| | 10.1±0.06ms | 10.0±0.6ms | 0.99 | load.STASHConstraint.time_stash_constraint((1280, 960, 5), 'FF') |
| | 10.2±0.1ms | 10.2±0.2ms | 1.00 | load.STASHConstraint.time_stash_constraint((1280, 960, 5), 'PP') |
| | 1.58±0.01s | 1.55±0.02s | 0.98 | load.STASHConstraint.time_stash_constraint((2, 2, 1000), 'FF') |
| | 1.61±0.02s | 1.57±0.01s | 0.98 | load.STASHConstraint.time_stash_constraint((2, 2, 1000), 'PP') |
| | 5.21±0.03ms | 5.20±0.2ms | 1.00 | load.STASHConstraint.time_stash_constraint((2, 2, 2), 'FF') |
| | 5.22±0.02ms | 5.16±0.2ms | 0.99 | load.STASHConstraint.time_stash_constraint((2, 2, 2), 'PP') |
| | 9.45±0.08ms | 9.17±0.2ms | 0.97 | load.StructuredFF.time_structured_load((1280, 960, 5), False) |
| | 6.07±0.05ms | 5.88±0.4ms | 0.97 | load.StructuredFF.time_structured_load((1280, 960, 5), True) |
| | 1.54±0.01s | 1.53±0.01s | 1.00 | load.StructuredFF.time_structured_load((2, 2, 1000), False) |
| | 570±8ms | 516±5ms | 0.91 | load.StructuredFF.time_structured_load((2, 2, 1000), True) |
| | 4.39±0.02ms | 4.35±0.02ms | 0.99 | load.StructuredFF.time_structured_load((2, 2, 2), False) |
| | 4.27±0.03ms | 4.23±0.2ms | 0.99 | load.StructuredFF.time_structured_load((2, 2, 2), True) |
| | 168±0.7ms | 167±3ms | 0.99 | load.TimeConstraint.time_time_constraint(20, 'FF') |
| | 14.5±0.1ms | 14.6±1ms | 1.01 | load.TimeConstraint.time_time_constraint(20, 'NetCDF') |
| | 171±0.9ms | 170±3ms | 0.99 | load.TimeConstraint.time_time_constraint(20, 'PP') |
| | 33.2±0.1ms | 33.9±1ms | 1.02 | load.TimeConstraint.time_time_constraint(3, 'FF') |
| | 14.0±0.2ms | 14.8±1ms | 1.05 | load.TimeConstraint.time_time_constraint(3, 'NetCDF') |
| | 33.3±0.2ms | 34.1±2ms | 1.02 | load.TimeConstraint.time_time_constraint(3, 'PP') |
| | 13.3±0.3ms | 13.6±1ms | 1.02 | load.ugrid.BasicLoading.time_load_file(1) |
| | 48.4±0.9ms | 45.3±2ms | 0.94 | load.ugrid.BasicLoading.time_load_file(200000) |
| | 8.72±0.4ms | 8.72±0.8ms | 1.00 | load.ugrid.BasicLoading.time_load_mesh(1) |
| | 15.3±0.4ms | 16.0±3ms | 1.04 | load.ugrid.BasicLoading.time_load_mesh(200000) |
| | 13.4±0.1ms | 13.4±1ms | 1.00 | load.ugrid.BasicLoadingTime.time_load_file(1) |
| | 14.8±0.9ms | 14.8±1ms | 1.00 | load.ugrid.BasicLoadingTime.time_load_file(200000) |
| | 8.56±0.2ms | 8.51±0.7ms | 0.99 | load.ugrid.BasicLoadingTime.time_load_mesh(1) |
| | 11.1±0.2ms | 11.2±1ms | 1.01 | load.ugrid.BasicLoadingTime.time_load_mesh(200000) |
| | 14.2±0.3ms | 14.4±1ms | 1.01 | load.ugrid.Callback.time_load_file_callback(1) |
| | 57.9±0.7ms | 55.2±6ms | 0.95 | load.ugrid.Callback.time_load_file_callback(200000) |
| | 14.4±0.3ms | 14.7±1ms | 1.02 | load.ugrid.CallbackTime.time_load_file_callback(1) |
| | 16.5±0.5ms | 16.8±1ms | 1.02 | load.ugrid.CallbackTime.time_load_file_callback(200000) |
| | 2.56±0.2ms | 2.88±0.5ms | 1.12 | load.ugrid.DataRealisation.time_realise_data(10000) |
| | 3.67±0.5ms | 3.96±0.7ms | 1.08 | load.ugrid.DataRealisation.time_realise_data(200000) |
| | 36.5±2ms | 37.5±5ms | 1.03 | load.ugrid.DataRealisationTime.time_realise_data(10000) |
| | 782±5ms | 793±20ms | 1.01 | load.ugrid.DataRealisationTime.time_realise_data(200000) |
| | 443±8ms | 449±10ms | 1.01 | merge_concat.Concatenate.time_concatenate(False) |
| | 440±2ms | 455±10ms | 1.03 | merge_concat.Concatenate.time_concatenate(True) |
| | 109±0.3M | 110±2M | 1.00 | merge_concat.Concatenate.tracemalloc_concatenate(False) |
| | 109±0.2M | 110±2M | 1.00 | merge_concat.Concatenate.tracemalloc_concatenate(True) |
| | 49.0±0.2ms | 48.4±1ms | 0.99 | merge_concat.Merge.time_merge |
| | 2.49±1M | 2.57±0.7M | 1.03 | merge_concat.Merge.tracemalloc_merge |
| | 334±4ns | 343±3ns | 1.02 | mesh.utils.regions_combine.CombineRegionsComputeRealData.time_compute_data(50) |
| | 194±1ms | 197±2ms | 1.02 | mesh.utils.regions_combine.CombineRegionsComputeRealData.time_compute_data(500) |
| | 651±1k | 739±0.2k | 1.14 | mesh.utils.regions_combine.CombineRegionsComputeRealData.tracemalloc_compute_data(50) |
| | 60.1±0M | 60.1±0M | 1.00 | mesh.utils.regions_combine.CombineRegionsComputeRealData.tracemalloc_compute_data(500) |
| | 17.4±0.03ms | 16.6±0.4ms | 0.96 | mesh.utils.regions_combine.CombineRegionsCreateCube.time_create_combined_cube(50) |
| | 19.5±0.2ms | 20.1±0.8ms | 1.03 | mesh.utils.regions_combine.CombineRegionsCreateCube.time_create_combined_cube(500) |
| | 1.14±0M | 1.29±0.09M | 1.13 | mesh.utils.regions_combine.CombineRegionsCreateCube.tracemalloc_create_combined_cube(50) |
| | 105±2ms | 109±7ms | 1.04 | mesh.utils.regions_combine.CombineRegionsFileStreamedCalc.time_stream_file2file(50) |
| | 574±9ms | 588±20ms | 1.02 | mesh.utils.regions_combine.CombineRegionsFileStreamedCalc.time_stream_file2file(500) |
| | 1.28±0.02M | 1.35±0.06M | 1.06 | mesh.utils.regions_combine.CombineRegionsFileStreamedCalc.tracemalloc_stream_file2file(50) |
| | 96.3±0.02M | 96.4±0.06M | 1.00 | mesh.utils.regions_combine.CombineRegionsFileStreamedCalc.tracemalloc_stream_file2file(500) |
| | 65.8±2ms | 70.9±6ms | 1.08 | mesh.utils.regions_combine.CombineRegionsSaveData.time_save(50) |
| | 529±7ms | 542±10ms | 1.02 | mesh.utils.regions_combine.CombineRegionsSaveData.time_save(500) |
| | 1.19±0.01M | 1.23±0.04M | 1.04 | mesh.utils.regions_combine.CombineRegionsSaveData.tracemalloc_save(50) |
| | 96.2±0.02M | 96.3±0.04M | 1.00 | mesh.utils.regions_combine.CombineRegionsSaveData.tracemalloc_save(500) |
| | 2.1752849999999997 | 2.1752849999999997 | 1.00 | mesh.utils.regions_combine.CombineRegionsSaveData.track_filesize_saved(50) |
| | 216.01528499999998 | 216.01528499999998 | 1.00 | mesh.utils.regions_combine.CombineRegionsSaveData.track_filesize_saved(500) |
| | 6.70±0.08ms | 6.70±0.4ms | 1.00 | plot.AuxSort.time_aux_sort |
| | 76.3±4ms | 77.2±4ms | 1.01 | regridding.CurvilinearRegridding.time_regrid_pic |
| | 136±3M | 136±3M | 1.00 | regridding.CurvilinearRegridding.tracemalloc_regrid_pic |
| | 99.1±0.9ms | 107±30ms | 1.08 | regridding.HorizontalChunkedRegridding.time_regrid_area_w |
| | 49.8±0.8ms | 51.9±2ms | 1.04 | regridding.HorizontalChunkedRegridding.time_regrid_area_w_new_grid |
| | 106±0.06M | 107±0.01M | 1.00 | regridding.HorizontalChunkedRegridding.tracemalloc_regrid_area_w |
| | 147±0.02M | 147±0.04M | 1.00 | regridding.HorizontalChunkedRegridding.tracemalloc_regrid_area_w_new_grid |
| | 4.34±0.03ms | 4.47±1ms | 1.03 | save.NetcdfSave.time_netcdf_save_cube(50, False) |
| | 71.9±2ms | 72.1±10ms | 1.00 | save.NetcdfSave.time_netcdf_save_cube(50, True) |
| | 42.9±0.2ms | 43.3±2ms | 1.01 | save.NetcdfSave.time_netcdf_save_cube(600, False) |
| | 483±3ms | 487±20ms | 1.01 | save.NetcdfSave.time_netcdf_save_cube(600, True) |
| | 84.3±0.4ns | 83.2±0.5ns | 0.99 | save.NetcdfSave.time_netcdf_save_mesh(50, False) |
| | 53.7±0.4ms | 55.0±10ms | 1.02 | save.NetcdfSave.time_netcdf_save_mesh(50, True) |
| | 86.4±0.7ns | 84.3±0.3ns | 0.98 | save.NetcdfSave.time_netcdf_save_mesh(600, False) |
| | 426±3ms | 431±20ms | 1.01 | save.NetcdfSave.time_netcdf_save_mesh(600, True) |
| | 30.6±0.1k | 29.6±0.3k | 0.97 | save.NetcdfSave.tracemalloc_netcdf_save(50, False) |
| | 1.59±0.2M | 1.76±0.2M | 1.11 | save.NetcdfSave.tracemalloc_netcdf_save(50, True) |
| | 30.6±0.1k | 29.7±0.3k | 0.97 | save.NetcdfSave.tracemalloc_netcdf_save(600, False) |
| | 225±20M | 225±20M | 1.00 | save.NetcdfSave.tracemalloc_netcdf_save(600, True) |
| | 41.2±0.7ms | 39.5±4ms | 0.96 | stats.PearsonR.time_lazy |
| | 8.81±0.1ms | 9.03±0.3ms | 1.02 | stats.PearsonR.time_real |
| | 18.4±0.01M | 18.4±0.01M | 1.00 | stats.PearsonR.tracemalloc_real |
| | 20.2±0.09ms | 21.5±2ms | 1.06 | trajectory.TrajectoryInterpolation.time_trajectory_linear |
| | 65.2±0.4ms | 60.1±2ms | 0.92 | trajectory.TrajectoryInterpolation.time_trajectory_nearest |
| | 17.6±0.02M | 17.6±0.02M | 1.00 | trajectory.TrajectoryInterpolation.tracemalloc_trajectory_linear |
| | 12.1±0.01M | 7.74±0.02M | ~0.64 | trajectory.TrajectoryInterpolation.tracemalloc_trajectory_nearest |
Benchmarks that have got worse:
| Change | Before [ed45606b] <main~2> | After [ccfe4ee9] <main~1> | Ratio | Benchmark (Parameter) |
|----------|------------------------------|-----------------------------|---------|-------------------------------------------------------------------------------------------|
| + | 19.2±0.2ms | 26.8±2ms | 1.4 | load.LoadAndRealise.time_realise((1280, 960, 5), False, 'NetCDF') |
| + | 13±0M | 25±0.09M | 1.92 | mesh.utils.regions_combine.CombineRegionsCreateCube.tracemalloc_create_combined_cube(500) |
| + | 24.4±2M | 29.7±1M | 1.22 | stats.PearsonR.tracemalloc_lazy |
Generated by GHA run 13597953299
Metadata
Metadata
Assignees
Type
Projects
Status
No status