- fork: python
- ref: 86c1a60d5a28cfb51f88
- machine: linux-x86_64
- commit hash: 86c1a60
- commit date: 2025-01-22
- overall geometric mean: 1.010x faster
- HPT reliability: 96.17%
- HPT 99th percentile: 1.00x faster
- Memory change: 1.12x
| Benchmark | bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20250122-linux-x86_64-python-86c1a60d5a28cfb51f88-3.14.0a4+-86c1a60 |
|---|---|---|
| 2to3 | 445 ms | 503 ms: 1.13x slower |
| docutils | 4.01 sec | 3.76 sec: 1.07x faster |
| Geometric mean | (ref) | 1.01x slower |
Benchmark hidden because not significant (1): html5lib
| Benchmark | bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20250122-linux-x86_64-python-86c1a60d5a28cfb51f88-3.14.0a4+-86c1a60 |
|---|---|---|
| async_tree_io | 1.39 sec | 933 ms: 1.49x faster |
| async_tree_io_tg | 1.40 sec | 988 ms: 1.42x faster |
| async_tree_none | 572 ms | 414 ms: 1.38x faster |
| async_tree_memoization_tg | 670 ms | 511 ms: 1.31x faster |
| async_tree_cpu_io_mixed_tg | 852 ms | 665 ms: 1.28x faster |
| async_tree_none_tg | 504 ms | 401 ms: 1.26x faster |
| async_tree_memoization | 709 ms | 572 ms: 1.24x faster |
| async_tree_cpu_io_mixed | 889 ms | 758 ms: 1.17x faster |
| coroutines | 30.9 ms | 36.3 ms: 1.18x slower |
| Geometric mean | (ref) | 1.20x faster |
Benchmark hidden because not significant (2): asyncio_websockets, async_generators
| Benchmark | bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20250122-linux-x86_64-python-86c1a60d5a28cfb51f88-3.14.0a4+-86c1a60 |
|---|---|---|
| nbody | 119 ms | 128 ms: 1.08x slower |
| Geometric mean | (ref) | 1.02x slower |
Benchmark hidden because not significant (2): float, pidigits
Benchmark hidden because not significant (4): regex_compile, regex_v8, regex_dna, regex_effbot
| Benchmark | bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20250122-linux-x86_64-python-86c1a60d5a28cfb51f88-3.14.0a4+-86c1a60 |
|---|---|---|
| xml_etree_parse | 231 ms | 205 ms: 1.13x faster |
| xml_etree_iterparse | 177 ms | 159 ms: 1.11x faster |
| tomli_loads | 2.78 sec | 2.65 sec: 1.05x faster |
| unpickle_pure_python | 290 us | 313 us: 1.08x slower |
| pickle_pure_python | 416 us | 449 us: 1.08x slower |
| xml_etree_generate | 122 ms | 140 ms: 1.14x slower |
| json_dumps | 14.1 ms | 16.8 ms: 1.19x slower |
| json_loads | 34.3 us | 47.9 us: 1.40x slower |
| Geometric mean | (ref) | 1.06x slower |
Benchmark hidden because not significant (1): xml_etree_process
| Benchmark | bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20250122-linux-x86_64-python-86c1a60d5a28cfb51f88-3.14.0a4+-86c1a60 |
|---|---|---|
| python_startup_no_site | 15.3 ms | 17.6 ms: 1.15x slower |
| python_startup | 22.4 ms | 29.7 ms: 1.33x slower |
| Geometric mean | (ref) | 1.24x slower |
| Benchmark | bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20250122-linux-x86_64-python-86c1a60d5a28cfb51f88-3.14.0a4+-86c1a60 |
|---|---|---|
| mako | 15.9 ms | 16.9 ms: 1.06x slower |
| django_template | 44.3 ms | 48.8 ms: 1.10x slower |
| Geometric mean | (ref) | 1.06x slower |
Benchmark hidden because not significant (2): genshi_text, genshi_xml
| Benchmark | bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20250122-linux-x86_64-python-86c1a60d5a28cfb51f88-3.14.0a4+-86c1a60 |
|---|---|---|
| async_tree_io | 1.39 sec | 933 ms: 1.49x faster |
| deepcopy | 498 us | 347 us: 1.43x faster |
| async_tree_io_tg | 1.40 sec | 988 ms: 1.42x faster |
| async_tree_none | 572 ms | 414 ms: 1.38x faster |
| async_tree_memoization_tg | 670 ms | 511 ms: 1.31x faster |
| async_tree_cpu_io_mixed_tg | 852 ms | 665 ms: 1.28x faster |
| async_tree_none_tg | 504 ms | 401 ms: 1.26x faster |
| async_tree_memoization | 709 ms | 572 ms: 1.24x faster |
| scimark_sor | 179 ms | 148 ms: 1.21x faster |
| go | 191 ms | 160 ms: 1.19x faster |
| async_tree_cpu_io_mixed | 889 ms | 758 ms: 1.17x faster |
| richards | 65.5 ms | 56.9 ms: 1.15x faster |
| thrift | 1.10 ms | 959 us: 1.15x faster |
| pylint | 470 ms | 411 ms: 1.14x faster |
| xml_etree_parse | 231 ms | 205 ms: 1.13x faster |
| deepcopy_memo | 50.1 us | 44.5 us: 1.13x faster |
| pprint_safe_repr | 987 ms | 880 ms: 1.12x faster |
| xml_etree_iterparse | 177 ms | 159 ms: 1.11x faster |
| spectral_norm | 157 ms | 141 ms: 1.11x faster |
| scimark_fft | 473 ms | 430 ms: 1.10x faster |
| bpe_tokeniser | 6.28 sec | 5.71 sec: 1.10x faster |
| pprint_pformat | 1.94 sec | 1.77 sec: 1.10x faster |
| deepcopy_reduce | 4.10 us | 3.77 us: 1.09x faster |
| fannkuch | 547 ms | 504 ms: 1.08x faster |
| docutils | 4.01 sec | 3.76 sec: 1.07x faster |
| telco | 12.2 ms | 11.6 ms: 1.05x faster |
| tomli_loads | 2.78 sec | 2.65 sec: 1.05x faster |
| mdp | 3.80 sec | 3.66 sec: 1.04x faster |
| raytrace | 344 ms | 355 ms: 1.03x slower |
| pycparser | 1.57 sec | 1.63 sec: 1.03x slower |
| generators | 40.0 ms | 41.5 ms: 1.04x slower |
| deltablue | 4.44 ms | 4.70 ms: 1.06x slower |
| mako | 15.9 ms | 16.9 ms: 1.06x slower |
| richards_super | 73.2 ms | 78.2 ms: 1.07x slower |
| sympy_expand | 601 ms | 645 ms: 1.07x slower |
| unpickle_pure_python | 290 us | 313 us: 1.08x slower |
| nbody | 119 ms | 128 ms: 1.08x slower |
| pyflate | 664 ms | 716 ms: 1.08x slower |
| pickle_pure_python | 416 us | 449 us: 1.08x slower |
| django_template | 44.3 ms | 48.8 ms: 1.10x slower |
| sqlglot_normalize | 140 ms | 156 ms: 1.12x slower |
| logging_silent | 130 ns | 146 ns: 1.12x slower |
| 2to3 | 445 ms | 503 ms: 1.13x slower |
| xml_etree_generate | 122 ms | 140 ms: 1.14x slower |
| coverage | 107 ms | 123 ms: 1.15x slower |
| json | 6.51 ms | 7.48 ms: 1.15x slower |
| python_startup_no_site | 15.3 ms | 17.6 ms: 1.15x slower |
| hexiom | 8.11 ms | 9.37 ms: 1.15x slower |
| logging_simple | 8.56 us | 9.96 us: 1.16x slower |
| coroutines | 30.9 ms | 36.3 ms: 1.18x slower |
| json_dumps | 14.1 ms | 16.8 ms: 1.19x slower |
| logging_format | 9.24 us | 11.3 us: 1.22x slower |
| dulwich_log | 93.7 ms | 118 ms: 1.25x slower |
| bench_thread_pool | 2.89 ms | 3.70 ms: 1.28x slower |
| python_startup | 22.4 ms | 29.7 ms: 1.33x slower |
| json_loads | 34.3 us | 47.9 us: 1.40x slower |
| create_gc_cycles | 2.41 ms | 4.24 ms: 1.76x slower |
| gc_traversal | 5.70 ms | 10.9 ms: 1.92x slower |
| bench_mp_pool | 18.7 ms | 105 ms: 5.61x slower |
| Geometric mean | (ref) | 1.03x slower |
Benchmark hidden because not significant (29): nqueens, chaos, html5lib, pathlib, regex_compile, xml_etree_process, sqlglot_transpile, scimark_sparse_mat_mult, float, scimark_monte_carlo, pidigits, regex_v8, asyncio_websockets, comprehensions, regex_dna, sympy_sum, crypto_pyaes, sympy_integrate, async_generators, scimark_lu, sqlglot_parse, meteor_contest, sqlglot_optimize, genshi_text, sqlite_synth, regex_effbot, genshi_xml, sympy_str, typing_runtime_protocols Ignored benchmarks (14) of results/bm-20240906-3.13.0rc2-ec61006/bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006.json: aiohttp, asyncio_tcp, asyncio_tcp_ssl, chameleon, dask, flaskblogging, gunicorn, pickle, pickle_dict, pickle_list, tornado_http, unpack_sequence, unpickle, unpickle_list Ignored benchmarks (8) of results/bm-20250122-3.14.0a4+-86c1a60/bm-20250122-linux-x86_64-python-86c1a60d5a28cfb51f88-3.14.0a4+-86c1a60.json: connected_components, k_core, many_optionals, shortest_path, sphinx, sqlalchemy_declarative, sqlalchemy_imperative, subparsers
- Geometric mean (including insignificant results): 1.010x faster
- Reliability score: 96.17% likely to be faster
- 90% likely to have a speedup of 1.00x
- 95% likely to have a speedup of 1.00x
- 99% likely to have a speedup of 1.00x
- memory change: 1.12x