py3.12_1.json ============= Performance version: 1.11.0 Report on Linux-5.14.0-506.el9.x86_64-x86_64-with-glibc2.34 Number of logical CPUs: 32 Start date: 2024-09-11 15:12:07.048655 End date: 2024-09-11 16:30:20.910559 py3.12_gcc_14.json ================== Performance version: 1.11.0 Report on Linux-5.14.0-506.el9.x86_64-x86_64-with-glibc2.34 Number of logical CPUs: 32 Start date: 2024-09-11 16:51:09.824542 End date: 2024-09-11 18:09:44.365883 +----------------------------------+---------------+--------------------+--------------+-------------------------+ | Benchmark | py3.12_1.json | py3.12_gcc_14.json | Change | Significance | +==================================+===============+====================+==============+=========================+ | 2to3 | 424 ms | 426 ms | 1.01x slower | Not significant | +----------------------------------+---------------+--------------------+--------------+-------------------------+ | async_generators | 765 ms | 767 ms | 1.00x slower | Not significant | +----------------------------------+---------------+--------------------+--------------+-------------------------+ | async_tree_cpu_io_mixed | 1.07 sec | 1.10 sec | 1.03x slower | Significant (t=-7.37) | +----------------------------------+---------------+--------------------+--------------+-------------------------+ | async_tree_cpu_io_mixed_tg | 1.03 sec | 1.07 sec | 1.04x slower | Significant (t=-9.97) | +----------------------------------+---------------+--------------------+--------------+-------------------------+ | async_tree_eager | 182 ms | 180 ms | 1.01x faster | Not significant | +----------------------------------+---------------+--------------------+--------------+-------------------------+ | async_tree_eager_cpu_io_mixed | 612 ms | 653 ms | 1.07x slower | Significant (t=-16.25) | +----------------------------------+---------------+--------------------+--------------+-------------------------+ | async_tree_eager_cpu_io_mixed_tg | 532 ms | 564 ms | 1.06x slower | Significant (t=-11.05) | +----------------------------------+---------------+--------------------+--------------+-------------------------+ | async_tree_eager_io | 1.73 sec | 1.73 sec | 1.00x faster | Not significant | +----------------------------------+---------------+--------------------+--------------+-------------------------+ | async_tree_eager_io_tg | 1.70 sec | 1.70 sec | 1.00x slower | Not significant | +----------------------------------+---------------+--------------------+--------------+-------------------------+ | async_tree_eager_memoization | 390 ms | 390 ms | 1.00x faster | Not significant | +----------------------------------+---------------+--------------------+--------------+-------------------------+ | async_tree_eager_memoization_tg | 297 ms | 289 ms | 1.03x faster | Significant (t=4.44) | +----------------------------------+---------------+--------------------+--------------+-------------------------+ | async_tree_eager_tg | 125 ms | 123 ms | 1.01x faster | Not significant | +----------------------------------+---------------+--------------------+--------------+-------------------------+ | async_tree_io | 1.59 sec | 1.60 sec | 1.01x slower | Not significant | +----------------------------------+---------------+--------------------+--------------+-------------------------+ | async_tree_io_tg | 1.58 sec | 1.58 sec | 1.00x faster | Not significant | +----------------------------------+---------------+--------------------+--------------+-------------------------+ | async_tree_memoization | 870 ms | 864 ms | 1.01x faster | Not significant | +----------------------------------+---------------+--------------------+--------------+-------------------------+ | async_tree_memoization_tg | 793 ms | 788 ms | 1.01x faster | Not significant | +----------------------------------+---------------+--------------------+--------------+-------------------------+ | async_tree_none | 695 ms | 698 ms | 1.00x slower | Not significant | +----------------------------------+---------------+--------------------+--------------+-------------------------+ | async_tree_none_tg | 631 ms | 629 ms | 1.00x faster | Not significant | +----------------------------------+---------------+--------------------+--------------+-------------------------+ | asyncio_tcp | 620 ms | 620 ms | 1.00x faster | Not significant | +----------------------------------+---------------+--------------------+--------------+-------------------------+ | asyncio_tcp_ssl | 2.64 sec | 2.65 sec | 1.00x slower | Not significant | +----------------------------------+---------------+--------------------+--------------+-------------------------+ | asyncio_websockets | 922 ms | 920 ms | 1.00x faster | Not significant | +----------------------------------+---------------+--------------------+--------------+-------------------------+ | bench_mp_pool | 10.8 ms | 9.80 ms | 1.10x faster | Significant (t=9.45) | +----------------------------------+---------------+--------------------+--------------+-------------------------+ | bench_thread_pool | 1.54 ms | 1.54 ms | 1.00x slower | Not significant | +----------------------------------+---------------+--------------------+--------------+-------------------------+ | chameleon | 11.7 ms | 11.6 ms | 1.01x faster | Not significant | +----------------------------------+---------------+--------------------+--------------+-------------------------+ | chaos | 104 ms | 105 ms | 1.01x slower | Not significant | +----------------------------------+---------------+--------------------+--------------+-------------------------+ | comprehensions | 35.4 us | 34.9 us | 1.02x faster | Not significant | +----------------------------------+---------------+--------------------+--------------+-------------------------+ | coroutines | 40.1 ms | 41.0 ms | 1.02x slower | Significant (t=-7.97) | +----------------------------------+---------------+--------------------+--------------+-------------------------+ | coverage | 125 ms | 125 ms | 1.00x faster | Not significant | +----------------------------------+---------------+--------------------+--------------+-------------------------+ | create_gc_cycles | 1.69 ms | 1.68 ms | 1.00x faster | Not significant | +----------------------------------+---------------+--------------------+--------------+-------------------------+ | crypto_pyaes | 128 ms | 126 ms | 1.02x faster | Not significant | +----------------------------------+---------------+--------------------+--------------+-------------------------+ | dask | 517 ms | 519 ms | 1.00x slower | Not significant | +----------------------------------+---------------+--------------------+--------------+-------------------------+ | deepcopy | 594 us | 598 us | 1.01x slower | Not significant | +----------------------------------+---------------+--------------------+--------------+-------------------------+ | deepcopy_memo | 65.6 us | 65.3 us | 1.00x faster | Not significant | +----------------------------------+---------------+--------------------+--------------+-------------------------+ | deepcopy_reduce | 5.32 us | 5.30 us | 1.00x faster | Not significant | +----------------------------------+---------------+--------------------+--------------+-------------------------+ | deltablue | 5.21 ms | 5.35 ms | 1.03x slower | Significant (t=-7.17) | +----------------------------------+---------------+--------------------+--------------+-------------------------+ | django_template | 58.9 ms | 60.7 ms | 1.03x slower | Significant (t=-17.21) | +----------------------------------+---------------+--------------------+--------------+-------------------------+ | docutils | 4.23 sec | 4.17 sec | 1.02x faster | Not significant | +----------------------------------+---------------+--------------------+--------------+-------------------------+ | dulwich_log | 125 ms | 126 ms | 1.01x slower | Not significant | +----------------------------------+---------------+--------------------+--------------+-------------------------+ | fannkuch | 639 ms | 652 ms | 1.02x slower | Not significant | +----------------------------------+---------------+--------------------+--------------+-------------------------+ | float | 132 ms | 133 ms | 1.01x slower | Not significant | +----------------------------------+---------------+--------------------+--------------+-------------------------+ | gc_traversal | 4.55 ms | 4.70 ms | 1.03x slower | Significant (t=-37.77) | +----------------------------------+---------------+--------------------+--------------+-------------------------+ | generators | 46.5 ms | 49.8 ms | 1.07x slower | Significant (t=-54.32) | +----------------------------------+---------------+--------------------+--------------+-------------------------+ | genshi_text | 37.8 ms | 38.0 ms | 1.01x slower | Not significant | +----------------------------------+---------------+--------------------+--------------+-------------------------+ | genshi_xml | 83.9 ms | 84.9 ms | 1.01x slower | Not significant | +----------------------------------+---------------+--------------------+--------------+-------------------------+ | go | 211 ms | 216 ms | 1.02x slower | Significant (t=-19.90) | +----------------------------------+---------------+--------------------+--------------+-------------------------+ | hexiom | 9.41 ms | 9.69 ms | 1.03x slower | Significant (t=-18.30) | +----------------------------------+---------------+--------------------+--------------+-------------------------+ | html5lib | 94.9 ms | 96.1 ms | 1.01x slower | Not significant | +----------------------------------+---------------+--------------------+--------------+-------------------------+ | json_dumps | 17.3 ms | 16.8 ms | 1.03x faster | Significant (t=8.03) | +----------------------------------+---------------+--------------------+--------------+-------------------------+ | json_loads | 43.0 us | 41.7 us | 1.03x faster | Significant (t=19.90) | +----------------------------------+---------------+--------------------+--------------+-------------------------+ | logging_format | 11.4 us | 11.3 us | 1.01x faster | Not significant | +----------------------------------+---------------+--------------------+--------------+-------------------------+ | logging_silent | 172 ns | 174 ns | 1.01x slower | Not significant | +----------------------------------+---------------+--------------------+--------------+-------------------------+ | logging_simple | 10.4 us | 10.3 us | 1.01x faster | Not significant | +----------------------------------+---------------+--------------------+--------------+-------------------------+ | mako | 16.9 ms | 17.3 ms | 1.02x slower | Not significant | +----------------------------------+---------------+--------------------+--------------+-------------------------+ | mdp | 4.23 sec | 4.15 sec | 1.02x faster | Not significant | +----------------------------------+---------------+--------------------+--------------+-------------------------+ | meteor_contest | 169 ms | 160 ms | 1.05x faster | Significant (t=15.95) | +----------------------------------+---------------+--------------------+--------------+-------------------------+ | nbody | 170 ms | 166 ms | 1.02x faster | Not significant | +----------------------------------+---------------+--------------------+--------------+-------------------------+ | nqueens | 140 ms | 143 ms | 1.02x slower | Significant (t=-16.66) | +----------------------------------+---------------+--------------------+--------------+-------------------------+ | pathlib | 29.8 ms | 29.8 ms | 1.00x faster | Not significant | +----------------------------------+---------------+--------------------+--------------+-------------------------+ | pickle | 15.7 us | 16.5 us | 1.06x slower | Significant (t=-9.21) | +----------------------------------+---------------+--------------------+--------------+-------------------------+ | pickle_dict | 43.1 us | 43.5 us | 1.01x slower | Not significant | +----------------------------------+---------------+--------------------+--------------+-------------------------+ | pickle_list | 6.46 us | 6.73 us | 1.04x slower | Significant (t=-26.64) | +----------------------------------+---------------+--------------------+--------------+-------------------------+ | pickle_pure_python | 490 us | 489 us | 1.00x faster | Not significant | +----------------------------------+---------------+--------------------+--------------+-------------------------+ | pidigits | 275 ms | 284 ms | 1.03x slower | Significant (t=-122.76) | +----------------------------------+---------------+--------------------+--------------+-------------------------+ | pprint_pformat | 2.54 sec | 2.54 sec | 1.00x faster | Not significant | +----------------------------------+---------------+--------------------+--------------+-------------------------+ | pprint_safe_repr | 1.25 sec | 1.25 sec | 1.00x faster | Not significant | +----------------------------------+---------------+--------------------+--------------+-------------------------+ | pyflate | 674 ms | 685 ms | 1.02x slower | Not significant | +----------------------------------+---------------+--------------------+--------------+-------------------------+ | python_startup | 14.6 ms | 14.5 ms | 1.01x faster | Not significant | +----------------------------------+---------------+--------------------+--------------+-------------------------+ | python_startup_no_site | 10.1 ms | 10.1 ms | 1.00x faster | Not significant | +----------------------------------+---------------+--------------------+--------------+-------------------------+ | raytrace | 501 ms | 513 ms | 1.02x slower | Significant (t=-18.12) | +----------------------------------+---------------+--------------------+--------------+-------------------------+ | regex_compile | 244 ms | 236 ms | 1.04x faster | Significant (t=12.05) | +----------------------------------+---------------+--------------------+--------------+-------------------------+ | regex_dna | 283 ms | 249 ms | 1.13x faster | Significant (t=102.19) | +----------------------------------+---------------+--------------------+--------------+-------------------------+ | regex_effbot | 5.16 ms | 4.91 ms | 1.05x faster | Significant (t=18.28) | +----------------------------------+---------------+--------------------+--------------+-------------------------+ | regex_v8 | 34.9 ms | 33.1 ms | 1.05x faster | Significant (t=43.43) | +----------------------------------+---------------+--------------------+--------------+-------------------------+ | richards | 68.6 ms | 70.7 ms | 1.03x slower | Significant (t=-6.16) | +----------------------------------+---------------+--------------------+--------------+-------------------------+ | richards_super | 77.8 ms | 78.4 ms | 1.01x slower | Not significant | +----------------------------------+---------------+--------------------+--------------+-------------------------+ | scimark_fft | 596 ms | 589 ms | 1.01x faster | Not significant | +----------------------------------+---------------+--------------------+--------------+-------------------------+ | scimark_lu | 189 ms | 187 ms | 1.01x faster | Not significant | +----------------------------------+---------------+--------------------+--------------+-------------------------+ | scimark_monte_carlo | 122 ms | 116 ms | 1.05x faster | Significant (t=5.53) | +----------------------------------+---------------+--------------------+--------------+-------------------------+ | scimark_sor | 209 ms | 207 ms | 1.01x faster | Not significant | +----------------------------------+---------------+--------------------+--------------+-------------------------+ | scimark_sparse_mat_mult | 7.49 ms | 7.30 ms | 1.03x faster | Significant (t=6.68) | +----------------------------------+---------------+--------------------+--------------+-------------------------+ | spectral_norm | 176 ms | 176 ms | 1.01x slower | Not significant | +----------------------------------+---------------+--------------------+--------------+-------------------------+ | sqlalchemy_declarative | 227 ms | 230 ms | 1.01x slower | Not significant | +----------------------------------+---------------+--------------------+--------------+-------------------------+ | sqlalchemy_imperative | 35.0 ms | 35.8 ms | 1.02x slower | Significant (t=-2.18) | +----------------------------------+---------------+--------------------+--------------+-------------------------+ | sqlglot_normalize | 188 ms | 185 ms | 1.02x faster | Not significant | +----------------------------------+---------------+--------------------+--------------+-------------------------+ | sqlglot_optimize | 92.6 ms | 92.2 ms | 1.00x faster | Not significant | +----------------------------------+---------------+--------------------+--------------+-------------------------+ | sqlglot_parse | 2.09 ms | 2.15 ms | 1.03x slower | Significant (t=-9.74) | +----------------------------------+---------------+--------------------+--------------+-------------------------+ | sqlglot_transpile | 2.58 ms | 2.62 ms | 1.01x slower | Not significant | +----------------------------------+---------------+--------------------+--------------+-------------------------+ | sqlite_synth | 4.22 us | 4.21 us | 1.00x faster | Not significant | +----------------------------------+---------------+--------------------+--------------+-------------------------+ | sympy_expand | 790 ms | 795 ms | 1.01x slower | Not significant | +----------------------------------+---------------+--------------------+--------------+-------------------------+ | sympy_integrate | 33.1 ms | 33.3 ms | 1.00x slower | Not significant | +----------------------------------+---------------+--------------------+--------------+-------------------------+ | sympy_str | 484 ms | 486 ms | 1.00x slower | Not significant | +----------------------------------+---------------+--------------------+--------------+-------------------------+ | sympy_sum | 272 ms | 277 ms | 1.02x slower | Not significant | +----------------------------------+---------------+--------------------+--------------+-------------------------+ | telco | 12.6 ms | 12.5 ms | 1.01x faster | Not significant | +----------------------------------+---------------+--------------------+--------------+-------------------------+ | tomli_loads | 3.41 sec | 3.41 sec | 1.00x faster | Not significant | +----------------------------------+---------------+--------------------+--------------+-------------------------+ | tornado_http | 184 ms | 185 ms | 1.00x slower | Not significant | +----------------------------------+---------------+--------------------+--------------+-------------------------+ | typing_runtime_protocols | 289 us | 284 us | 1.02x faster | Not significant | +----------------------------------+---------------+--------------------+--------------+-------------------------+ | unpack_sequence | 63.5 ns | 60.1 ns | 1.06x faster | Significant (t=6.03) | +----------------------------------+---------------+--------------------+--------------+-------------------------+ | unpickle | 23.6 us | 23.0 us | 1.03x faster | Significant (t=2.11) | +----------------------------------+---------------+--------------------+--------------+-------------------------+ | unpickle_list | 8.42 us | 8.34 us | 1.01x faster | Not significant | +----------------------------------+---------------+--------------------+--------------+-------------------------+ | unpickle_pure_python | 365 us | 348 us | 1.05x faster | Significant (t=14.60) | +----------------------------------+---------------+--------------------+--------------+-------------------------+ | xml_etree_generate | 149 ms | 148 ms | 1.00x faster | Not significant | +----------------------------------+---------------+--------------------+--------------+-------------------------+ | xml_etree_iterparse | 179 ms | 179 ms | 1.00x slower | Not significant | +----------------------------------+---------------+--------------------+--------------+-------------------------+ | xml_etree_parse | 265 ms | 260 ms | 1.02x faster | Not significant | +----------------------------------+---------------+--------------------+--------------+-------------------------+ | xml_etree_process | 99.7 ms | 101 ms | 1.01x slower | Not significant | +----------------------------------+---------------+--------------------+--------------+-------------------------+