Performance version: 1.11.0 Report on Linux-5.14.0-465.el9.x86_64-x86_64-with-glibc2.34 Number of logical CPUs: 48 Start date: 2024-06-20 20:30:23.410259 End date: 2024-06-20 21:49:24.191072 +----------------------------+--------------+---------------+--------------+------------------------+ | Benchmark | results.json | results2.json | Change | Significance | +============================+==============+===============+==============+========================+ | 2to3 | 479 ms | 455 ms | 1.05x faster | Significant (t=74.69) | +----------------------------+--------------+---------------+--------------+------------------------+ | async_generators | 665 ms | 633 ms | 1.05x faster | Significant (t=38.93) | +----------------------------+--------------+---------------+--------------+------------------------+ | async_tree_cpu_io_mixed | 1.28 sec | 1.25 sec | 1.02x faster | Significant (t=3.43) | +----------------------------+--------------+---------------+--------------+------------------------+ | async_tree_cpu_io_mixed_tg | 1.17 sec | 1.14 sec | 1.03x faster | Significant (t=7.72) | +----------------------------+--------------+---------------+--------------+------------------------+ | async_tree_io | 2.00 sec | 1.96 sec | 1.02x faster | Significant (t=7.98) | +----------------------------+--------------+---------------+--------------+------------------------+ | async_tree_io_tg | 1.91 sec | 1.86 sec | 1.03x faster | Significant (t=13.62) | +----------------------------+--------------+---------------+--------------+------------------------+ | async_tree_memoization | 1.08 sec | 977 ms | 1.11x faster | Significant (t=12.23) | +----------------------------+--------------+---------------+--------------+------------------------+ | async_tree_memoization_tg | 989 ms | 957 ms | 1.03x faster | Significant (t=6.59) | +----------------------------+--------------+---------------+--------------+------------------------+ | async_tree_none | 862 ms | 825 ms | 1.04x faster | Significant (t=9.83) | +----------------------------+--------------+---------------+--------------+------------------------+ | async_tree_none_tg | 753 ms | 724 ms | 1.04x faster | Significant (t=29.02) | +----------------------------+--------------+---------------+--------------+------------------------+ | asyncio_tcp | 1.15 sec | 1.14 sec | 1.01x faster | Not significant | +----------------------------+--------------+---------------+--------------+------------------------+ | asyncio_tcp_ssl | 4.33 sec | 4.36 sec | 1.01x slower | Not significant | +----------------------------+--------------+---------------+--------------+------------------------+ | asyncio_websockets | 1.04 sec | 1.04 sec | 1.00x faster | Not significant | +----------------------------+--------------+---------------+--------------+------------------------+ | bench_mp_pool | 11.8 ms | 12.5 ms | 1.06x slower | Significant (t=-3.55) | +----------------------------+--------------+---------------+--------------+------------------------+ | bench_thread_pool | 1.78 ms | 1.75 ms | 1.02x faster | Significant (t=6.73) | +----------------------------+--------------+---------------+--------------+------------------------+ | chameleon | 13.6 ms | 12.9 ms | 1.05x faster | Significant (t=51.99) | +----------------------------+--------------+---------------+--------------+------------------------+ | chaos | 140 ms | 124 ms | 1.12x faster | Significant (t=54.41) | +----------------------------+--------------+---------------+--------------+------------------------+ | comprehensions | 44.9 us | 41.4 us | 1.08x faster | Significant (t=92.26) | +----------------------------+--------------+---------------+--------------+------------------------+ | coroutines | 50.1 ms | 48.8 ms | 1.03x faster | Significant (t=19.76) | +----------------------------+--------------+---------------+--------------+------------------------+ | coverage | 146 ms | 133 ms | 1.10x faster | Significant (t=33.12) | +----------------------------+--------------+---------------+--------------+------------------------+ | create_gc_cycles | 1.99 ms | 1.97 ms | 1.01x faster | Not significant | +----------------------------+--------------+---------------+--------------+------------------------+ | crypto_pyaes | 156 ms | 136 ms | 1.15x faster | Significant (t=135.07) | +----------------------------+--------------+---------------+--------------+------------------------+ | dask | 583 ms | 574 ms | 1.02x faster | Not significant | +----------------------------+--------------+---------------+--------------+------------------------+ | deepcopy | 705 us | 671 us | 1.05x faster | Significant (t=45.43) | +----------------------------+--------------+---------------+--------------+------------------------+ | deepcopy_memo | 80.1 us | 76.7 us | 1.04x faster | Significant (t=88.69) | +----------------------------+--------------+---------------+--------------+------------------------+ | deepcopy_reduce | 6.20 us | 5.81 us | 1.07x faster | Significant (t=48.81) | +----------------------------+--------------+---------------+--------------+------------------------+ | deltablue | 7.86 ms | 7.24 ms | 1.08x faster | Significant (t=50.58) | +----------------------------+--------------+---------------+--------------+------------------------+ | django_template | 66.6 ms | 63.3 ms | 1.05x faster | Significant (t=29.89) | +----------------------------+--------------+---------------+--------------+------------------------+ | docutils | 4.58 sec | 4.43 sec | 1.03x faster | Significant (t=13.80) | +----------------------------+--------------+---------------+--------------+------------------------+ | dulwich_log | 142 ms | 137 ms | 1.04x faster | Significant (t=12.21) | +----------------------------+--------------+---------------+--------------+------------------------+ | fannkuch | 785 ms | 713 ms | 1.10x faster | Significant (t=103.58) | +----------------------------+--------------+---------------+--------------+------------------------+ | float | 153 ms | 144 ms | 1.06x faster | Significant (t=21.88) | +----------------------------+--------------+---------------+--------------+------------------------+ | gc_traversal | 5.40 ms | 5.37 ms | 1.01x faster | Not significant | +----------------------------+--------------+---------------+--------------+------------------------+ | generators | 94.1 ms | 94.0 ms | 1.00x faster | Not significant | +----------------------------+--------------+---------------+--------------+------------------------+ | genshi_text | 46.4 ms | 42.6 ms | 1.09x faster | Significant (t=61.15) | +----------------------------+--------------+---------------+--------------+------------------------+ | genshi_xml | 105 ms | 97.3 ms | 1.08x faster | Significant (t=32.11) | +----------------------------+--------------+---------------+--------------+------------------------+ | go | 271 ms | 258 ms | 1.05x faster | Significant (t=37.64) | +----------------------------+--------------+---------------+--------------+------------------------+ | hexiom | 13.2 ms | 12.2 ms | 1.08x faster | Significant (t=38.30) | +----------------------------+--------------+---------------+--------------+------------------------+ | html5lib | 117 ms | 113 ms | 1.04x faster | Significant (t=4.60) | +----------------------------+--------------+---------------+--------------+------------------------+ | json_dumps | 22.8 ms | 22.2 ms | 1.03x faster | Significant (t=7.52) | +----------------------------+--------------+---------------+--------------+------------------------+ | json_loads | 46.3 us | 42.2 us | 1.10x faster | Significant (t=33.87) | +----------------------------+--------------+---------------+--------------+------------------------+ | logging_format | 13.3 us | 12.8 us | 1.04x faster | Significant (t=13.64) | +----------------------------+--------------+---------------+--------------+------------------------+ | logging_silent | 210 ns | 199 ns | 1.06x faster | Significant (t=35.04) | +----------------------------+--------------+---------------+--------------+------------------------+ | logging_simple | 12.1 us | 11.8 us | 1.03x faster | Significant (t=15.65) | +----------------------------+--------------+---------------+--------------+------------------------+ | mako | 20.3 ms | 19.1 ms | 1.06x faster | Significant (t=96.00) | +----------------------------+--------------+---------------+--------------+------------------------+ | mdp | 4.84 sec | 4.68 sec | 1.03x faster | Significant (t=29.40) | +----------------------------+--------------+---------------+--------------+------------------------+ | meteor_contest | 213 ms | 191 ms | 1.12x faster | Significant (t=134.37) | +----------------------------+--------------+---------------+--------------+------------------------+ | nbody | 189 ms | 185 ms | 1.03x faster | Significant (t=9.03) | +----------------------------+--------------+---------------+--------------+------------------------+ | nqueens | 175 ms | 157 ms | 1.11x faster | Significant (t=72.63) | +----------------------------+--------------+---------------+--------------+------------------------+ | pathlib | 34.3 ms | 32.5 ms | 1.06x faster | Significant (t=12.74) | +----------------------------+--------------+---------------+--------------+------------------------+ | pickle | 18.2 us | 16.5 us | 1.10x faster | Significant (t=31.12) | +----------------------------+--------------+---------------+--------------+------------------------+ | pickle_dict | 49.0 us | 45.7 us | 1.07x faster | Significant (t=55.94) | +----------------------------+--------------+---------------+--------------+------------------------+ | pickle_list | 6.41 us | 6.21 us | 1.03x faster | Significant (t=13.31) | +----------------------------+--------------+---------------+--------------+------------------------+ | pickle_pure_python | 601 us | 582 us | 1.03x faster | Significant (t=19.74) | +----------------------------+--------------+---------------+--------------+------------------------+ | pidigits | 310 ms | 311 ms | 1.00x slower | Not significant | +----------------------------+--------------+---------------+--------------+------------------------+ | pprint_pformat | 2.91 sec | 2.69 sec | 1.08x faster | Significant (t=73.35) | +----------------------------+--------------+---------------+--------------+------------------------+ | pprint_safe_repr | 1.42 sec | 1.31 sec | 1.09x faster | Significant (t=97.09) | +----------------------------+--------------+---------------+--------------+------------------------+ | pyflate | 810 ms | 757 ms | 1.07x faster | Significant (t=45.17) | +----------------------------+--------------+---------------+--------------+------------------------+ | python_startup | 15.1 ms | 14.8 ms | 1.02x faster | Significant (t=46.12) | +----------------------------+--------------+---------------+--------------+------------------------+ | python_startup_no_site | 10.5 ms | 10.3 ms | 1.02x faster | Significant (t=44.89) | +----------------------------+--------------+---------------+--------------+------------------------+ | raytrace | 601 ms | 546 ms | 1.10x faster | Significant (t=136.99) | +----------------------------+--------------+---------------+--------------+------------------------+ | regex_compile | 271 ms | 253 ms | 1.07x faster | Significant (t=30.81) | +----------------------------+--------------+---------------+--------------+------------------------+ | regex_dna | 313 ms | 302 ms | 1.03x faster | Significant (t=66.72) | +----------------------------+--------------+---------------+--------------+------------------------+ | regex_effbot | 5.24 ms | 5.12 ms | 1.02x faster | Significant (t=10.26) | +----------------------------+--------------+---------------+--------------+------------------------+ | regex_v8 | 37.4 ms | 37.5 ms | 1.00x slower | Not significant | +----------------------------+--------------+---------------+--------------+------------------------+ | richards | 94.3 ms | 89.9 ms | 1.05x faster | Significant (t=18.44) | +----------------------------+--------------+---------------+--------------+------------------------+ | richards_super | 117 ms | 110 ms | 1.06x faster | Significant (t=38.09) | +----------------------------+--------------+---------------+--------------+------------------------+ | scimark_fft | 711 ms | 619 ms | 1.15x faster | Significant (t=130.45) | +----------------------------+--------------+---------------+--------------+------------------------+ | scimark_lu | 237 ms | 215 ms | 1.10x faster | Significant (t=56.22) | +----------------------------+--------------+---------------+--------------+------------------------+ | scimark_monte_carlo | 141 ms | 132 ms | 1.07x faster | Significant (t=19.80) | +----------------------------+--------------+---------------+--------------+------------------------+ | scimark_sor | 245 ms | 227 ms | 1.08x faster | Significant (t=51.84) | +----------------------------+--------------+---------------+--------------+------------------------+ | scimark_sparse_mat_mult | 9.36 ms | 8.33 ms | 1.12x faster | Significant (t=80.95) | +----------------------------+--------------+---------------+--------------+------------------------+ | spectral_norm | 221 ms | 207 ms | 1.07x faster | Significant (t=83.39) | +----------------------------+--------------+---------------+--------------+------------------------+ | sqlalchemy_declarative | 256 ms | 248 ms | 1.03x faster | Significant (t=11.58) | +----------------------------+--------------+---------------+--------------+------------------------+ | sqlalchemy_imperative | 39.9 ms | 39.6 ms | 1.01x faster | Not significant | +----------------------------+--------------+---------------+--------------+------------------------+ | sqlglot_normalize | 219 ms | 204 ms | 1.07x faster | Significant (t=68.57) | +----------------------------+--------------+---------------+--------------+------------------------+ | sqlglot_optimize | 106 ms | 100.0 ms | 1.06x faster | Significant (t=54.23) | +----------------------------+--------------+---------------+--------------+------------------------+ | sqlglot_parse | 2.85 ms | 2.65 ms | 1.07x faster | Significant (t=19.80) | +----------------------------+--------------+---------------+--------------+------------------------+ | sqlglot_transpile | 3.36 ms | 3.14 ms | 1.07x faster | Significant (t=49.72) | +----------------------------+--------------+---------------+--------------+------------------------+ | sqlite_synth | 3.93 us | 3.89 us | 1.01x faster | Not significant | +----------------------------+--------------+---------------+--------------+------------------------+ | sympy_expand | 951 ms | 887 ms | 1.07x faster | Significant (t=35.09) | +----------------------------+--------------+---------------+--------------+------------------------+ | sympy_integrate | 39.8 ms | 38.3 ms | 1.04x faster | Significant (t=37.96) | +----------------------------+--------------+---------------+--------------+------------------------+ | sympy_str | 577 ms | 543 ms | 1.06x faster | Significant (t=31.19) | +----------------------------+--------------+---------------+--------------+------------------------+ | sympy_sum | 333 ms | 317 ms | 1.05x faster | Significant (t=23.73) | +----------------------------+--------------+---------------+--------------+------------------------+ | telco | 12.9 ms | 12.8 ms | 1.01x faster | Not significant | +----------------------------+--------------+---------------+--------------+------------------------+ | tomli_loads | 4.46 sec | 4.06 sec | 1.10x faster | Significant (t=63.27) | +----------------------------+--------------+---------------+--------------+------------------------+ | tornado_http | 218 ms | 216 ms | 1.01x faster | Not significant | +----------------------------+--------------+---------------+--------------+------------------------+ | typing_runtime_protocols | 1.06 ms | 865 us | 1.22x faster | Significant (t=140.90) | +----------------------------+--------------+---------------+--------------+------------------------+ | unpack_sequence | 86.9 ns | 85.5 ns | 1.02x faster | Not significant | +----------------------------+--------------+---------------+--------------+------------------------+ | unpickle | 25.5 us | 22.2 us | 1.15x faster | Significant (t=15.19) | +----------------------------+--------------+---------------+--------------+------------------------+ | unpickle_list | 8.70 us | 8.95 us | 1.03x slower | Significant (t=-5.08) | +----------------------------+--------------+---------------+--------------+------------------------+ | unpickle_pure_python | 485 us | 436 us | 1.11x faster | Significant (t=189.61) | +----------------------------+--------------+---------------+--------------+------------------------+ | xml_etree_generate | 160 ms | 149 ms | 1.07x faster | Significant (t=36.08) | +----------------------------+--------------+---------------+--------------+------------------------+ | xml_etree_iterparse | 204 ms | 190 ms | 1.08x faster | Significant (t=18.70) | +----------------------------+--------------+---------------+--------------+------------------------+ | xml_etree_parse | 310 ms | 288 ms | 1.08x faster | Significant (t=8.81) | +----------------------------+--------------+---------------+--------------+------------------------+ | xml_etree_process | 112 ms | 105 ms | 1.06x faster | Significant (t=39.55) | +----------------------------+--------------+---------------+--------------+------------------------+