Performance version: 1.11.0 Report on Linux-5.14.0-465.el9.aarch64-aarch64-with-glibc2.34 Number of logical CPUs: 128 Start date: 2024-06-20 20:27:59.949389 End date: 2024-06-20 21:40:36.242251 +----------------------------+--------------+---------------+--------------+------------------------+ | Benchmark | results.json | results2.json | Change | Significance | +============================+==============+===============+==============+========================+ | 2to3 | 330 ms | 318 ms | 1.04x faster | Significant (t=15.78) | +----------------------------+--------------+---------------+--------------+------------------------+ | async_generators | 414 ms | 395 ms | 1.05x faster | Significant (t=31.34) | +----------------------------+--------------+---------------+--------------+------------------------+ | async_tree_cpu_io_mixed | 1.14 sec | 1.12 sec | 1.02x faster | Not significant | +----------------------------+--------------+---------------+--------------+------------------------+ | async_tree_cpu_io_mixed_tg | 1.01 sec | 985 ms | 1.03x faster | Significant (t=6.67) | +----------------------------+--------------+---------------+--------------+------------------------+ | async_tree_io | 1.80 sec | 1.76 sec | 1.02x faster | Significant (t=4.82) | +----------------------------+--------------+---------------+--------------+------------------------+ | async_tree_io_tg | 1.64 sec | 1.60 sec | 1.02x faster | Significant (t=5.67) | +----------------------------+--------------+---------------+--------------+------------------------+ | async_tree_memoization | 1.02 sec | 937 ms | 1.09x faster | Significant (t=5.90) | +----------------------------+--------------+---------------+--------------+------------------------+ | async_tree_memoization_tg | 913 ms | 892 ms | 1.02x faster | Significant (t=3.45) | +----------------------------+--------------+---------------+--------------+------------------------+ | async_tree_none | 779 ms | 765 ms | 1.02x faster | Not significant | +----------------------------+--------------+---------------+--------------+------------------------+ | async_tree_none_tg | 686 ms | 675 ms | 1.02x faster | Not significant | +----------------------------+--------------+---------------+--------------+------------------------+ | asyncio_tcp | 764 ms | 753 ms | 1.02x faster | Not significant | +----------------------------+--------------+---------------+--------------+------------------------+ | asyncio_tcp_ssl | 2.61 sec | 2.61 sec | 1.00x slower | Not significant | +----------------------------+--------------+---------------+--------------+------------------------+ | asyncio_websockets | 805 ms | 798 ms | 1.01x faster | Not significant | +----------------------------+--------------+---------------+--------------+------------------------+ | bench_mp_pool | 9.31 ms | 9.11 ms | 1.02x faster | Significant (t=2.32) | +----------------------------+--------------+---------------+--------------+------------------------+ | bench_thread_pool | 1.99 ms | 1.98 ms | 1.00x faster | Not significant | +----------------------------+--------------+---------------+--------------+------------------------+ | chameleon | 9.42 ms | 8.75 ms | 1.08x faster | Significant (t=47.63) | +----------------------------+--------------+---------------+--------------+------------------------+ | chaos | 91.3 ms | 84.4 ms | 1.08x faster | Significant (t=131.09) | +----------------------------+--------------+---------------+--------------+------------------------+ | comprehensions | 30.9 us | 29.5 us | 1.05x faster | Significant (t=52.38) | +----------------------------+--------------+---------------+--------------+------------------------+ | coroutines | 37.8 ms | 36.5 ms | 1.04x faster | Significant (t=78.02) | +----------------------------+--------------+---------------+--------------+------------------------+ | coverage | 91.9 ms | 87.5 ms | 1.05x faster | Significant (t=27.52) | +----------------------------+--------------+---------------+--------------+------------------------+ | create_gc_cycles | 1.93 ms | 1.92 ms | 1.01x faster | Not significant | +----------------------------+--------------+---------------+--------------+------------------------+ | crypto_pyaes | 102 ms | 93.9 ms | 1.09x faster | Significant (t=93.43) | +----------------------------+--------------+---------------+--------------+------------------------+ | dask | 459 ms | 446 ms | 1.03x faster | Significant (t=5.77) | +----------------------------+--------------+---------------+--------------+------------------------+ | deepcopy | 464 us | 452 us | 1.03x faster | Significant (t=28.07) | +----------------------------+--------------+---------------+--------------+------------------------+ | deepcopy_memo | 52.3 us | 50.8 us | 1.03x faster | Significant (t=64.00) | +----------------------------+--------------+---------------+--------------+------------------------+ | deepcopy_reduce | 4.29 us | 4.15 us | 1.03x faster | Significant (t=35.66) | +----------------------------+--------------+---------------+--------------+------------------------+ | deltablue | 5.45 ms | 5.13 ms | 1.06x faster | Significant (t=54.11) | +----------------------------+--------------+---------------+--------------+------------------------+ | django_template | 46.0 ms | 44.1 ms | 1.04x faster | Significant (t=42.92) | +----------------------------+--------------+---------------+--------------+------------------------+ | docutils | 3.17 sec | 3.10 sec | 1.02x faster | Significant (t=5.38) | +----------------------------+--------------+---------------+--------------+------------------------+ | dulwich_log | 65.8 ms | 63.5 ms | 1.04x faster | Significant (t=15.35) | +----------------------------+--------------+---------------+--------------+------------------------+ | fannkuch | 523 ms | 488 ms | 1.07x faster | Significant (t=136.04) | +----------------------------+--------------+---------------+--------------+------------------------+ | float | 107 ms | 102 ms | 1.05x faster | Significant (t=37.75) | +----------------------------+--------------+---------------+--------------+------------------------+ | gc_traversal | 4.38 ms | 4.37 ms | 1.00x faster | Not significant | +----------------------------+--------------+---------------+--------------+------------------------+ | generators | 67.8 ms | 67.5 ms | 1.00x faster | Not significant | +----------------------------+--------------+---------------+--------------+------------------------+ | genshi_text | 31.6 ms | 30.2 ms | 1.05x faster | Significant (t=46.71) | +----------------------------+--------------+---------------+--------------+------------------------+ | genshi_xml | 69.7 ms | 65.6 ms | 1.06x faster | Significant (t=29.15) | +----------------------------+--------------+---------------+--------------+------------------------+ | go | 180 ms | 175 ms | 1.03x faster | Significant (t=23.95) | +----------------------------+--------------+---------------+--------------+------------------------+ | hexiom | 8.69 ms | 8.05 ms | 1.08x faster | Significant (t=233.72) | +----------------------------+--------------+---------------+--------------+------------------------+ | html5lib | 69.3 ms | 67.9 ms | 1.02x faster | Significant (t=2.05) | +----------------------------+--------------+---------------+--------------+------------------------+ | json_dumps | 16.5 ms | 15.6 ms | 1.06x faster | Significant (t=29.55) | +----------------------------+--------------+---------------+--------------+------------------------+ | json_loads | 32.3 us | 30.4 us | 1.06x faster | Significant (t=54.64) | +----------------------------+--------------+---------------+--------------+------------------------+ | logging_format | 9.14 us | 8.78 us | 1.04x faster | Significant (t=34.25) | +----------------------------+--------------+---------------+--------------+------------------------+ | logging_silent | 150 ns | 148 ns | 1.01x faster | Not significant | +----------------------------+--------------+---------------+--------------+------------------------+ | logging_simple | 8.38 us | 8.04 us | 1.04x faster | Significant (t=44.98) | +----------------------------+--------------+---------------+--------------+------------------------+ | mako | 14.7 ms | 14.0 ms | 1.05x faster | Significant (t=64.27) | +----------------------------+--------------+---------------+--------------+------------------------+ | mdp | 3.70 sec | 3.46 sec | 1.07x faster | Significant (t=34.08) | +----------------------------+--------------+---------------+--------------+------------------------+ | meteor_contest | 132 ms | 119 ms | 1.11x faster | Significant (t=105.84) | +----------------------------+--------------+---------------+--------------+------------------------+ | nbody | 132 ms | 128 ms | 1.03x faster | Significant (t=90.18) | +----------------------------+--------------+---------------+--------------+------------------------+ | nqueens | 121 ms | 111 ms | 1.09x faster | Significant (t=106.03) | +----------------------------+--------------+---------------+--------------+------------------------+ | pathlib | 24.3 ms | 23.9 ms | 1.02x faster | Not significant | +----------------------------+--------------+---------------+--------------+------------------------+ | pickle | 14.0 us | 12.6 us | 1.12x faster | Significant (t=88.45) | +----------------------------+--------------+---------------+--------------+------------------------+ | pickle_dict | 38.6 us | 37.3 us | 1.04x faster | Significant (t=22.70) | +----------------------------+--------------+---------------+--------------+------------------------+ | pickle_list | 5.12 us | 4.97 us | 1.03x faster | Significant (t=20.80) | +----------------------------+--------------+---------------+--------------+------------------------+ | pickle_pure_python | 419 us | 394 us | 1.06x faster | Significant (t=51.68) | +----------------------------+--------------+---------------+--------------+------------------------+ | pidigits | 234 ms | 234 ms | 1.00x faster | Not significant | +----------------------------+--------------+---------------+--------------+------------------------+ | pprint_pformat | 2.06 sec | 1.92 sec | 1.07x faster | Significant (t=94.10) | +----------------------------+--------------+---------------+--------------+------------------------+ | pprint_safe_repr | 994 ms | 929 ms | 1.07x faster | Significant (t=103.27) | +----------------------------+--------------+---------------+--------------+------------------------+ | pyflate | 592 ms | 557 ms | 1.06x faster | Significant (t=54.46) | +----------------------------+--------------+---------------+--------------+------------------------+ | python_startup | 11.0 ms | 10.8 ms | 1.02x faster | Significant (t=10.63) | +----------------------------+--------------+---------------+--------------+------------------------+ | python_startup_no_site | 8.12 ms | 12.8 ms | 1.57x slower | Significant (t=-25.67) | +----------------------------+--------------+---------------+--------------+------------------------+ | raytrace | 805 ms | 755 ms | 1.07x faster | Significant (t=102.25) | +----------------------------+--------------+---------------+--------------+------------------------+ | regex_compile | 306 ms | 289 ms | 1.06x faster | Significant (t=81.99) | +----------------------------+--------------+---------------+--------------+------------------------+ | regex_dna | 448 ms | 468 ms | 1.04x slower | Significant (t=-82.45) | +----------------------------+--------------+---------------+--------------+------------------------+ | regex_effbot | 8.21 ms | 8.52 ms | 1.04x slower | Significant (t=-91.30) | +----------------------------+--------------+---------------+--------------+------------------------+ | regex_v8 | 58.1 ms | 58.2 ms | 1.00x slower | Not significant | +----------------------------+--------------+---------------+--------------+------------------------+ | richards | 131 ms | 124 ms | 1.06x faster | Significant (t=50.55) | +----------------------------+--------------+---------------+--------------+------------------------+ | richards_super | 161 ms | 150 ms | 1.07x faster | Significant (t=58.57) | +----------------------------+--------------+---------------+--------------+------------------------+ | scimark_fft | 938 ms | 853 ms | 1.10x faster | Significant (t=20.22) | +----------------------------+--------------+---------------+--------------+------------------------+ | scimark_lu | 328 ms | 304 ms | 1.08x faster | Significant (t=18.40) | +----------------------------+--------------+---------------+--------------+------------------------+ | scimark_monte_carlo | 189 ms | 175 ms | 1.08x faster | Significant (t=26.53) | +----------------------------+--------------+---------------+--------------+------------------------+ | scimark_sor | 332 ms | 316 ms | 1.05x faster | Significant (t=35.88) | +----------------------------+--------------+---------------+--------------+------------------------+ | scimark_sparse_mat_mult | 14.2 ms | 12.9 ms | 1.10x faster | Significant (t=16.11) | +----------------------------+--------------+---------------+--------------+------------------------+ | spectral_norm | 319 ms | 303 ms | 1.05x faster | Significant (t=25.81) | +----------------------------+--------------+---------------+--------------+------------------------+ | sqlalchemy_declarative | 312 ms | 306 ms | 1.02x faster | Significant (t=3.20) | +----------------------------+--------------+---------------+--------------+------------------------+ | sqlalchemy_imperative | 36.2 ms | 34.3 ms | 1.06x faster | Significant (t=4.73) | +----------------------------+--------------+---------------+--------------+------------------------+ | sqlglot_normalize | 299 ms | 282 ms | 1.06x faster | Significant (t=68.47) | +----------------------------+--------------+---------------+--------------+------------------------+ | sqlglot_optimize | 141 ms | 134 ms | 1.06x faster | Significant (t=52.99) | +----------------------------+--------------+---------------+--------------+------------------------+ | sqlglot_parse | 3.74 ms | 3.47 ms | 1.08x faster | Significant (t=108.41) | +----------------------------+--------------+---------------+--------------+------------------------+ | sqlglot_transpile | 4.43 ms | 4.14 ms | 1.07x faster | Significant (t=55.82) | +----------------------------+--------------+---------------+--------------+------------------------+ | sqlite_synth | 6.16 us | 5.96 us | 1.03x faster | Significant (t=11.20) | +----------------------------+--------------+---------------+--------------+------------------------+ | sympy_expand | 1.09 sec | 1.01 sec | 1.08x faster | Significant (t=63.87) | +----------------------------+--------------+---------------+--------------+------------------------+ | sympy_integrate | 48.0 ms | 46.5 ms | 1.03x faster | Significant (t=14.67) | +----------------------------+--------------+---------------+--------------+------------------------+ | sympy_str | 655 ms | 609 ms | 1.08x faster | Significant (t=42.13) | +----------------------------+--------------+---------------+--------------+------------------------+ | sympy_sum | 360 ms | 341 ms | 1.05x faster | Significant (t=20.61) | +----------------------------+--------------+---------------+--------------+------------------------+ | telco | 18.9 ms | 17.7 ms | 1.06x faster | Significant (t=19.89) | +----------------------------+--------------+---------------+--------------+------------------------+ | tomli_loads | 6.02 sec | 5.61 sec | 1.07x faster | Significant (t=58.31) | +----------------------------+--------------+---------------+--------------+------------------------+ | tornado_http | 258 ms | 257 ms | 1.01x faster | Not significant | +----------------------------+--------------+---------------+--------------+------------------------+ | typing_runtime_protocols | 1.53 ms | 1.33 ms | 1.15x faster | Significant (t=167.43) | +----------------------------+--------------+---------------+--------------+------------------------+ | unpack_sequence | 135 ns | 134 ns | 1.01x faster | Not significant | +----------------------------+--------------+---------------+--------------+------------------------+ | unpickle | 39.4 us | 34.7 us | 1.14x faster | Significant (t=94.94) | +----------------------------+--------------+---------------+--------------+------------------------+ | unpickle_list | 11.1 us | 13.8 us | 1.25x slower | Significant (t=-67.99) | +----------------------------+--------------+---------------+--------------+------------------------+ | unpickle_pure_python | 637 us | 595 us | 1.07x faster | Significant (t=83.29) | +----------------------------+--------------+---------------+--------------+------------------------+ | xml_etree_generate | 231 ms | 219 ms | 1.06x faster | Significant (t=21.24) | +----------------------------+--------------+---------------+--------------+------------------------+ | xml_etree_iterparse | 319 ms | 311 ms | 1.03x faster | Significant (t=6.65) | +----------------------------+--------------+---------------+--------------+------------------------+ | xml_etree_parse | 464 ms | 455 ms | 1.02x faster | Not significant | +----------------------------+--------------+---------------+--------------+------------------------+ | xml_etree_process | 162 ms | 158 ms | 1.03x faster | Significant (t=25.45) | +----------------------------+--------------+---------------+--------------+------------------------+