py3.12_rhel9.json ================= Performance version: 1.11.0 Report on Linux-5.14.0-509.el9.x86_64-x86_64-with-glibc2.34 Number of logical CPUs: 16 Start date: 2024-09-18 22:04:00.360290 End date: 2024-09-18 23:27:50.291761 py3.12_rhel9_flags_shuffle.json =============================== Performance version: 1.11.0 Report on Linux-5.14.0-509.el9.x86_64-x86_64-with-glibc2.34 Number of logical CPUs: 16 Start date: 2024-09-18 23:38:29.631441 End date: 2024-09-19 01:02:21.280468 +----------------------------------+-------------------+---------------------------------+--------------+------------------------+ | Benchmark | py3.12_rhel9.json | py3.12_rhel9_flags_shuffle.json | Change | Significance | +==================================+===================+=================================+==============+========================+ | 2to3 | 478 ms | 473 ms | 1.01x faster | Not significant | +----------------------------------+-------------------+---------------------------------+--------------+------------------------+ | async_generators | 788 ms | 836 ms | 1.06x slower | Significant (t=-26.36) | +----------------------------------+-------------------+---------------------------------+--------------+------------------------+ | async_tree_cpu_io_mixed | 1.15 sec | 1.17 sec | 1.02x slower | Not significant | +----------------------------------+-------------------+---------------------------------+--------------+------------------------+ | async_tree_cpu_io_mixed_tg | 1.12 sec | 1.14 sec | 1.02x slower | Not significant | +----------------------------------+-------------------+---------------------------------+--------------+------------------------+ | async_tree_eager | 220 ms | 226 ms | 1.02x slower | Significant (t=-13.02) | +----------------------------------+-------------------+---------------------------------+--------------+------------------------+ | async_tree_eager_cpu_io_mixed | 654 ms | 659 ms | 1.01x slower | Not significant | +----------------------------------+-------------------+---------------------------------+--------------+------------------------+ | async_tree_eager_cpu_io_mixed_tg | 551 ms | 552 ms | 1.00x slower | Not significant | +----------------------------------+-------------------+---------------------------------+--------------+------------------------+ | async_tree_eager_io | 1.81 sec | 1.83 sec | 1.01x slower | Not significant | +----------------------------------+-------------------+---------------------------------+--------------+------------------------+ | async_tree_eager_io_tg | 1.79 sec | 1.81 sec | 1.01x slower | Not significant | +----------------------------------+-------------------+---------------------------------+--------------+------------------------+ | async_tree_eager_memoization | 478 ms | 482 ms | 1.01x slower | Not significant | +----------------------------------+-------------------+---------------------------------+--------------+------------------------+ | async_tree_eager_memoization_tg | 367 ms | 370 ms | 1.01x slower | Not significant | +----------------------------------+-------------------+---------------------------------+--------------+------------------------+ | async_tree_eager_tg | 152 ms | 154 ms | 1.01x slower | Not significant | +----------------------------------+-------------------+---------------------------------+--------------+------------------------+ | async_tree_io | 1.75 sec | 1.77 sec | 1.01x slower | Not significant | +----------------------------------+-------------------+---------------------------------+--------------+------------------------+ | async_tree_io_tg | 1.71 sec | 1.72 sec | 1.00x slower | Not significant | +----------------------------------+-------------------+---------------------------------+--------------+------------------------+ | async_tree_memoization | 975 ms | 995 ms | 1.02x slower | Significant (t=-2.65) | +----------------------------------+-------------------+---------------------------------+--------------+------------------------+ | async_tree_memoization_tg | 910 ms | 921 ms | 1.01x slower | Not significant | +----------------------------------+-------------------+---------------------------------+--------------+------------------------+ | async_tree_none | 781 ms | 801 ms | 1.02x slower | Significant (t=-7.05) | +----------------------------------+-------------------+---------------------------------+--------------+------------------------+ | async_tree_none_tg | 717 ms | 734 ms | 1.02x slower | Significant (t=-21.43) | +----------------------------------+-------------------+---------------------------------+--------------+------------------------+ | asyncio_tcp | 652 ms | 689 ms | 1.06x slower | Significant (t=-6.49) | +----------------------------------+-------------------+---------------------------------+--------------+------------------------+ | asyncio_tcp_ssl | 2.09 sec | 2.10 sec | 1.00x slower | Not significant | +----------------------------------+-------------------+---------------------------------+--------------+------------------------+ | asyncio_websockets | 937 ms | 937 ms | 1.00x faster | Not significant | +----------------------------------+-------------------+---------------------------------+--------------+------------------------+ | bench_mp_pool | 21.2 ms | 17.1 ms | 1.24x faster | Significant (t=2.53) | +----------------------------------+-------------------+---------------------------------+--------------+------------------------+ | bench_thread_pool | 1.95 ms | 2.16 ms | 1.11x slower | Significant (t=-36.23) | +----------------------------------+-------------------+---------------------------------+--------------+------------------------+ | chameleon | 13.2 ms | 12.8 ms | 1.03x faster | Significant (t=10.85) | +----------------------------------+-------------------+---------------------------------+--------------+------------------------+ | chaos | 128 ms | 128 ms | 1.00x faster | Not significant | +----------------------------------+-------------------+---------------------------------+--------------+------------------------+ | comprehensions | 37.2 us | 37.5 us | 1.01x slower | Not significant | +----------------------------------+-------------------+---------------------------------+--------------+------------------------+ | coroutines | 40.0 ms | 39.7 ms | 1.01x faster | Not significant | +----------------------------------+-------------------+---------------------------------+--------------+------------------------+ | coverage | 125 ms | 119 ms | 1.05x faster | Significant (t=13.17) | +----------------------------------+-------------------+---------------------------------+--------------+------------------------+ | create_gc_cycles | 2.14 ms | 2.14 ms | 1.00x slower | Not significant | +----------------------------------+-------------------+---------------------------------+--------------+------------------------+ | crypto_pyaes | 136 ms | 136 ms | 1.00x slower | Not significant | +----------------------------------+-------------------+---------------------------------+--------------+------------------------+ | dask | 726 ms | 700 ms | 1.04x faster | Significant (t=4.21) | +----------------------------------+-------------------+---------------------------------+--------------+------------------------+ | deepcopy | 691 us | 680 us | 1.02x faster | Not significant | +----------------------------------+-------------------+---------------------------------+--------------+------------------------+ | deepcopy_memo | 62.1 us | 65.2 us | 1.05x slower | Significant (t=-13.30) | +----------------------------------+-------------------+---------------------------------+--------------+------------------------+ | deepcopy_reduce | 6.69 us | 6.69 us | 1.00x slower | Not significant | +----------------------------------+-------------------+---------------------------------+--------------+------------------------+ | deltablue | 5.84 ms | 5.85 ms | 1.00x slower | Not significant | +----------------------------------+-------------------+---------------------------------+--------------+------------------------+ | django_template | 76.9 ms | 76.2 ms | 1.01x faster | Not significant | +----------------------------------+-------------------+---------------------------------+--------------+------------------------+ | docutils | 4.42 sec | 4.45 sec | 1.01x slower | Not significant | +----------------------------------+-------------------+---------------------------------+--------------+------------------------+ | dulwich_log | 128 ms | 128 ms | 1.00x faster | Not significant | +----------------------------------+-------------------+---------------------------------+--------------+------------------------+ | fannkuch | 645 ms | 619 ms | 1.04x faster | Significant (t=16.89) | +----------------------------------+-------------------+---------------------------------+--------------+------------------------+ | float | 142 ms | 139 ms | 1.03x faster | Significant (t=9.55) | +----------------------------------+-------------------+---------------------------------+--------------+------------------------+ | gc_traversal | 5.88 ms | 5.98 ms | 1.02x slower | Not significant | +----------------------------------+-------------------+---------------------------------+--------------+------------------------+ | generators | 50.6 ms | 54.0 ms | 1.07x slower | Significant (t=-84.27) | +----------------------------------+-------------------+---------------------------------+--------------+------------------------+ | genshi_text | 43.9 ms | 43.5 ms | 1.01x faster | Not significant | +----------------------------------+-------------------+---------------------------------+--------------+------------------------+ | genshi_xml | 109 ms | 109 ms | 1.00x slower | Not significant | +----------------------------------+-------------------+---------------------------------+--------------+------------------------+ | go | 246 ms | 243 ms | 1.01x faster | Not significant | +----------------------------------+-------------------+---------------------------------+--------------+------------------------+ | hexiom | 9.50 ms | 10.1 ms | 1.06x slower | Significant (t=-37.06) | +----------------------------------+-------------------+---------------------------------+--------------+------------------------+ | html5lib | 119 ms | 120 ms | 1.01x slower | Not significant | +----------------------------------+-------------------+---------------------------------+--------------+------------------------+ | json_dumps | 17.9 ms | 17.6 ms | 1.02x faster | Not significant | +----------------------------------+-------------------+---------------------------------+--------------+------------------------+ | json_loads | 42.3 us | 41.5 us | 1.02x faster | Not significant | +----------------------------------+-------------------+---------------------------------+--------------+------------------------+ | logging_format | 15.7 us | 15.8 us | 1.00x slower | Not significant | +----------------------------------+-------------------+---------------------------------+--------------+------------------------+ | logging_silent | 170 ns | 169 ns | 1.01x faster | Not significant | +----------------------------------+-------------------+---------------------------------+--------------+------------------------+ | logging_simple | 14.4 us | 14.3 us | 1.00x faster | Not significant | +----------------------------------+-------------------+---------------------------------+--------------+------------------------+ | mako | 18.2 ms | 17.9 ms | 1.02x faster | Not significant | +----------------------------------+-------------------+---------------------------------+--------------+------------------------+ | mdp | 4.75 sec | 4.57 sec | 1.04x faster | Significant (t=39.89) | +----------------------------------+-------------------+---------------------------------+--------------+------------------------+ | meteor_contest | 156 ms | 154 ms | 1.01x faster | Not significant | +----------------------------------+-------------------+---------------------------------+--------------+------------------------+ | nbody | 160 ms | 168 ms | 1.05x slower | Significant (t=-24.51) | +----------------------------------+-------------------+---------------------------------+--------------+------------------------+ | nqueens | 147 ms | 146 ms | 1.01x faster | Not significant | +----------------------------------+-------------------+---------------------------------+--------------+------------------------+ | pathlib | 37.0 ms | 37.6 ms | 1.02x slower | Not significant | +----------------------------------+-------------------+---------------------------------+--------------+------------------------+ | pickle | 17.3 us | 17.4 us | 1.01x slower | Not significant | +----------------------------------+-------------------+---------------------------------+--------------+------------------------+ | pickle_dict | 40.8 us | 41.1 us | 1.01x slower | Not significant | +----------------------------------+-------------------+---------------------------------+--------------+------------------------+ | pickle_list | 7.10 us | 7.33 us | 1.03x slower | Significant (t=-18.89) | +----------------------------------+-------------------+---------------------------------+--------------+------------------------+ | pickle_pure_python | 600 us | 611 us | 1.02x slower | Not significant | +----------------------------------+-------------------+---------------------------------+--------------+------------------------+ | pidigits | 241 ms | 244 ms | 1.01x slower | Not significant | +----------------------------------+-------------------+---------------------------------+--------------+------------------------+ | pprint_pformat | 2.98 sec | 2.92 sec | 1.02x faster | Not significant | +----------------------------------+-------------------+---------------------------------+--------------+------------------------+ | pprint_safe_repr | 1.42 sec | 1.40 sec | 1.01x faster | Not significant | +----------------------------------+-------------------+---------------------------------+--------------+------------------------+ | pyflate | 761 ms | 820 ms | 1.08x slower | Significant (t=-32.13) | +----------------------------------+-------------------+---------------------------------+--------------+------------------------+ | python_startup | 15.8 ms | 16.1 ms | 1.01x slower | Not significant | +----------------------------------+-------------------+---------------------------------+--------------+------------------------+ | python_startup_no_site | 11.2 ms | 11.4 ms | 1.02x slower | Not significant | +----------------------------------+-------------------+---------------------------------+--------------+------------------------+ | raytrace | 598 ms | 594 ms | 1.01x faster | Not significant | +----------------------------------+-------------------+---------------------------------+--------------+------------------------+ | regex_compile | 234 ms | 237 ms | 1.01x slower | Not significant | +----------------------------------+-------------------+---------------------------------+--------------+------------------------+ | regex_dna | 270 ms | 272 ms | 1.01x slower | Not significant | +----------------------------------+-------------------+---------------------------------+--------------+------------------------+ | regex_effbot | 5.30 ms | 5.73 ms | 1.08x slower | Significant (t=-55.52) | +----------------------------------+-------------------+---------------------------------+--------------+------------------------+ | regex_v8 | 34.9 ms | 35.6 ms | 1.02x slower | Significant (t=-23.15) | +----------------------------------+-------------------+---------------------------------+--------------+------------------------+ | richards | 93.2 ms | 93.7 ms | 1.00x slower | Not significant | +----------------------------------+-------------------+---------------------------------+--------------+------------------------+ | richards_super | 104 ms | 104 ms | 1.00x faster | Not significant | +----------------------------------+-------------------+---------------------------------+--------------+------------------------+ | scimark_fft | 675 ms | 657 ms | 1.03x faster | Significant (t=14.03) | +----------------------------------+-------------------+---------------------------------+--------------+------------------------+ | scimark_lu | 187 ms | 186 ms | 1.01x faster | Not significant | +----------------------------------+-------------------+---------------------------------+--------------+------------------------+ | scimark_monte_carlo | 122 ms | 120 ms | 1.02x faster | Not significant | +----------------------------------+-------------------+---------------------------------+--------------+------------------------+ | scimark_sor | 231 ms | 228 ms | 1.02x faster | Not significant | +----------------------------------+-------------------+---------------------------------+--------------+------------------------+ | scimark_sparse_mat_mult | 7.89 ms | 7.96 ms | 1.01x slower | Not significant | +----------------------------------+-------------------+---------------------------------+--------------+------------------------+ | spectral_norm | 184 ms | 212 ms | 1.15x slower | Significant (t=-27.19) | +----------------------------------+-------------------+---------------------------------+--------------+------------------------+ | sqlalchemy_declarative | 225 ms | 229 ms | 1.02x slower | Not significant | +----------------------------------+-------------------+---------------------------------+--------------+------------------------+ | sqlalchemy_imperative | 33.3 ms | 33.7 ms | 1.01x slower | Not significant | +----------------------------------+-------------------+---------------------------------+--------------+------------------------+ | sqlglot_normalize | 225 ms | 217 ms | 1.04x faster | Significant (t=27.49) | +----------------------------------+-------------------+---------------------------------+--------------+------------------------+ | sqlglot_optimize | 102 ms | 101 ms | 1.01x faster | Not significant | +----------------------------------+-------------------+---------------------------------+--------------+------------------------+ | sqlglot_parse | 2.39 ms | 2.37 ms | 1.01x faster | Not significant | +----------------------------------+-------------------+---------------------------------+--------------+------------------------+ | sqlglot_transpile | 2.92 ms | 2.90 ms | 1.01x faster | Not significant | +----------------------------------+-------------------+---------------------------------+--------------+------------------------+ | sqlite_synth | 4.54 us | 4.62 us | 1.02x slower | Not significant | +----------------------------------+-------------------+---------------------------------+--------------+------------------------+ | sympy_expand | 840 ms | 842 ms | 1.00x slower | Not significant | +----------------------------------+-------------------+---------------------------------+--------------+------------------------+ | sympy_integrate | 32.5 ms | 32.7 ms | 1.01x slower | Not significant | +----------------------------------+-------------------+---------------------------------+--------------+------------------------+ | sympy_str | 502 ms | 503 ms | 1.00x slower | Not significant | +----------------------------------+-------------------+---------------------------------+--------------+------------------------+ | sympy_sum | 267 ms | 269 ms | 1.01x slower | Not significant | +----------------------------------+-------------------+---------------------------------+--------------+------------------------+ | telco | 13.8 ms | 13.4 ms | 1.03x faster | Significant (t=9.22) | +----------------------------------+-------------------+---------------------------------+--------------+------------------------+ | tomli_loads | 3.97 sec | 3.87 sec | 1.02x faster | Significant (t=11.71) | +----------------------------------+-------------------+---------------------------------+--------------+------------------------+ | tornado_http | 209 ms | 209 ms | 1.00x slower | Not significant | +----------------------------------+-------------------+---------------------------------+--------------+------------------------+ | typing_runtime_protocols | 334 us | 333 us | 1.00x faster | Not significant | +----------------------------------+-------------------+---------------------------------+--------------+------------------------+ | unpack_sequence | 96.3 ns | 97.6 ns | 1.01x slower | Not significant | +----------------------------------+-------------------+---------------------------------+--------------+------------------------+ | unpickle | 25.3 us | 25.5 us | 1.01x slower | Not significant | +----------------------------------+-------------------+---------------------------------+--------------+------------------------+ | unpickle_list | 8.63 us | 8.45 us | 1.02x faster | Significant (t=13.57) | +----------------------------------+-------------------+---------------------------------+--------------+------------------------+ | unpickle_pure_python | 358 us | 361 us | 1.01x slower | Not significant | +----------------------------------+-------------------+---------------------------------+--------------+------------------------+ | xml_etree_generate | 151 ms | 151 ms | 1.00x slower | Not significant | +----------------------------------+-------------------+---------------------------------+--------------+------------------------+ | xml_etree_iterparse | 205 ms | 202 ms | 1.01x faster | Not significant | +----------------------------------+-------------------+---------------------------------+--------------+------------------------+ | xml_etree_parse | 313 ms | 313 ms | 1.00x faster | Not significant | +----------------------------------+-------------------+---------------------------------+--------------+------------------------+ | xml_etree_process | 106 ms | 106 ms | 1.01x slower | Not significant | +----------------------------------+-------------------+---------------------------------+--------------+------------------------+