py3.12_c10s.json ================ Performance version: 1.11.0 Report on Linux-6.11.0-25.el10.x86_64-x86_64-with-glibc2.39 Number of logical CPUs: 4 Start date: 2024-09-18 15:27:16.178238 End date: 2024-09-18 17:02:52.435012 py3.12_c10s_flags_shuffle.json ============================== Performance version: 1.11.0 Report on Linux-6.11.0-25.el10.x86_64-x86_64-with-glibc2.39 Number of logical CPUs: 4 Start date: 2024-09-18 17:37:21.268112 End date: 2024-09-18 19:12:42.179099 +----------------------------------+------------------+--------------------------------+--------------+------------------------+ | Benchmark | py3.12_c10s.json | py3.12_c10s_flags_shuffle.json | Change | Significance | +==================================+==================+================================+==============+========================+ | 2to3 | 479 ms | 476 ms | 1.01x faster | Not significant | +----------------------------------+------------------+--------------------------------+--------------+------------------------+ | async_generators | 737 ms | 754 ms | 1.02x slower | Significant (t=-11.19) | +----------------------------------+------------------+--------------------------------+--------------+------------------------+ | async_tree_cpu_io_mixed | 1.23 sec | 1.23 sec | 1.00x slower | Not significant | +----------------------------------+------------------+--------------------------------+--------------+------------------------+ | async_tree_cpu_io_mixed_tg | 1.18 sec | 1.17 sec | 1.00x faster | Not significant | +----------------------------------+------------------+--------------------------------+--------------+------------------------+ | async_tree_eager | 198 ms | 195 ms | 1.01x faster | Not significant | +----------------------------------+------------------+--------------------------------+--------------+------------------------+ | async_tree_eager_cpu_io_mixed | 703 ms | 706 ms | 1.01x slower | Not significant | +----------------------------------+------------------+--------------------------------+--------------+------------------------+ | async_tree_eager_cpu_io_mixed_tg | 607 ms | 608 ms | 1.00x slower | Not significant | +----------------------------------+------------------+--------------------------------+--------------+------------------------+ | async_tree_eager_io | 1.86 sec | 1.85 sec | 1.00x faster | Not significant | +----------------------------------+------------------+--------------------------------+--------------+------------------------+ | async_tree_eager_io_tg | 1.86 sec | 1.85 sec | 1.01x faster | Not significant | +----------------------------------+------------------+--------------------------------+--------------+------------------------+ | async_tree_eager_memoization | 437 ms | 444 ms | 1.02x slower | Not significant | +----------------------------------+------------------+--------------------------------+--------------+------------------------+ | async_tree_eager_memoization_tg | 331 ms | 331 ms | 1.00x faster | Not significant | +----------------------------------+------------------+--------------------------------+--------------+------------------------+ | async_tree_eager_tg | 136 ms | 133 ms | 1.02x faster | Not significant | +----------------------------------+------------------+--------------------------------+--------------+------------------------+ | async_tree_io | 1.76 sec | 1.74 sec | 1.01x faster | Not significant | +----------------------------------+------------------+--------------------------------+--------------+------------------------+ | async_tree_io_tg | 1.74 sec | 1.72 sec | 1.01x faster | Not significant | +----------------------------------+------------------+--------------------------------+--------------+------------------------+ | async_tree_memoization | 970 ms | 958 ms | 1.01x faster | Not significant | +----------------------------------+------------------+--------------------------------+--------------+------------------------+ | async_tree_memoization_tg | 899 ms | 874 ms | 1.03x faster | Significant (t=4.03) | +----------------------------------+------------------+--------------------------------+--------------+------------------------+ | async_tree_none | 787 ms | 777 ms | 1.01x faster | Not significant | +----------------------------------+------------------+--------------------------------+--------------+------------------------+ | async_tree_none_tg | 709 ms | 691 ms | 1.03x faster | Significant (t=11.13) | +----------------------------------+------------------+--------------------------------+--------------+------------------------+ | asyncio_tcp | 748 ms | 718 ms | 1.04x faster | Significant (t=8.50) | +----------------------------------+------------------+--------------------------------+--------------+------------------------+ | asyncio_tcp_ssl | 10.3 sec | 10.3 sec | 1.00x slower | Not significant | +----------------------------------+------------------+--------------------------------+--------------+------------------------+ | asyncio_websockets | 467 ms | 473 ms | 1.01x slower | Not significant | +----------------------------------+------------------+--------------------------------+--------------+------------------------+ | bench_mp_pool | 12.7 ms | 12.5 ms | 1.02x faster | Not significant | +----------------------------------+------------------+--------------------------------+--------------+------------------------+ | bench_thread_pool | 2.04 ms | 2.03 ms | 1.01x faster | Not significant | +----------------------------------+------------------+--------------------------------+--------------+------------------------+ | chameleon | 13.0 ms | 12.7 ms | 1.02x faster | Significant (t=15.39) | +----------------------------------+------------------+--------------------------------+--------------+------------------------+ | chaos | 117 ms | 116 ms | 1.00x faster | Not significant | +----------------------------------+------------------+--------------------------------+--------------+------------------------+ | comprehensions | 38.0 us | 37.8 us | 1.00x faster | Not significant | +----------------------------------+------------------+--------------------------------+--------------+------------------------+ | coroutines | 43.3 ms | 42.7 ms | 1.01x faster | Not significant | +----------------------------------+------------------+--------------------------------+--------------+------------------------+ | coverage | 134 ms | 133 ms | 1.00x faster | Not significant | +----------------------------------+------------------+--------------------------------+--------------+------------------------+ | create_gc_cycles | 1.93 ms | 1.92 ms | 1.00x faster | Not significant | +----------------------------------+------------------+--------------------------------+--------------+------------------------+ | crypto_pyaes | 139 ms | 139 ms | 1.01x slower | Not significant | +----------------------------------+------------------+--------------------------------+--------------+------------------------+ | dask | 844 ms | 840 ms | 1.00x faster | Not significant | +----------------------------------+------------------+--------------------------------+--------------+------------------------+ | deepcopy | 659 us | 658 us | 1.00x faster | Not significant | +----------------------------------+------------------+--------------------------------+--------------+------------------------+ | deepcopy_memo | 74.0 us | 74.2 us | 1.00x slower | Not significant | +----------------------------------+------------------+--------------------------------+--------------+------------------------+ | deepcopy_reduce | 5.82 us | 5.83 us | 1.00x slower | Not significant | +----------------------------------+------------------+--------------------------------+--------------+------------------------+ | deltablue | 5.89 ms | 5.89 ms | 1.00x slower | Not significant | +----------------------------------+------------------+--------------------------------+--------------+------------------------+ | django_template | 63.6 ms | 64.6 ms | 1.01x slower | Not significant | +----------------------------------+------------------+--------------------------------+--------------+------------------------+ | docutils | 4.64 sec | 4.62 sec | 1.00x faster | Not significant | +----------------------------------+------------------+--------------------------------+--------------+------------------------+ | dulwich_log | 135 ms | 135 ms | 1.00x slower | Not significant | +----------------------------------+------------------+--------------------------------+--------------+------------------------+ | fannkuch | 708 ms | 718 ms | 1.01x slower | Not significant | +----------------------------------+------------------+--------------------------------+--------------+------------------------+ | float | 146 ms | 148 ms | 1.02x slower | Not significant | +----------------------------------+------------------+--------------------------------+--------------+------------------------+ | gc_traversal | 5.24 ms | 5.45 ms | 1.04x slower | Significant (t=-63.35) | +----------------------------------+------------------+--------------------------------+--------------+------------------------+ | generators | 54.3 ms | 54.4 ms | 1.00x slower | Not significant | +----------------------------------+------------------+--------------------------------+--------------+------------------------+ | genshi_text | 41.2 ms | 41.0 ms | 1.00x faster | Not significant | +----------------------------------+------------------+--------------------------------+--------------+------------------------+ | genshi_xml | 90.9 ms | 90.1 ms | 1.01x faster | Not significant | +----------------------------------+------------------+--------------------------------+--------------+------------------------+ | go | 237 ms | 238 ms | 1.00x slower | Not significant | +----------------------------------+------------------+--------------------------------+--------------+------------------------+ | hexiom | 10.7 ms | 10.7 ms | 1.00x slower | Not significant | +----------------------------------+------------------+--------------------------------+--------------+------------------------+ | html5lib | 111 ms | 111 ms | 1.00x faster | Not significant | +----------------------------------+------------------+--------------------------------+--------------+------------------------+ | json_dumps | 18.2 ms | 18.3 ms | 1.01x slower | Not significant | +----------------------------------+------------------+--------------------------------+--------------+------------------------+ | json_loads | 46.9 us | 46.7 us | 1.00x faster | Not significant | +----------------------------------+------------------+--------------------------------+--------------+------------------------+ | logging_format | 12.6 us | 12.4 us | 1.01x faster | Not significant | +----------------------------------+------------------+--------------------------------+--------------+------------------------+ | logging_silent | 194 ns | 192 ns | 1.01x faster | Not significant | +----------------------------------+------------------+--------------------------------+--------------+------------------------+ | logging_simple | 11.4 us | 11.3 us | 1.02x faster | Not significant | +----------------------------------+------------------+--------------------------------+--------------+------------------------+ | mako | 19.9 ms | 19.6 ms | 1.01x faster | Not significant | +----------------------------------+------------------+--------------------------------+--------------+------------------------+ | mdp | 4.64 sec | 4.66 sec | 1.00x slower | Not significant | +----------------------------------+------------------+--------------------------------+--------------+------------------------+ | meteor_contest | 178 ms | 179 ms | 1.00x slower | Not significant | +----------------------------------+------------------+--------------------------------+--------------+------------------------+ | nbody | 169 ms | 166 ms | 1.02x faster | Not significant | +----------------------------------+------------------+--------------------------------+--------------+------------------------+ | nqueens | 155 ms | 155 ms | 1.00x slower | Not significant | +----------------------------------+------------------+--------------------------------+--------------+------------------------+ | pathlib | 33.3 ms | 34.0 ms | 1.02x slower | Significant (t=-2.84) | +----------------------------------+------------------+--------------------------------+--------------+------------------------+ | pickle | 18.9 us | 19.1 us | 1.01x slower | Not significant | +----------------------------------+------------------+--------------------------------+--------------+------------------------+ | pickle_dict | 48.3 us | 49.3 us | 1.02x slower | Significant (t=-7.41) | +----------------------------------+------------------+--------------------------------+--------------+------------------------+ | pickle_list | 7.32 us | 7.54 us | 1.03x slower | Significant (t=-6.77) | +----------------------------------+------------------+--------------------------------+--------------+------------------------+ | pickle_pure_python | 546 us | 567 us | 1.04x slower | Significant (t=-6.62) | +----------------------------------+------------------+--------------------------------+--------------+------------------------+ | pidigits | 309 ms | 310 ms | 1.00x slower | Not significant | +----------------------------------+------------------+--------------------------------+--------------+------------------------+ | pprint_pformat | 2.75 sec | 2.77 sec | 1.01x slower | Not significant | +----------------------------------+------------------+--------------------------------+--------------+------------------------+ | pprint_safe_repr | 1.35 sec | 1.37 sec | 1.02x slower | Not significant | +----------------------------------+------------------+--------------------------------+--------------+------------------------+ | pyflate | 749 ms | 752 ms | 1.00x slower | Not significant | +----------------------------------+------------------+--------------------------------+--------------+------------------------+ | python_startup | 16.6 ms | 16.5 ms | 1.01x faster | Not significant | +----------------------------------+------------------+--------------------------------+--------------+------------------------+ | python_startup_no_site | 11.5 ms | 11.5 ms | 1.00x faster | Not significant | +----------------------------------+------------------+--------------------------------+--------------+------------------------+ | raytrace | 553 ms | 550 ms | 1.01x faster | Not significant | +----------------------------------+------------------+--------------------------------+--------------+------------------------+ | regex_compile | 254 ms | 251 ms | 1.01x faster | Not significant | +----------------------------------+------------------+--------------------------------+--------------+------------------------+ | regex_dna | 290 ms | 290 ms | 1.00x faster | Not significant | +----------------------------------+------------------+--------------------------------+--------------+------------------------+ | regex_effbot | 5.54 ms | 5.35 ms | 1.04x faster | Significant (t=31.18) | +----------------------------------+------------------+--------------------------------+--------------+------------------------+ | regex_v8 | 38.2 ms | 38.1 ms | 1.00x faster | Not significant | +----------------------------------+------------------+--------------------------------+--------------+------------------------+ | richards | 75.8 ms | 77.3 ms | 1.02x slower | Significant (t=-4.46) | +----------------------------------+------------------+--------------------------------+--------------+------------------------+ | richards_super | 87.2 ms | 86.4 ms | 1.01x faster | Not significant | +----------------------------------+------------------+--------------------------------+--------------+------------------------+ | scimark_fft | 639 ms | 632 ms | 1.01x faster | Not significant | +----------------------------------+------------------+--------------------------------+--------------+------------------------+ | scimark_lu | 209 ms | 203 ms | 1.03x faster | Significant (t=23.16) | +----------------------------------+------------------+--------------------------------+--------------+------------------------+ | scimark_monte_carlo | 127 ms | 127 ms | 1.00x faster | Not significant | +----------------------------------+------------------+--------------------------------+--------------+------------------------+ | scimark_sor | 222 ms | 223 ms | 1.00x slower | Not significant | +----------------------------------+------------------+--------------------------------+--------------+------------------------+ | scimark_sparse_mat_mult | 8.14 ms | 7.98 ms | 1.02x faster | Not significant | +----------------------------------+------------------+--------------------------------+--------------+------------------------+ | spectral_norm | 199 ms | 195 ms | 1.02x faster | Significant (t=10.40) | +----------------------------------+------------------+--------------------------------+--------------+------------------------+ | sqlalchemy_declarative | 252 ms | 252 ms | 1.00x slower | Not significant | +----------------------------------+------------------+--------------------------------+--------------+------------------------+ | sqlalchemy_imperative | 37.1 ms | 37.4 ms | 1.01x slower | Not significant | +----------------------------------+------------------+--------------------------------+--------------+------------------------+ | sqlglot_normalize | 200 ms | 200 ms | 1.00x faster | Not significant | +----------------------------------+------------------+--------------------------------+--------------+------------------------+ | sqlglot_optimize | 99.5 ms | 99.3 ms | 1.00x faster | Not significant | +----------------------------------+------------------+--------------------------------+--------------+------------------------+ | sqlglot_parse | 2.36 ms | 2.37 ms | 1.01x slower | Not significant | +----------------------------------+------------------+--------------------------------+--------------+------------------------+ | sqlglot_transpile | 2.90 ms | 2.91 ms | 1.00x slower | Not significant | +----------------------------------+------------------+--------------------------------+--------------+------------------------+ | sqlite_synth | 4.11 us | 4.08 us | 1.01x faster | Not significant | +----------------------------------+------------------+--------------------------------+--------------+------------------------+ | sympy_expand | 860 ms | 857 ms | 1.00x faster | Not significant | +----------------------------------+------------------+--------------------------------+--------------+------------------------+ | sympy_integrate | 37.1 ms | 37.1 ms | 1.00x faster | Not significant | +----------------------------------+------------------+--------------------------------+--------------+------------------------+ | sympy_str | 531 ms | 527 ms | 1.01x faster | Not significant | +----------------------------------+------------------+--------------------------------+--------------+------------------------+ | sympy_sum | 309 ms | 308 ms | 1.00x faster | Not significant | +----------------------------------+------------------+--------------------------------+--------------+------------------------+ | telco | 13.0 ms | 13.2 ms | 1.02x slower | Not significant | +----------------------------------+------------------+--------------------------------+--------------+------------------------+ | tomli_loads | 3.79 sec | 3.73 sec | 1.01x faster | Not significant | +----------------------------------+------------------+--------------------------------+--------------+------------------------+ | tornado_http | 226 ms | 227 ms | 1.00x slower | Not significant | +----------------------------------+------------------+--------------------------------+--------------+------------------------+ | typing_runtime_protocols | 306 us | 308 us | 1.01x slower | Not significant | +----------------------------------+------------------+--------------------------------+--------------+------------------------+ | unpack_sequence | 71.5 ns | 73.5 ns | 1.03x slower | Significant (t=-14.49) | +----------------------------------+------------------+--------------------------------+--------------+------------------------+ | unpickle | 24.0 us | 23.9 us | 1.01x faster | Not significant | +----------------------------------+------------------+--------------------------------+--------------+------------------------+ | unpickle_list | 8.95 us | 8.88 us | 1.01x faster | Not significant | +----------------------------------+------------------+--------------------------------+--------------+------------------------+ | unpickle_pure_python | 387 us | 389 us | 1.01x slower | Not significant | +----------------------------------+------------------+--------------------------------+--------------+------------------------+ | xml_etree_generate | 163 ms | 161 ms | 1.01x faster | Not significant | +----------------------------------+------------------+--------------------------------+--------------+------------------------+ | xml_etree_iterparse | 194 ms | 195 ms | 1.00x slower | Not significant | +----------------------------------+------------------+--------------------------------+--------------+------------------------+ | xml_etree_parse | 285 ms | 284 ms | 1.00x faster | Not significant | +----------------------------------+------------------+--------------------------------+--------------+------------------------+ | xml_etree_process | 109 ms | 108 ms | 1.00x faster | Not significant | +----------------------------------+------------------+--------------------------------+--------------+------------------------+