pgo_test.json ============= Performance version: 1.11.0 Report on Linux-5.14.0-511.el9.x86_64-x86_64-with-glibc2.34 Number of logical CPUs: 48 Start date: 2024-09-24 14:48:04.828993 End date: 2024-09-24 16:13:54.658301 pgo_test_ubuntu_patch.json ========================== Performance version: 1.11.0 Report on Linux-5.14.0-511.el9.x86_64-x86_64-with-glibc2.34 Number of logical CPUs: 48 Start date: 2024-09-24 16:25:21.772557 End date: 2024-09-24 17:50:35.604567 +----------------------------------+---------------+----------------------------+--------------+-------------------------+ | Benchmark | pgo_test.json | pgo_test_ubuntu_patch.json | Change | Significance | +==================================+===============+============================+==============+=========================+ | 2to3 | 479 ms | 477 ms | 1.00x faster | Not significant | +----------------------------------+---------------+----------------------------+--------------+-------------------------+ | async_generators | 851 ms | 851 ms | 1.00x slower | Not significant | +----------------------------------+---------------+----------------------------+--------------+-------------------------+ | async_tree_cpu_io_mixed | 1.14 sec | 1.14 sec | 1.00x faster | Not significant | +----------------------------------+---------------+----------------------------+--------------+-------------------------+ | async_tree_cpu_io_mixed_tg | 1.10 sec | 1.11 sec | 1.00x slower | Not significant | +----------------------------------+---------------+----------------------------+--------------+-------------------------+ | async_tree_eager | 205 ms | 203 ms | 1.01x faster | Not significant | +----------------------------------+---------------+----------------------------+--------------+-------------------------+ | async_tree_eager_cpu_io_mixed | 684 ms | 687 ms | 1.00x slower | Not significant | +----------------------------------+---------------+----------------------------+--------------+-------------------------+ | async_tree_eager_cpu_io_mixed_tg | 594 ms | 590 ms | 1.01x faster | Not significant | +----------------------------------+---------------+----------------------------+--------------+-------------------------+ | async_tree_eager_io | 1.82 sec | 1.82 sec | 1.00x faster | Not significant | +----------------------------------+---------------+----------------------------+--------------+-------------------------+ | async_tree_eager_io_tg | 1.79 sec | 1.79 sec | 1.00x faster | Not significant | +----------------------------------+---------------+----------------------------+--------------+-------------------------+ | async_tree_eager_memoization | 426 ms | 427 ms | 1.00x slower | Not significant | +----------------------------------+---------------+----------------------------+--------------+-------------------------+ | async_tree_eager_memoization_tg | 324 ms | 321 ms | 1.01x faster | Not significant | +----------------------------------+---------------+----------------------------+--------------+-------------------------+ | async_tree_eager_tg | 141 ms | 139 ms | 1.01x faster | Not significant | +----------------------------------+---------------+----------------------------+--------------+-------------------------+ | async_tree_io | 1.70 sec | 1.69 sec | 1.01x faster | Not significant | +----------------------------------+---------------+----------------------------+--------------+-------------------------+ | async_tree_io_tg | 1.68 sec | 1.68 sec | 1.00x faster | Not significant | +----------------------------------+---------------+----------------------------+--------------+-------------------------+ | async_tree_memoization | 898 ms | 893 ms | 1.01x faster | Not significant | +----------------------------------+---------------+----------------------------+--------------+-------------------------+ | async_tree_memoization_tg | 839 ms | 836 ms | 1.00x faster | Not significant | +----------------------------------+---------------+----------------------------+--------------+-------------------------+ | async_tree_none | 737 ms | 727 ms | 1.01x faster | Not significant | +----------------------------------+---------------+----------------------------+--------------+-------------------------+ | async_tree_none_tg | 670 ms | 667 ms | 1.00x faster | Not significant | +----------------------------------+---------------+----------------------------+--------------+-------------------------+ | asyncio_tcp | 660 ms | 665 ms | 1.01x slower | Not significant | +----------------------------------+---------------+----------------------------+--------------+-------------------------+ | asyncio_tcp_ssl | 2.89 sec | 2.90 sec | 1.00x slower | Not significant | +----------------------------------+---------------+----------------------------+--------------+-------------------------+ | asyncio_websockets | 1.03 sec | 1.03 sec | 1.00x slower | Not significant | +----------------------------------+---------------+----------------------------+--------------+-------------------------+ | bench_mp_pool | 12.0 ms | 12.9 ms | 1.07x slower | Significant (t=-4.34) | +----------------------------------+---------------+----------------------------+--------------+-------------------------+ | bench_thread_pool | 1.74 ms | 1.73 ms | 1.01x faster | Not significant | +----------------------------------+---------------+----------------------------+--------------+-------------------------+ | chameleon | 13.3 ms | 13.2 ms | 1.01x faster | Not significant | +----------------------------------+---------------+----------------------------+--------------+-------------------------+ | chaos | 117 ms | 117 ms | 1.00x faster | Not significant | +----------------------------------+---------------+----------------------------+--------------+-------------------------+ | comprehensions | 39.7 us | 39.4 us | 1.01x faster | Not significant | +----------------------------------+---------------+----------------------------+--------------+-------------------------+ | coroutines | 45.7 ms | 45.4 ms | 1.01x faster | Not significant | +----------------------------------+---------------+----------------------------+--------------+-------------------------+ | coverage | 139 ms | 140 ms | 1.00x slower | Not significant | +----------------------------------+---------------+----------------------------+--------------+-------------------------+ | create_gc_cycles | 1.95 ms | 1.92 ms | 1.01x faster | Not significant | +----------------------------------+---------------+----------------------------+--------------+-------------------------+ | crypto_pyaes | 142 ms | 142 ms | 1.00x faster | Not significant | +----------------------------------+---------------+----------------------------+--------------+-------------------------+ | dask | 568 ms | 566 ms | 1.00x faster | Not significant | +----------------------------------+---------------+----------------------------+--------------+-------------------------+ | deepcopy | 666 us | 675 us | 1.01x slower | Not significant | +----------------------------------+---------------+----------------------------+--------------+-------------------------+ | deepcopy_memo | 74.1 us | 71.8 us | 1.03x faster | Significant (t=23.75) | +----------------------------------+---------------+----------------------------+--------------+-------------------------+ | deepcopy_reduce | 6.01 us | 6.13 us | 1.02x slower | Significant (t=-11.42) | +----------------------------------+---------------+----------------------------+--------------+-------------------------+ | deltablue | 6.08 ms | 5.92 ms | 1.03x faster | Significant (t=5.27) | +----------------------------------+---------------+----------------------------+--------------+-------------------------+ | django_template | 65.6 ms | 65.5 ms | 1.00x faster | Not significant | +----------------------------------+---------------+----------------------------+--------------+-------------------------+ | docutils | 4.75 sec | 4.62 sec | 1.03x faster | Significant (t=12.66) | +----------------------------------+---------------+----------------------------+--------------+-------------------------+ | dulwich_log | 143 ms | 143 ms | 1.00x slower | Not significant | +----------------------------------+---------------+----------------------------+--------------+-------------------------+ | fannkuch | 716 ms | 717 ms | 1.00x slower | Not significant | +----------------------------------+---------------+----------------------------+--------------+-------------------------+ | float | 148 ms | 148 ms | 1.00x faster | Not significant | +----------------------------------+---------------+----------------------------+--------------+-------------------------+ | gc_traversal | 5.64 ms | 5.64 ms | 1.00x faster | Not significant | +----------------------------------+---------------+----------------------------+--------------+-------------------------+ | generators | 52.2 ms | 65.8 ms | 1.26x slower | Significant (t=-256.14) | +----------------------------------+---------------+----------------------------+--------------+-------------------------+ | genshi_text | 42.1 ms | 42.3 ms | 1.01x slower | Not significant | +----------------------------------+---------------+----------------------------+--------------+-------------------------+ | genshi_xml | 94.9 ms | 91.6 ms | 1.04x faster | Significant (t=10.52) | +----------------------------------+---------------+----------------------------+--------------+-------------------------+ | go | 239 ms | 237 ms | 1.01x faster | Not significant | +----------------------------------+---------------+----------------------------+--------------+-------------------------+ | hexiom | 10.6 ms | 10.7 ms | 1.01x slower | Not significant | +----------------------------------+---------------+----------------------------+--------------+-------------------------+ | html5lib | 112 ms | 111 ms | 1.01x faster | Not significant | +----------------------------------+---------------+----------------------------+--------------+-------------------------+ | json_dumps | 19.1 ms | 19.1 ms | 1.00x faster | Not significant | +----------------------------------+---------------+----------------------------+--------------+-------------------------+ | json_loads | 49.6 us | 46.7 us | 1.06x faster | Significant (t=8.68) | +----------------------------------+---------------+----------------------------+--------------+-------------------------+ | logging_format | 13.0 us | 13.1 us | 1.01x slower | Not significant | +----------------------------------+---------------+----------------------------+--------------+-------------------------+ | logging_silent | 198 ns | 190 ns | 1.04x faster | Significant (t=59.33) | +----------------------------------+---------------+----------------------------+--------------+-------------------------+ | logging_simple | 11.6 us | 11.8 us | 1.01x slower | Not significant | +----------------------------------+---------------+----------------------------+--------------+-------------------------+ | mako | 19.1 ms | 19.1 ms | 1.00x slower | Not significant | +----------------------------------+---------------+----------------------------+--------------+-------------------------+ | mdp | 4.78 sec | 4.75 sec | 1.01x faster | Not significant | +----------------------------------+---------------+----------------------------+--------------+-------------------------+ | meteor_contest | 191 ms | 190 ms | 1.01x faster | Not significant | +----------------------------------+---------------+----------------------------+--------------+-------------------------+ | nbody | 180 ms | 178 ms | 1.01x faster | Not significant | +----------------------------------+---------------+----------------------------+--------------+-------------------------+ | nqueens | 156 ms | 158 ms | 1.01x slower | Not significant | +----------------------------------+---------------+----------------------------+--------------+-------------------------+ | pathlib | 34.0 ms | 34.2 ms | 1.01x slower | Not significant | +----------------------------------+---------------+----------------------------+--------------+-------------------------+ | pickle | 17.3 us | 17.1 us | 1.01x faster | Not significant | +----------------------------------+---------------+----------------------------+--------------+-------------------------+ | pickle_dict | 47.2 us | 47.2 us | 1.00x faster | Not significant | +----------------------------------+---------------+----------------------------+--------------+-------------------------+ | pickle_list | 7.38 us | 7.24 us | 1.02x faster | Not significant | +----------------------------------+---------------+----------------------------+--------------+-------------------------+ | pickle_pure_python | 554 us | 550 us | 1.01x faster | Not significant | +----------------------------------+---------------+----------------------------+--------------+-------------------------+ | pidigits | 310 ms | 310 ms | 1.00x slower | Not significant | +----------------------------------+---------------+----------------------------+--------------+-------------------------+ | pprint_pformat | 2.85 sec | 2.81 sec | 1.02x faster | Not significant | +----------------------------------+---------------+----------------------------+--------------+-------------------------+ | pprint_safe_repr | 1.40 sec | 1.37 sec | 1.02x faster | Not significant | +----------------------------------+---------------+----------------------------+--------------+-------------------------+ | pyflate | 757 ms | 752 ms | 1.01x faster | Not significant | +----------------------------------+---------------+----------------------------+--------------+-------------------------+ | python_startup | 16.4 ms | 16.4 ms | 1.00x slower | Not significant | +----------------------------------+---------------+----------------------------+--------------+-------------------------+ | python_startup_no_site | 11.4 ms | 11.4 ms | 1.00x slower | Not significant | +----------------------------------+---------------+----------------------------+--------------+-------------------------+ | raytrace | 566 ms | 562 ms | 1.01x faster | Not significant | +----------------------------------+---------------+----------------------------+--------------+-------------------------+ | regex_compile | 275 ms | 263 ms | 1.05x faster | Significant (t=10.49) | +----------------------------------+---------------+----------------------------+--------------+-------------------------+ | regex_dna | 318 ms | 323 ms | 1.01x slower | Not significant | +----------------------------------+---------------+----------------------------+--------------+-------------------------+ | regex_effbot | 5.79 ms | 5.79 ms | 1.00x slower | Not significant | +----------------------------------+---------------+----------------------------+--------------+-------------------------+ | regex_v8 | 39.1 ms | 37.4 ms | 1.05x faster | Significant (t=29.05) | +----------------------------------+---------------+----------------------------+--------------+-------------------------+ | richards | 76.7 ms | 78.3 ms | 1.02x slower | Significant (t=-3.66) | +----------------------------------+---------------+----------------------------+--------------+-------------------------+ | richards_super | 86.9 ms | 87.9 ms | 1.01x slower | Not significant | +----------------------------------+---------------+----------------------------+--------------+-------------------------+ | scimark_fft | 684 ms | 674 ms | 1.01x faster | Not significant | +----------------------------------+---------------+----------------------------+--------------+-------------------------+ | scimark_lu | 213 ms | 217 ms | 1.02x slower | Not significant | +----------------------------------+---------------+----------------------------+--------------+-------------------------+ | scimark_monte_carlo | 131 ms | 131 ms | 1.00x faster | Not significant | +----------------------------------+---------------+----------------------------+--------------+-------------------------+ | scimark_sor | 233 ms | 232 ms | 1.00x faster | Not significant | +----------------------------------+---------------+----------------------------+--------------+-------------------------+ | scimark_sparse_mat_mult | 8.26 ms | 8.38 ms | 1.01x slower | Not significant | +----------------------------------+---------------+----------------------------+--------------+-------------------------+ | spectral_norm | 200 ms | 203 ms | 1.01x slower | Not significant | +----------------------------------+---------------+----------------------------+--------------+-------------------------+ | sqlalchemy_declarative | 260 ms | 258 ms | 1.01x faster | Not significant | +----------------------------------+---------------+----------------------------+--------------+-------------------------+ | sqlalchemy_imperative | 40.7 ms | 40.8 ms | 1.00x slower | Not significant | +----------------------------------+---------------+----------------------------+--------------+-------------------------+ | sqlglot_normalize | 209 ms | 210 ms | 1.00x slower | Not significant | +----------------------------------+---------------+----------------------------+--------------+-------------------------+ | sqlglot_optimize | 104 ms | 104 ms | 1.00x faster | Not significant | +----------------------------------+---------------+----------------------------+--------------+-------------------------+ | sqlglot_parse | 2.41 ms | 2.35 ms | 1.03x faster | Significant (t=8.01) | +----------------------------------+---------------+----------------------------+--------------+-------------------------+ | sqlglot_transpile | 2.92 ms | 2.90 ms | 1.01x faster | Not significant | +----------------------------------+---------------+----------------------------+--------------+-------------------------+ | sqlite_synth | 4.62 us | 4.45 us | 1.04x faster | Significant (t=3.24) | +----------------------------------+---------------+----------------------------+--------------+-------------------------+ | sympy_expand | 881 ms | 886 ms | 1.01x slower | Not significant | +----------------------------------+---------------+----------------------------+--------------+-------------------------+ | sympy_integrate | 37.6 ms | 37.7 ms | 1.00x slower | Not significant | +----------------------------------+---------------+----------------------------+--------------+-------------------------+ | sympy_str | 544 ms | 551 ms | 1.01x slower | Not significant | +----------------------------------+---------------+----------------------------+--------------+-------------------------+ | sympy_sum | 310 ms | 308 ms | 1.01x faster | Not significant | +----------------------------------+---------------+----------------------------+--------------+-------------------------+ | telco | 14.0 ms | 14.1 ms | 1.01x slower | Not significant | +----------------------------------+---------------+----------------------------+--------------+-------------------------+ | tomli_loads | 3.86 sec | 3.82 sec | 1.01x faster | Not significant | +----------------------------------+---------------+----------------------------+--------------+-------------------------+ | tornado_http | 209 ms | 207 ms | 1.01x faster | Not significant | +----------------------------------+---------------+----------------------------+--------------+-------------------------+ | typing_runtime_protocols | 321 us | 319 us | 1.01x faster | Not significant | +----------------------------------+---------------+----------------------------+--------------+-------------------------+ | unpack_sequence | 66.0 ns | 80.6 ns | 1.22x slower | Significant (t=-553.33) | +----------------------------------+---------------+----------------------------+--------------+-------------------------+ | unpickle | 26.7 us | 26.9 us | 1.01x slower | Not significant | +----------------------------------+---------------+----------------------------+--------------+-------------------------+ | unpickle_list | 9.46 us | 9.48 us | 1.00x slower | Not significant | +----------------------------------+---------------+----------------------------+--------------+-------------------------+ | unpickle_pure_python | 409 us | 393 us | 1.04x faster | Significant (t=9.65) | +----------------------------------+---------------+----------------------------+--------------+-------------------------+ | xml_etree_generate | 166 ms | 164 ms | 1.01x faster | Not significant | +----------------------------------+---------------+----------------------------+--------------+-------------------------+ | xml_etree_iterparse | 201 ms | 199 ms | 1.01x faster | Not significant | +----------------------------------+---------------+----------------------------+--------------+-------------------------+ | xml_etree_parse | 304 ms | 288 ms | 1.05x faster | Significant (t=9.29) | +----------------------------------+---------------+----------------------------+--------------+-------------------------+ | xml_etree_process | 111 ms | 110 ms | 1.01x faster | Not significant | +----------------------------------+---------------+----------------------------+--------------+-------------------------+