Skip to content

Latest commit

 

History

History
226 lines (203 loc) · 46.4 KB

bm-20240615-darwin-arm64-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26-vs-base.md

File metadata and controls

226 lines (203 loc) · 46.4 KB

Results vs. base

  • fork: python
  • ref: a19bb261a327e1008f21
  • machine: darwin-arm64
  • commit hash: a19bb26
  • commit date: 2024-06-15
  • overall geometric mean: 1.13x slower
  • HPT reliability: 100.00%
  • HPT 99th percentile: 1.06x slower
  • Memory change: 1.02x

Benchmarks with tag 'apps':

Benchmark results/bm-20240615-3.13.0b2+-a19bb26/bm-20240615-darwin-arm64-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26.json results/bm-20240615-3.13.0b2+-a19bb26-PYTHON_UOPS/bm-20240615-darwin-arm64-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26.json
2to3 160 ms 183 ms: 1.14x slower
chameleon 4.33 ms 4.92 ms: 1.14x slower
docutils 1.44 sec 1.67 sec: 1.16x slower
html5lib 31.2 ms 33.2 ms: 1.07x slower
tornado_http 66.6 ms 70.9 ms: 1.06x slower
Geometric mean (ref) 1.11x slower

Benchmarks with tag 'asyncio':

Benchmark results/bm-20240615-3.13.0b2+-a19bb26/bm-20240615-darwin-arm64-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26.json results/bm-20240615-3.13.0b2+-a19bb26-PYTHON_UOPS/bm-20240615-darwin-arm64-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26.json
async_tree_eager_cpu_io_mixed_tg 331 ms 335 ms: 1.01x slower
async_tree_eager_cpu_io_mixed 359 ms 367 ms: 1.02x slower
async_tree_eager_memoization_tg 126 ms 130 ms: 1.03x slower
async_tree_cpu_io_mixed 468 ms 482 ms: 1.03x slower
async_tree_io 559 ms 580 ms: 1.04x slower
async_tree_none_tg 198 ms 209 ms: 1.05x slower
async_tree_none 209 ms 223 ms: 1.07x slower
async_tree_memoization 260 ms 277 ms: 1.07x slower
async_tree_eager_tg 41.3 ms 44.4 ms: 1.08x slower
async_tree_memoization_tg 240 ms 262 ms: 1.09x slower
async_tree_eager 60.2 ms 68.0 ms: 1.13x slower
Geometric mean (ref) 1.04x slower

Benchmark hidden because not significant (5): async_tree_io_tg, async_tree_eager_io, async_tree_cpu_io_mixed_tg, async_tree_eager_io_tg, async_tree_eager_memoization

Benchmarks with tag 'math':

Benchmark results/bm-20240615-3.13.0b2+-a19bb26/bm-20240615-darwin-arm64-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26.json results/bm-20240615-3.13.0b2+-a19bb26-PYTHON_UOPS/bm-20240615-darwin-arm64-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26.json
pidigits 282 ms 283 ms: 1.00x slower
float 48.5 ms 60.5 ms: 1.25x slower
nbody 59.7 ms 76.4 ms: 1.28x slower
Geometric mean (ref) 1.17x slower

Benchmarks with tag 'regex':

Benchmark results/bm-20240615-3.13.0b2+-a19bb26/bm-20240615-darwin-arm64-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26.json results/bm-20240615-3.13.0b2+-a19bb26-PYTHON_UOPS/bm-20240615-darwin-arm64-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26.json
regex_effbot 2.58 ms 2.56 ms: 1.01x faster
regex_dna 150 ms 149 ms: 1.00x faster
regex_v8 17.2 ms 17.5 ms: 1.02x slower
regex_compile 68.4 ms 96.3 ms: 1.41x slower
Geometric mean (ref) 1.09x slower

Benchmarks with tag 'serialize':

Benchmark results/bm-20240615-3.13.0b2+-a19bb26/bm-20240615-darwin-arm64-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26.json results/bm-20240615-3.13.0b2+-a19bb26-PYTHON_UOPS/bm-20240615-darwin-arm64-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26.json
unpickle_list 2.91 us 2.89 us: 1.01x faster
pickle_dict 18.3 us 18.4 us: 1.00x slower
pickle 7.49 us 7.53 us: 1.01x slower
unpickle 9.21 us 9.30 us: 1.01x slower
json_dumps 6.18 ms 6.48 ms: 1.05x slower
xml_etree_parse 102 ms 108 ms: 1.05x slower
xml_etree_iterparse 71.9 ms 77.2 ms: 1.07x slower
tomli_loads 1.48 sec 1.62 sec: 1.09x slower
xml_etree_process 36.9 ms 41.0 ms: 1.11x slower
xml_etree_generate 52.9 ms 59.0 ms: 1.12x slower
unpickle_pure_python 140 us 175 us: 1.25x slower
pickle_pure_python 179 us 227 us: 1.27x slower
Geometric mean (ref) 1.07x slower

Benchmark hidden because not significant (2): pickle_list, json_loads

Benchmarks with tag 'startup':

Benchmark results/bm-20240615-3.13.0b2+-a19bb26/bm-20240615-darwin-arm64-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26.json results/bm-20240615-3.13.0b2+-a19bb26-PYTHON_UOPS/bm-20240615-darwin-arm64-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26.json
python_startup 15.0 ms 15.2 ms: 1.01x slower
python_startup_no_site 12.2 ms 12.4 ms: 1.01x slower
Geometric mean (ref) 1.01x slower

Benchmarks with tag 'template':

Benchmark results/bm-20240615-3.13.0b2+-a19bb26/bm-20240615-darwin-arm64-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26.json results/bm-20240615-3.13.0b2+-a19bb26-PYTHON_UOPS/bm-20240615-darwin-arm64-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26.json
genshi_xml 29.7 ms 35.9 ms: 1.21x slower
django_template 19.5 ms 23.7 ms: 1.22x slower
genshi_text 14.0 ms 17.3 ms: 1.24x slower
mako 6.95 ms 8.82 ms: 1.27x slower
Geometric mean (ref) 1.23x slower

All benchmarks:

Benchmark results/bm-20240615-3.13.0b2+-a19bb26/bm-20240615-darwin-arm64-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26.json results/bm-20240615-3.13.0b2+-a19bb26-PYTHON_UOPS/bm-20240615-darwin-arm64-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26.json
asyncio_tcp 441 ms 416 ms: 1.06x faster
unpickle_list 2.91 us 2.89 us: 1.01x faster
regex_effbot 2.58 ms 2.56 ms: 1.01x faster
coverage 45.7 ms 45.5 ms: 1.00x faster
regex_dna 150 ms 149 ms: 1.00x faster
pickle_dict 18.3 us 18.4 us: 1.00x slower
gc_traversal 2.46 ms 2.47 ms: 1.00x slower
pidigits 282 ms 283 ms: 1.00x slower
pickle 7.49 us 7.53 us: 1.01x slower
asyncio_tcp_ssl 1.28 sec 1.29 sec: 1.01x slower
unpickle 9.21 us 9.30 us: 1.01x slower
async_tree_eager_cpu_io_mixed_tg 331 ms 335 ms: 1.01x slower
python_startup 15.0 ms 15.2 ms: 1.01x slower
python_startup_no_site 12.2 ms 12.4 ms: 1.01x slower
regex_v8 17.2 ms 17.5 ms: 1.02x slower
create_gc_cycles 900 us 915 us: 1.02x slower
async_tree_eager_cpu_io_mixed 359 ms 367 ms: 1.02x slower
pathlib 23.5 ms 24.1 ms: 1.02x slower
async_tree_eager_memoization_tg 126 ms 130 ms: 1.03x slower
flaskblogging 3.49 ms 3.59 ms: 1.03x slower
bench_mp_pool 47.3 ms 48.5 ms: 1.03x slower
thrift 432 us 445 us: 1.03x slower
async_tree_cpu_io_mixed 468 ms 482 ms: 1.03x slower
json 2.92 ms 3.02 ms: 1.03x slower
logging_simple 3.06 us 3.16 us: 1.03x slower
coroutines 15.9 ms 16.4 ms: 1.04x slower
logging_format 3.35 us 3.47 us: 1.04x slower
async_tree_io 559 ms 580 ms: 1.04x slower
generators 22.8 ms 23.8 ms: 1.05x slower
dask 219 ms 229 ms: 1.05x slower
async_generators 284 ms 298 ms: 1.05x slower
json_dumps 6.18 ms 6.48 ms: 1.05x slower
xml_etree_parse 102 ms 108 ms: 1.05x slower
async_tree_none_tg 198 ms 209 ms: 1.05x slower
sqlite_synth 1.54 us 1.63 us: 1.06x slower
tornado_http 66.6 ms 70.9 ms: 1.06x slower
html5lib 31.2 ms 33.2 ms: 1.07x slower
async_tree_none 209 ms 223 ms: 1.07x slower
telco 4.60 ms 4.91 ms: 1.07x slower
async_tree_memoization 260 ms 277 ms: 1.07x slower
dulwich_log 27.5 ms 29.5 ms: 1.07x slower
xml_etree_iterparse 71.9 ms 77.2 ms: 1.07x slower
async_tree_eager_tg 41.3 ms 44.4 ms: 1.08x slower
aiohttp 1.03 ms 1.12 ms: 1.09x slower
async_tree_memoization_tg 240 ms 262 ms: 1.09x slower
tomli_loads 1.48 sec 1.62 sec: 1.09x slower
mdp 1.42 sec 1.55 sec: 1.10x slower
xml_etree_process 36.9 ms 41.0 ms: 1.11x slower
xml_etree_generate 52.9 ms 59.0 ms: 1.12x slower
meteor_contest 70.2 ms 78.9 ms: 1.12x slower
async_tree_eager 60.2 ms 68.0 ms: 1.13x slower
scimark_sor 95.4 ms 108 ms: 1.13x slower
bench_thread_pool 458 us 518 us: 1.13x slower
chameleon 4.33 ms 4.92 ms: 1.14x slower
2to3 160 ms 183 ms: 1.14x slower
bpe_tokeniser 3.06 sec 3.49 sec: 1.14x slower
mypy2 381 ms 435 ms: 1.14x slower
gunicorn 1.04 ms 1.19 ms: 1.15x slower
pycparser 631 ms 726 ms: 1.15x slower
richards_super 35.1 ms 40.5 ms: 1.15x slower
docutils 1.44 sec 1.67 sec: 1.16x slower
sympy_expand 226 ms 264 ms: 1.17x slower
pylint 170 ms 198 ms: 1.17x slower
richards 31.8 ms 37.2 ms: 1.17x slower
deepcopy_reduce 1.81 us 2.12 us: 1.17x slower
go 100 ms 118 ms: 1.17x slower
typing_runtime_protocols 88.7 us 106 us: 1.19x slower
sqlglot_optimize 30.9 ms 36.9 ms: 1.20x slower
raytrace 147 ms 178 ms: 1.21x slower
genshi_xml 29.7 ms 35.9 ms: 1.21x slower
django_template 19.5 ms 23.7 ms: 1.22x slower
sympy_integrate 10.3 ms 12.6 ms: 1.22x slower
crypto_pyaes 49.6 ms 60.7 ms: 1.22x slower
fannkuch 251 ms 308 ms: 1.23x slower
scimark_fft 181 ms 223 ms: 1.23x slower
deepcopy 203 us 250 us: 1.23x slower
pyflate 322 ms 397 ms: 1.23x slower
genshi_text 14.0 ms 17.3 ms: 1.24x slower
sympy_str 132 ms 163 ms: 1.24x slower
pprint_pformat 949 ms 1.17 sec: 1.24x slower
pprint_safe_repr 465 ms 576 ms: 1.24x slower
sympy_sum 69.3 ms 85.8 ms: 1.24x slower
float 48.5 ms 60.5 ms: 1.25x slower
unpickle_pure_python 140 us 175 us: 1.25x slower
mako 6.95 ms 8.82 ms: 1.27x slower
pickle_pure_python 179 us 227 us: 1.27x slower
nbody 59.7 ms 76.4 ms: 1.28x slower
sqlglot_transpile 888 us 1.15 ms: 1.29x slower
sqlglot_parse 731 us 946 us: 1.29x slower
nqueens 52.6 ms 68.2 ms: 1.30x slower
chaos 34.8 ms 46.5 ms: 1.34x slower
deltablue 2.15 ms 2.94 ms: 1.37x slower
scimark_sparse_mat_mult 2.78 ms 3.87 ms: 1.39x slower
regex_compile 68.4 ms 96.3 ms: 1.41x slower
spectral_norm 66.5 ms 93.9 ms: 1.41x slower
scimark_monte_carlo 42.4 ms 60.6 ms: 1.43x slower
deepcopy_memo 22.7 us 32.7 us: 1.44x slower
hexiom 4.08 ms 5.94 ms: 1.46x slower
scimark_lu 66.7 ms 98.3 ms: 1.47x slower
logging_silent 60.3 ns 93.9 ns: 1.56x slower
comprehensions 10.2 us 17.2 us: 1.69x slower
Geometric mean (ref) 1.13x slower

Benchmark hidden because not significant (8): async_tree_io_tg, pickle_list, json_loads, asyncio_websockets, async_tree_eager_io, async_tree_cpu_io_mixed_tg, async_tree_eager_io_tg, async_tree_eager_memoization Ignored benchmarks (1) of results/bm-20240615-3.13.0b2+-a19bb26/bm-20240615-darwin-arm64-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26.json: sqlglot_normalize

HPT report

  • Reliability score: 100.00% likely to be slow
  • 90% likely to have a slowdown of 1.08x
  • 95% likely to have a slowdown of 1.07x
  • 99% likely to have a slowdown of 1.06x

Memory

  • memory change: 1.02x