harness:full_quick:cpython-system:small

finished · cpython-system

← All campaigns

Campaign Summary

ID: b0a9468e16ca485f9f3c1f39

Started: 2026-07-18 21:43:47.708913
Finished: 2026-07-18 21:43:54.568591
Duration: 6.9s

11
Workloads
66
Cases
66
Passed
0
Failed
0
Mismatches

Campaign Chart

Campaign summary chart

Workload Results

core.integer_sum

0.3146
cold mean ms
0.2110
warm mean ms
0.1918
warm median ms
0.0472
warm stdev ms
100%
success rate
0
mismatches
Comparison chart for core.integer_sum

core.float_reduction

0.3038
cold mean ms
0.3151
warm mean ms
0.3037
warm median ms
0.0389
warm stdev ms
100%
success rate
0
mismatches
Comparison chart for core.float_reduction

core.list_filter

0.0495
cold mean ms
0.0306
warm mean ms
0.0251
warm median ms
0.0083
warm stdev ms
100%
success rate
0
mismatches
Comparison chart for core.list_filter

numerical.dot_product

0.0764
cold mean ms
0.0610
warm mean ms
0.0461
warm median ms
0.0213
warm stdev ms
100%
success rate
0
mismatches
Comparison chart for numerical.dot_product

numerical.matrix_multiply

7.5181
cold mean ms
5.0828
warm mean ms
5.0658
warm median ms
0.1042
warm stdev ms
100%
success rate
0
mismatches
Comparison chart for numerical.matrix_multiply

numerical.monte_carlo_pi

0.9027
cold mean ms
0.9927
warm mean ms
0.9231
warm median ms
0.2059
warm stdev ms
100%
success rate
0
mismatches
Comparison chart for numerical.monte_carlo_pi

numerical.prime_sieve

0.3139
cold mean ms
0.3042
warm mean ms
0.2763
warm median ms
0.0715
warm stdev ms
100%
success rate
0
mismatches
Comparison chart for numerical.prime_sieve

data_processing.csv_parse

0.2454
cold mean ms
0.2333
warm mean ms
0.2144
warm median ms
0.0444
warm stdev ms
100%
success rate
0
mismatches
Comparison chart for data_processing.csv_parse

iot.rolling_average

0.3222
cold mean ms
0.2177
warm mean ms
0.1827
warm median ms
0.0573
warm stdev ms
100%
success rate
0
mismatches
Comparison chart for iot.rolling_average

stdlib.json_parse

0.9624
cold mean ms
0.4776
warm mean ms
0.4139
warm median ms
0.1505
warm stdev ms
100%
success rate
0
mismatches
Comparison chart for stdlib.json_parse

stdlib.dict_lookup

0.0940
cold mean ms
0.0719
warm mean ms
0.0586
warm median ms
0.0231
warm stdev ms
100%
success rate
0
mismatches
Comparison chart for stdlib.dict_lookup

Case Runs

Workload Phase Status Correctness Mean ms Duration
core.float_reduction cold success match 0.3038 0.00s
core.float_reduction warm success match 0.3773 0.00s
core.float_reduction warm success match 0.3256 0.00s
core.float_reduction warm success match 0.2915 0.00s
core.float_reduction warm success match 0.3037 0.00s
core.float_reduction warm success match 0.2777 0.00s
core.integer_sum cold success match 0.3146 0.00s
core.integer_sum warm success match 0.1946 0.00s
core.integer_sum warm success match 0.1832 0.00s
core.integer_sum warm success match 0.1901 0.00s
core.integer_sum warm success match 0.2951 0.00s
core.integer_sum warm success match 0.1918 0.00s
core.list_filter cold success match 0.0495 0.00s
core.list_filter warm success match 0.0249 0.00s
core.list_filter warm success match 0.0251 0.00s
core.list_filter warm success match 0.0397 0.00s
core.list_filter warm success match 0.0236 0.00s
core.list_filter warm success match 0.0396 0.00s
data_processing.csv_parse cold success match 0.2454 0.00s
data_processing.csv_parse warm success match 0.2205 0.00s
data_processing.csv_parse warm success match 0.2060 0.00s
data_processing.csv_parse warm success match 0.3121 0.00s
data_processing.csv_parse warm success match 0.2133 0.00s
data_processing.csv_parse warm success match 0.2144 0.00s
iot.rolling_average cold success match 0.3222 0.00s
iot.rolling_average warm success match 0.1827 0.00s
iot.rolling_average warm success match 0.1742 0.00s
iot.rolling_average warm success match 0.2748 0.00s
iot.rolling_average warm success match 0.1713 0.00s
iot.rolling_average warm success match 0.2856 0.00s
numerical.dot_product cold success match 0.0764 0.00s
numerical.dot_product warm success match 0.0843 0.00s
numerical.dot_product warm success match 0.0452 0.00s
numerical.dot_product warm success match 0.0461 0.00s
numerical.dot_product warm success match 0.0453 0.00s
numerical.dot_product warm success match 0.0843 0.00s
numerical.matrix_multiply cold success match 7.5181 0.00s
numerical.matrix_multiply warm success match 4.9396 0.00s
numerical.matrix_multiply warm success match 5.0469 0.00s
numerical.matrix_multiply warm success match 5.1482 0.00s
numerical.matrix_multiply warm success match 5.2136 0.00s
numerical.matrix_multiply warm success match 5.0658 0.00s
numerical.monte_carlo_pi cold success match 0.9027 0.00s
numerical.monte_carlo_pi warm success match 0.9661 0.00s
numerical.monte_carlo_pi warm success match 1.3523 0.00s
numerical.monte_carlo_pi warm success match 0.9231 0.00s
numerical.monte_carlo_pi warm success match 0.8554 0.00s
numerical.monte_carlo_pi warm success match 0.8667 0.00s
numerical.prime_sieve cold success match 0.3139 0.00s
numerical.prime_sieve warm success match 0.2421 0.00s
numerical.prime_sieve warm success match 0.2763 0.00s
numerical.prime_sieve warm success match 0.3248 0.00s
numerical.prime_sieve warm success match 0.2585 0.00s
numerical.prime_sieve warm success match 0.4194 0.00s
stdlib.dict_lookup cold success match 0.0940 0.00s
stdlib.dict_lookup warm success match 0.0554 0.00s
stdlib.dict_lookup warm success match 0.0586 0.00s
stdlib.dict_lookup warm success match 0.0516 0.00s
stdlib.dict_lookup warm success match 0.1000 0.00s
stdlib.dict_lookup warm success match 0.0940 0.00s
stdlib.json_parse cold success match 0.9624 0.00s
stdlib.json_parse warm success match 0.4139 0.00s
stdlib.json_parse warm success match 0.3593 0.00s
stdlib.json_parse warm success match 0.5364 0.00s
stdlib.json_parse warm success match 0.7146 0.00s
stdlib.json_parse warm success match 0.3641 0.00s

Proof Packs

📦
Proof pack for stdlib.dict_lookup on cpython-system
/var/www/pyvorin-bench/data/proofpacks/b0a9468e16ca485f9f3c1f39/4497e7ad90234c81b07a8ac5
📦
Proof pack for stdlib.dict_lookup on cpython-system
/var/www/pyvorin-bench/data/proofpacks/b0a9468e16ca485f9f3c1f39/070d3dcda13a4e63b1c7fe09
📦
Proof pack for stdlib.dict_lookup on cpython-system
/var/www/pyvorin-bench/data/proofpacks/b0a9468e16ca485f9f3c1f39/f26efdd2e9054810a93136ef
📦
Proof pack for stdlib.dict_lookup on cpython-system
/var/www/pyvorin-bench/data/proofpacks/b0a9468e16ca485f9f3c1f39/ccf7d193780646cbb24f05c2
📦
Proof pack for stdlib.dict_lookup on cpython-system
/var/www/pyvorin-bench/data/proofpacks/b0a9468e16ca485f9f3c1f39/bf56213d224d4cd0afe25009
📦
Proof pack for stdlib.dict_lookup on cpython-system
/var/www/pyvorin-bench/data/proofpacks/b0a9468e16ca485f9f3c1f39/85b69eedadd342e095656521
📦
Proof pack for stdlib.json_parse on cpython-system
/var/www/pyvorin-bench/data/proofpacks/b0a9468e16ca485f9f3c1f39/93ed6fe2a54c4b83a14a097a
📦
Proof pack for stdlib.json_parse on cpython-system
/var/www/pyvorin-bench/data/proofpacks/b0a9468e16ca485f9f3c1f39/a5f656b1e8284b408cbcffd4
📦
Proof pack for stdlib.json_parse on cpython-system
/var/www/pyvorin-bench/data/proofpacks/b0a9468e16ca485f9f3c1f39/c4e66dc20f81469d93211e3b
📦
Proof pack for stdlib.json_parse on cpython-system
/var/www/pyvorin-bench/data/proofpacks/b0a9468e16ca485f9f3c1f39/1237a8619ce34ce3b8a0b006
📦
Proof pack for stdlib.json_parse on cpython-system
/var/www/pyvorin-bench/data/proofpacks/b0a9468e16ca485f9f3c1f39/61c5b76a3d4d46ce8d288c30
📦
Proof pack for stdlib.json_parse on cpython-system
/var/www/pyvorin-bench/data/proofpacks/b0a9468e16ca485f9f3c1f39/1481725a6c1b4cb6b3c5cac3
📦
Proof pack for iot.rolling_average on cpython-system
/var/www/pyvorin-bench/data/proofpacks/b0a9468e16ca485f9f3c1f39/746a717d8245430cbc73ee21
📦
Proof pack for iot.rolling_average on cpython-system
/var/www/pyvorin-bench/data/proofpacks/b0a9468e16ca485f9f3c1f39/ee74616cbd2646249e0fda7f
📦
Proof pack for iot.rolling_average on cpython-system
/var/www/pyvorin-bench/data/proofpacks/b0a9468e16ca485f9f3c1f39/9bec7704075e486c834244aa
📦
Proof pack for iot.rolling_average on cpython-system
/var/www/pyvorin-bench/data/proofpacks/b0a9468e16ca485f9f3c1f39/acaf0f0f46734d95b31775dc
📦
Proof pack for iot.rolling_average on cpython-system
/var/www/pyvorin-bench/data/proofpacks/b0a9468e16ca485f9f3c1f39/783cb876c50543ddb1f737da
📦
Proof pack for iot.rolling_average on cpython-system
/var/www/pyvorin-bench/data/proofpacks/b0a9468e16ca485f9f3c1f39/a47b4eeee76649e2aa3b17df
📦
Proof pack for data_processing.csv_parse on cpython-system
/var/www/pyvorin-bench/data/proofpacks/b0a9468e16ca485f9f3c1f39/31118cfd2b7d44b8a36bd7e9
📦
Proof pack for data_processing.csv_parse on cpython-system
/var/www/pyvorin-bench/data/proofpacks/b0a9468e16ca485f9f3c1f39/86c1736c8a574da2b1a51e1e
📦
Proof pack for data_processing.csv_parse on cpython-system
/var/www/pyvorin-bench/data/proofpacks/b0a9468e16ca485f9f3c1f39/968b46ced291437c9d9b613c
📦
Proof pack for data_processing.csv_parse on cpython-system
/var/www/pyvorin-bench/data/proofpacks/b0a9468e16ca485f9f3c1f39/8e203ad0a3684803aabc6841
📦
Proof pack for data_processing.csv_parse on cpython-system
/var/www/pyvorin-bench/data/proofpacks/b0a9468e16ca485f9f3c1f39/c665da68c38d446b9a7566b8
📦
Proof pack for data_processing.csv_parse on cpython-system
/var/www/pyvorin-bench/data/proofpacks/b0a9468e16ca485f9f3c1f39/dc01d5fe31ec455dba2d54b6
📦
Proof pack for numerical.prime_sieve on cpython-system
/var/www/pyvorin-bench/data/proofpacks/b0a9468e16ca485f9f3c1f39/2cb91c40b46c48ea820d1413
📦
Proof pack for numerical.prime_sieve on cpython-system
/var/www/pyvorin-bench/data/proofpacks/b0a9468e16ca485f9f3c1f39/25ae0a06abb940f79f8c5cb0
📦
Proof pack for numerical.prime_sieve on cpython-system
/var/www/pyvorin-bench/data/proofpacks/b0a9468e16ca485f9f3c1f39/71b4e2ae434340b68961f9c4
📦
Proof pack for numerical.prime_sieve on cpython-system
/var/www/pyvorin-bench/data/proofpacks/b0a9468e16ca485f9f3c1f39/2924922ef20844eab3a46d7d
📦
Proof pack for numerical.prime_sieve on cpython-system
/var/www/pyvorin-bench/data/proofpacks/b0a9468e16ca485f9f3c1f39/01d6add1e7054e7cae5a7b89
📦
Proof pack for numerical.prime_sieve on cpython-system
/var/www/pyvorin-bench/data/proofpacks/b0a9468e16ca485f9f3c1f39/4c843674c64846eea7bc24c4
📦
Proof pack for numerical.monte_carlo_pi on cpython-system
/var/www/pyvorin-bench/data/proofpacks/b0a9468e16ca485f9f3c1f39/b496c3a40f65474eae2e8ce3
📦
Proof pack for numerical.monte_carlo_pi on cpython-system
/var/www/pyvorin-bench/data/proofpacks/b0a9468e16ca485f9f3c1f39/8a3d8d5d55e34c838e20f6c3
📦
Proof pack for numerical.monte_carlo_pi on cpython-system
/var/www/pyvorin-bench/data/proofpacks/b0a9468e16ca485f9f3c1f39/784dfe3df2494bc894fd36af
📦
Proof pack for numerical.monte_carlo_pi on cpython-system
/var/www/pyvorin-bench/data/proofpacks/b0a9468e16ca485f9f3c1f39/b97f3008a5094f728504a0dc
📦
Proof pack for numerical.monte_carlo_pi on cpython-system
/var/www/pyvorin-bench/data/proofpacks/b0a9468e16ca485f9f3c1f39/e7502ef087be4145938f0a2b
📦
Proof pack for numerical.monte_carlo_pi on cpython-system
/var/www/pyvorin-bench/data/proofpacks/b0a9468e16ca485f9f3c1f39/0a5c74a1c2ba43ff9090ac00
📦
Proof pack for numerical.matrix_multiply on cpython-system
/var/www/pyvorin-bench/data/proofpacks/b0a9468e16ca485f9f3c1f39/2d2882c9d8074232a6da19f8
📦
Proof pack for numerical.matrix_multiply on cpython-system
/var/www/pyvorin-bench/data/proofpacks/b0a9468e16ca485f9f3c1f39/39b40ccbd4f7432f83d3d1c3
📦
Proof pack for numerical.matrix_multiply on cpython-system
/var/www/pyvorin-bench/data/proofpacks/b0a9468e16ca485f9f3c1f39/d4b0b3cd8df349f6a35ea471
📦
Proof pack for numerical.matrix_multiply on cpython-system
/var/www/pyvorin-bench/data/proofpacks/b0a9468e16ca485f9f3c1f39/dc4c227236524c06a6a29373
📦
Proof pack for numerical.matrix_multiply on cpython-system
/var/www/pyvorin-bench/data/proofpacks/b0a9468e16ca485f9f3c1f39/164ab7358b774de9a397bb75
📦
Proof pack for numerical.matrix_multiply on cpython-system
/var/www/pyvorin-bench/data/proofpacks/b0a9468e16ca485f9f3c1f39/dcbe1a76f0f8471e83d34509
📦
Proof pack for numerical.dot_product on cpython-system
/var/www/pyvorin-bench/data/proofpacks/b0a9468e16ca485f9f3c1f39/adbc882eb5754c1188e89449
📦
Proof pack for numerical.dot_product on cpython-system
/var/www/pyvorin-bench/data/proofpacks/b0a9468e16ca485f9f3c1f39/4da4846e21814b808e617e89
📦
Proof pack for numerical.dot_product on cpython-system
/var/www/pyvorin-bench/data/proofpacks/b0a9468e16ca485f9f3c1f39/153f979cd4074510b2961da5
📦
Proof pack for numerical.dot_product on cpython-system
/var/www/pyvorin-bench/data/proofpacks/b0a9468e16ca485f9f3c1f39/3b6ca0d2f9634bc1b684bd06
📦
Proof pack for numerical.dot_product on cpython-system
/var/www/pyvorin-bench/data/proofpacks/b0a9468e16ca485f9f3c1f39/dcdba966c07040258fb2d3d6
📦
Proof pack for numerical.dot_product on cpython-system
/var/www/pyvorin-bench/data/proofpacks/b0a9468e16ca485f9f3c1f39/bae6456af1af42a8a3377074
📦
Proof pack for core.list_filter on cpython-system
/var/www/pyvorin-bench/data/proofpacks/b0a9468e16ca485f9f3c1f39/54592dd675094b6e8e2723b1
📦
Proof pack for core.list_filter on cpython-system
/var/www/pyvorin-bench/data/proofpacks/b0a9468e16ca485f9f3c1f39/3350f40a0d1a463b9c6f9b59
📦
Proof pack for core.list_filter on cpython-system
/var/www/pyvorin-bench/data/proofpacks/b0a9468e16ca485f9f3c1f39/db1036b4e77243008df9c517
📦
Proof pack for core.list_filter on cpython-system
/var/www/pyvorin-bench/data/proofpacks/b0a9468e16ca485f9f3c1f39/7995018c2fd6483a8fa2552b
📦
Proof pack for core.list_filter on cpython-system
/var/www/pyvorin-bench/data/proofpacks/b0a9468e16ca485f9f3c1f39/0885ceff315e44a181269923
📦
Proof pack for core.list_filter on cpython-system
/var/www/pyvorin-bench/data/proofpacks/b0a9468e16ca485f9f3c1f39/51e0fb0eb39043799bbda2ff
📦
Proof pack for core.float_reduction on cpython-system
/var/www/pyvorin-bench/data/proofpacks/b0a9468e16ca485f9f3c1f39/f236bf15e69f4552b7945b5d
📦
Proof pack for core.float_reduction on cpython-system
/var/www/pyvorin-bench/data/proofpacks/b0a9468e16ca485f9f3c1f39/0c978de6b75548d28dd54aa0
📦
Proof pack for core.float_reduction on cpython-system
/var/www/pyvorin-bench/data/proofpacks/b0a9468e16ca485f9f3c1f39/4e6cfc8ef5b741f8a65a451f
📦
Proof pack for core.float_reduction on cpython-system
/var/www/pyvorin-bench/data/proofpacks/b0a9468e16ca485f9f3c1f39/eda55cf0dd9e417ab6ee9364
📦
Proof pack for core.float_reduction on cpython-system
/var/www/pyvorin-bench/data/proofpacks/b0a9468e16ca485f9f3c1f39/d3510db2ac7c46ae9b23cf48
📦
Proof pack for core.float_reduction on cpython-system
/var/www/pyvorin-bench/data/proofpacks/b0a9468e16ca485f9f3c1f39/1b9415f52c304d7eafb935b2
📦
Proof pack for core.integer_sum on cpython-system
/var/www/pyvorin-bench/data/proofpacks/b0a9468e16ca485f9f3c1f39/d430344d038641dc9a154d00
📦
Proof pack for core.integer_sum on cpython-system
/var/www/pyvorin-bench/data/proofpacks/b0a9468e16ca485f9f3c1f39/dff97caf22e54fcf86168962
📦
Proof pack for core.integer_sum on cpython-system
/var/www/pyvorin-bench/data/proofpacks/b0a9468e16ca485f9f3c1f39/bf41a1cb0ece4e7a8ed0b230
📦
Proof pack for core.integer_sum on cpython-system
/var/www/pyvorin-bench/data/proofpacks/b0a9468e16ca485f9f3c1f39/88583825388541ffb6e8e55a
📦
Proof pack for core.integer_sum on cpython-system
/var/www/pyvorin-bench/data/proofpacks/b0a9468e16ca485f9f3c1f39/f4ddf52fbdcd4a6eac2358bb
📦
Proof pack for core.integer_sum on cpython-system
/var/www/pyvorin-bench/data/proofpacks/b0a9468e16ca485f9f3c1f39/45388c720f104bf9a034e734

← Back to campaigns