harness:full_quick:pyvorin-project-venv:small

finished · pyvorin-project-venv

← All campaigns

Campaign Summary

ID: 14823af95e7749a1a313aca6

Started: 2026-07-18 21:43:54.602860
Finished: 2026-07-18 21:44:42.747534
Duration: 48.1s

11
Workloads
66
Cases
48
Passed
18
Failed
6
Mismatches

Campaign Chart

Campaign summary chart

Workload Results

core.integer_sum

0.0540
cold mean ms
0.0070
warm mean ms
0.0068
warm median ms
0.0010
warm stdev ms
100%
success rate
0
mismatches
Comparison chart for core.integer_sum

core.float_reduction

0.0679
cold mean ms
0.0210
warm mean ms
0.0193
warm median ms
0.0064
warm stdev ms
100%
success rate
0
mismatches
Comparison chart for core.float_reduction

core.list_filter

0.7368
cold mean ms
0.6148
warm mean ms
0.5572
warm median ms
0.1568
warm stdev ms
100%
success rate
0
mismatches
Comparison chart for core.list_filter

numerical.dot_product

0.0645
cold mean ms
0.0485
warm mean ms
0.0502
warm median ms
0.0031
warm stdev ms
100%
success rate
0
mismatches
Comparison chart for numerical.dot_product

numerical.matrix_multiply

0.0000
cold mean ms
0.0000
warm mean ms
0.0000
warm median ms
0.0000
warm stdev ms
0%
success rate
0
mismatches
Comparison chart for numerical.matrix_multiply

numerical.monte_carlo_pi

0.0730
cold mean ms
0.0223
warm mean ms
0.0183
warm median ms
0.0062
warm stdev ms
100%
success rate
0
mismatches
Comparison chart for numerical.monte_carlo_pi

numerical.prime_sieve

0.0000
cold mean ms
0.0000
warm mean ms
0.0000
warm median ms
0.0000
warm stdev ms
0%
success rate
0
mismatches
Comparison chart for numerical.prime_sieve

data_processing.csv_parse

1.1765
cold mean ms
0.1066
warm mean ms
0.1012
warm median ms
0.0200
warm stdev ms
100%
success rate
6
mismatches
Comparison chart for data_processing.csv_parse

iot.rolling_average

0.0000
cold mean ms
0.0000
warm mean ms
0.0000
warm median ms
0.0000
warm stdev ms
0%
success rate
0
mismatches
Comparison chart for iot.rolling_average

stdlib.json_parse

1.5654
cold mean ms
2.7445
warm mean ms
2.7199
warm median ms
0.1082
warm stdev ms
100%
success rate
0
mismatches
Comparison chart for stdlib.json_parse

stdlib.dict_lookup

0.0725
cold mean ms
0.0776
warm mean ms
0.0664
warm median ms
0.0255
warm stdev ms
100%
success rate
0
mismatches
Comparison chart for stdlib.dict_lookup

Case Runs

Workload Phase Status Correctness Mean ms Duration
core.float_reduction cold success match 0.0679 0.00s
core.float_reduction warm success match 0.0166 0.00s
core.float_reduction warm success match 0.0166 0.00s
core.float_reduction warm success match 0.0203 0.00s
core.float_reduction warm success match 0.0193 0.00s
core.float_reduction warm success match 0.0321 0.00s
core.integer_sum cold success match 0.0540 0.00s
core.integer_sum warm success match 0.0065 0.00s
core.integer_sum warm success match 0.0068 0.00s
core.integer_sum warm success match 0.0087 0.00s
core.integer_sum warm success match 0.0068 0.00s
core.integer_sum warm success match 0.0062 0.00s
core.list_filter cold success match 0.7368 0.00s
core.list_filter warm success match 0.5601 0.00s
core.list_filter warm success match 0.5321 0.00s
core.list_filter warm success match 0.5572 0.00s
core.list_filter warm success match 0.5304 0.00s
core.list_filter warm success match 0.8942 0.00s
data_processing.csv_parse cold success mismatch 1.1765 0.00s
data_processing.csv_parse warm success mismatch 0.1289 0.00s
data_processing.csv_parse warm success mismatch 0.1012 0.00s
data_processing.csv_parse warm success mismatch 0.0866 0.00s
data_processing.csv_parse warm success mismatch 0.0900 0.00s
data_processing.csv_parse warm success mismatch 0.1264 0.00s
iot.rolling_average cold failed no_result n/a 0.00s
iot.rolling_average warm failed no_result n/a 0.00s
iot.rolling_average warm failed no_result n/a 0.00s
iot.rolling_average warm failed no_result n/a 0.00s
iot.rolling_average warm failed no_result n/a 0.00s
iot.rolling_average warm failed no_result n/a 0.00s
numerical.dot_product cold success match 0.0645 0.00s
numerical.dot_product warm success match 0.0502 0.00s
numerical.dot_product warm success match 0.0449 0.00s
numerical.dot_product warm success match 0.0502 0.00s
numerical.dot_product warm success match 0.0454 0.00s
numerical.dot_product warm success match 0.0517 0.00s
numerical.matrix_multiply cold failed no_result n/a 0.00s
numerical.matrix_multiply warm failed no_result n/a 0.00s
numerical.matrix_multiply warm failed no_result n/a 0.00s
numerical.matrix_multiply warm failed no_result n/a 0.00s
numerical.matrix_multiply warm failed no_result n/a 0.00s
numerical.matrix_multiply warm failed no_result n/a 0.00s
numerical.monte_carlo_pi cold success match 0.0730 0.00s
numerical.monte_carlo_pi warm success match 0.0183 0.00s
numerical.monte_carlo_pi warm success match 0.0176 0.00s
numerical.monte_carlo_pi warm success match 0.0175 0.00s
numerical.monte_carlo_pi warm success match 0.0304 0.00s
numerical.monte_carlo_pi warm success match 0.0278 0.00s
numerical.prime_sieve cold failed no_result n/a 0.00s
numerical.prime_sieve warm failed no_result n/a 0.00s
numerical.prime_sieve warm failed no_result n/a 0.00s
numerical.prime_sieve warm failed no_result n/a 0.00s
numerical.prime_sieve warm failed no_result n/a 0.00s
numerical.prime_sieve warm failed no_result n/a 0.00s
stdlib.dict_lookup cold success match 0.0725 0.00s
stdlib.dict_lookup warm success match 0.0566 0.00s
stdlib.dict_lookup warm success match 0.0664 0.00s
stdlib.dict_lookup warm success match 0.1020 0.00s
stdlib.dict_lookup warm success match 0.0549 0.00s
stdlib.dict_lookup warm success match 0.1081 0.00s
stdlib.json_parse cold success match 1.5654 0.00s
stdlib.json_parse warm success match 2.6900 0.00s
stdlib.json_parse warm success match 2.7199 0.00s
stdlib.json_parse warm success match 2.7966 0.00s
stdlib.json_parse warm success match 2.6164 0.00s
stdlib.json_parse warm success match 2.8998 0.00s

Failures

Class Severity Signature Status
compile_error error 3e4968084912d335bc168fc79ce88ac3 open
compile_error error 3e4968084912d335bc168fc79ce88ac3 open
compile_error error 3e4968084912d335bc168fc79ce88ac3 open
compile_error error 3e4968084912d335bc168fc79ce88ac3 open
compile_error error 3e4968084912d335bc168fc79ce88ac3 open
compile_error error 3e4968084912d335bc168fc79ce88ac3 open
correctness_mismatch error eec71191b1a79d065c7b8292395b47df open
correctness_mismatch error eec71191b1a79d065c7b8292395b47df open
correctness_mismatch error eec71191b1a79d065c7b8292395b47df open
correctness_mismatch error eec71191b1a79d065c7b8292395b47df open
correctness_mismatch error eec71191b1a79d065c7b8292395b47df open
correctness_mismatch error eec71191b1a79d065c7b8292395b47df open
compile_error error 3d9b90f21aade38e0b7867479872f121 open
compile_error error 3d9b90f21aade38e0b7867479872f121 open
compile_error error 3d9b90f21aade38e0b7867479872f121 open
compile_error error 3d9b90f21aade38e0b7867479872f121 open
compile_error error 3d9b90f21aade38e0b7867479872f121 open
compile_error error 3d9b90f21aade38e0b7867479872f121 open
runtime_error error 2a9d94bde8830e7de3295d78c980bfa5 open
runtime_error error 2a9d94bde8830e7de3295d78c980bfa5 open
runtime_error error 2a9d94bde8830e7de3295d78c980bfa5 open
runtime_error error 2a9d94bde8830e7de3295d78c980bfa5 open
runtime_error error 2a9d94bde8830e7de3295d78c980bfa5 open
runtime_error error 2a9d94bde8830e7de3295d78c980bfa5 open

Proof Packs

📦
Proof pack for stdlib.dict_lookup on pyvorin-project-venv
/var/www/pyvorin-bench/data/proofpacks/14823af95e7749a1a313aca6/13bb6e4ba87b4d529b354f66
📦
Proof pack for stdlib.dict_lookup on pyvorin-project-venv
/var/www/pyvorin-bench/data/proofpacks/14823af95e7749a1a313aca6/63168aac76f2426b9cbcc888
📦
Proof pack for stdlib.dict_lookup on pyvorin-project-venv
/var/www/pyvorin-bench/data/proofpacks/14823af95e7749a1a313aca6/32a0d498e1284c85b9b68e48
📦
Proof pack for stdlib.dict_lookup on pyvorin-project-venv
/var/www/pyvorin-bench/data/proofpacks/14823af95e7749a1a313aca6/085256ff562e45aa88af4e81
📦
Proof pack for stdlib.dict_lookup on pyvorin-project-venv
/var/www/pyvorin-bench/data/proofpacks/14823af95e7749a1a313aca6/4a3dcf86db8d4b42b2af2652
📦
Proof pack for stdlib.dict_lookup on pyvorin-project-venv
/var/www/pyvorin-bench/data/proofpacks/14823af95e7749a1a313aca6/d5b193ca5e8b4aecaa567237
📦
Proof pack for stdlib.json_parse on pyvorin-project-venv
/var/www/pyvorin-bench/data/proofpacks/14823af95e7749a1a313aca6/eafdaf1af5ec42ffa5b75c06
📦
Proof pack for stdlib.json_parse on pyvorin-project-venv
/var/www/pyvorin-bench/data/proofpacks/14823af95e7749a1a313aca6/b51d1f77edfc48269b722a75
📦
Proof pack for stdlib.json_parse on pyvorin-project-venv
/var/www/pyvorin-bench/data/proofpacks/14823af95e7749a1a313aca6/d6c8f74c8b0c4756a7d33d69
📦
Proof pack for stdlib.json_parse on pyvorin-project-venv
/var/www/pyvorin-bench/data/proofpacks/14823af95e7749a1a313aca6/34d358d028b34977a960c717
📦
Proof pack for stdlib.json_parse on pyvorin-project-venv
/var/www/pyvorin-bench/data/proofpacks/14823af95e7749a1a313aca6/b35cb46d2416418786a36a06
📦
Proof pack for stdlib.json_parse on pyvorin-project-venv
/var/www/pyvorin-bench/data/proofpacks/14823af95e7749a1a313aca6/a6706a822c35466ab260040f
📦
Proof pack for numerical.monte_carlo_pi on pyvorin-project-venv
/var/www/pyvorin-bench/data/proofpacks/14823af95e7749a1a313aca6/9da268ac2876449db7655956
📦
Proof pack for numerical.monte_carlo_pi on pyvorin-project-venv
/var/www/pyvorin-bench/data/proofpacks/14823af95e7749a1a313aca6/3af194d2314b44fd8cf1cff9
📦
Proof pack for numerical.monte_carlo_pi on pyvorin-project-venv
/var/www/pyvorin-bench/data/proofpacks/14823af95e7749a1a313aca6/99d5034678b747fc875441cb
📦
Proof pack for numerical.monte_carlo_pi on pyvorin-project-venv
/var/www/pyvorin-bench/data/proofpacks/14823af95e7749a1a313aca6/aed793107011404a9fc51eb3
📦
Proof pack for numerical.monte_carlo_pi on pyvorin-project-venv
/var/www/pyvorin-bench/data/proofpacks/14823af95e7749a1a313aca6/81b6c0b83f354b57ae857271
📦
Proof pack for numerical.monte_carlo_pi on pyvorin-project-venv
/var/www/pyvorin-bench/data/proofpacks/14823af95e7749a1a313aca6/cea4dd4224de4fbb9dd48e4f
📦
Proof pack for numerical.dot_product on pyvorin-project-venv
/var/www/pyvorin-bench/data/proofpacks/14823af95e7749a1a313aca6/624c79421cd74a63b3663a8a
📦
Proof pack for numerical.dot_product on pyvorin-project-venv
/var/www/pyvorin-bench/data/proofpacks/14823af95e7749a1a313aca6/59a79173e4ac4e8686491220
📦
Proof pack for numerical.dot_product on pyvorin-project-venv
/var/www/pyvorin-bench/data/proofpacks/14823af95e7749a1a313aca6/01d343d046254eec9ccc0385
📦
Proof pack for numerical.dot_product on pyvorin-project-venv
/var/www/pyvorin-bench/data/proofpacks/14823af95e7749a1a313aca6/f71c6e694d4c4fd0bc6e718e
📦
Proof pack for numerical.dot_product on pyvorin-project-venv
/var/www/pyvorin-bench/data/proofpacks/14823af95e7749a1a313aca6/c07a3d56cdd5429bb81f7164
📦
Proof pack for numerical.dot_product on pyvorin-project-venv
/var/www/pyvorin-bench/data/proofpacks/14823af95e7749a1a313aca6/50cfacc98b21467489dfb610
📦
Proof pack for core.list_filter on pyvorin-project-venv
/var/www/pyvorin-bench/data/proofpacks/14823af95e7749a1a313aca6/b647d2fb63a74019818438b1
📦
Proof pack for core.list_filter on pyvorin-project-venv
/var/www/pyvorin-bench/data/proofpacks/14823af95e7749a1a313aca6/2b39d72ff87e46f09186a493
📦
Proof pack for core.list_filter on pyvorin-project-venv
/var/www/pyvorin-bench/data/proofpacks/14823af95e7749a1a313aca6/e8d271941bf7407489ac3c45
📦
Proof pack for core.list_filter on pyvorin-project-venv
/var/www/pyvorin-bench/data/proofpacks/14823af95e7749a1a313aca6/6af5cac376dd4e6796658a6f
📦
Proof pack for core.list_filter on pyvorin-project-venv
/var/www/pyvorin-bench/data/proofpacks/14823af95e7749a1a313aca6/687614de5bfe4d6cbb52e344
📦
Proof pack for core.list_filter on pyvorin-project-venv
/var/www/pyvorin-bench/data/proofpacks/14823af95e7749a1a313aca6/1779c416ea8b4ef28eb0d208
📦
Proof pack for core.float_reduction on pyvorin-project-venv
/var/www/pyvorin-bench/data/proofpacks/14823af95e7749a1a313aca6/bc7111e9efd045b1b9353a2d
📦
Proof pack for core.float_reduction on pyvorin-project-venv
/var/www/pyvorin-bench/data/proofpacks/14823af95e7749a1a313aca6/684251efbd12497faada9c0d
📦
Proof pack for core.float_reduction on pyvorin-project-venv
/var/www/pyvorin-bench/data/proofpacks/14823af95e7749a1a313aca6/3cca1a5071bc420ba6e40a2a
📦
Proof pack for core.float_reduction on pyvorin-project-venv
/var/www/pyvorin-bench/data/proofpacks/14823af95e7749a1a313aca6/7858c7f111154d90990744b3
📦
Proof pack for core.float_reduction on pyvorin-project-venv
/var/www/pyvorin-bench/data/proofpacks/14823af95e7749a1a313aca6/2bc5211a8cea49b4bd651a22
📦
Proof pack for core.float_reduction on pyvorin-project-venv
/var/www/pyvorin-bench/data/proofpacks/14823af95e7749a1a313aca6/cd23caae7a714a08a2902bb9
📦
Proof pack for core.integer_sum on pyvorin-project-venv
/var/www/pyvorin-bench/data/proofpacks/14823af95e7749a1a313aca6/1bedcd07c2b945299d5d0914
📦
Proof pack for core.integer_sum on pyvorin-project-venv
/var/www/pyvorin-bench/data/proofpacks/14823af95e7749a1a313aca6/13cbc17cf9a946bf803e9895
📦
Proof pack for core.integer_sum on pyvorin-project-venv
/var/www/pyvorin-bench/data/proofpacks/14823af95e7749a1a313aca6/b2e4a68fd2a0446ba52c64e9
📦
Proof pack for core.integer_sum on pyvorin-project-venv
/var/www/pyvorin-bench/data/proofpacks/14823af95e7749a1a313aca6/f7abf7f004cd4bad8b72b6db
📦
Proof pack for core.integer_sum on pyvorin-project-venv
/var/www/pyvorin-bench/data/proofpacks/14823af95e7749a1a313aca6/2de2069096204481b2808a56
📦
Proof pack for core.integer_sum on pyvorin-project-venv
/var/www/pyvorin-bench/data/proofpacks/14823af95e7749a1a313aca6/d11256d2e8b14c34a1ceb5ed

← Back to campaigns