Stream: GitHub notifications

Topic: Bench Notifications


view this post on Zulip Bench bot (May 14 2021 at 14:55):

Bench at https://gitlab.com/coq/coq/-/jobs/1263087417
For packages coq-bignums coq-hott coq-performance-tests-lite coq-engine-bench-lite coq-mathcomp-ssreflect coq-mathcomp-fingroup coq-mathcomp-algebra coq-mathcomp-solvable coq-mathcomp-field coq-mathcomp-character coq-mathcomp-odd-order coq-math-classes coq-corn coq-flocq coq-compcert coq-geocoq coq-color coq-coqprime coq-coqutil coq-bedrock2 coq-rewriter coq-fiat-core coq-fiat-parsers coq-fiat-crypto coq-unimath coq-coquelicot coq-lambda-rust coq-verdi coq-verdi-raft coq-fourcolor coq-rewriter-perf-SuperFast coq-perennial coq-vst

view this post on Zulip Bench bot (May 14 2021 at 14:57):

Bench at https://gitlab.com/coq/coq/-/jobs/1263138563
For packages coq-bignums coq-hott coq-performance-tests-lite coq-engine-bench-lite coq-mathcomp-ssreflect coq-mathcomp-fingroup coq-mathcomp-algebra coq-mathcomp-solvable coq-mathcomp-field coq-mathcomp-character coq-mathcomp-odd-order coq-math-classes coq-corn coq-flocq coq-compcert coq-geocoq coq-color coq-coqprime coq-coqutil coq-bedrock2 coq-rewriter coq-fiat-core coq-fiat-parsers coq-fiat-crypto coq-unimath coq-coquelicot coq-lambda-rust coq-verdi coq-verdi-raft coq-fourcolor coq-rewriter-perf-SuperFast coq-perennial coq-vst

┌────────────────────────────┬─────────────────────────┬───────────────────────────────────────┬───────────────────────────────────────┬─────────────────────────┬─────────────────┐
│                            │      user time [s]      │              CPU cycles               │           CPU instructions            │  max resident mem [KB]  │   mem faults    │
│                            │                         │                                       │                                       │                         │                 │
│               package_name │     NEW      OLD  PDIFF │            NEW             OLD  PDIFF │            NEW             OLD  PDIFF │     NEW      OLD  PDIFF │ NEW  OLD  PDIFF │
├────────────────────────────┼─────────────────────────┼───────────────────────────────────────┼───────────────────────────────────────┼─────────────────────────┼─────────────────┤
│      coq-engine-bench-lite │  334.28   336.43  -0.64 │   941498243466    944931471435  -0.36 │  1650118689826   1653595221550  -0.21 │ 3541116  3541092   0.00 │   0    0    nan │
├────────────────────────────┼─────────────────────────┼───────────────────────────────────────┼───────────────────────────────────────┼─────────────────────────┼─────────────────┤
│               coq-coqprime │ 1474.44  1478.95  -0.30 │  4106445011596   4118527553042  -0.29 │  6591977394886   6591680208978   0.00 │ 1056420  1056312   0.01 │   0    0    nan │
├────────────────────────────┼─────────────────────────┼───────────────────────────────────────┼───────────────────────────────────────┼─────────────────────────┼─────────────────┤
│                   coq-core │  109.92   110.13  -0.19 │   308515212629    307887768275   0.20 │   453676250332    453656381822   0.00 │  274616   274612   0.00 │   0    0    nan │
├────────────────────────────┼─────────────────────────┼───────────────────────────────────────┼───────────────────────────────────────┼─────────────────────────┼─────────────────┤
│                 coq-stdlib │  421.28   422.03  -0.18 │  1182059979105   1181487071996   0.05 │  1473198710946   1472903424667   0.02 │  569220   568932   0.05 │   0    0    nan │
├────────────────────────────┼─────────────────────────┼───────────────────────────────────────┼───────────────────────────────────────┼─────────────────────────┼─────────────────┤
│                   coq-hott │  291.72   292.14  -0.14 │   789709454492    790986521126  -0.16 │  1157322356326   1157407631618  -0.01 │  584156   584052   0.02 │   0    0    nan │
├────────────────────────────┼─────────────────────────┼───────────────────────────────────────┼───────────────────────────────────────┼─────────────────────────┼─────────────────┤
│           coq-fiat-parsers │  647.08   647.29  -0.03 │  1800416787347   1799260416069   0.06 │  2559282556579   2558559452884   0.03 │ 3274456  3274532  -0.00 │   0    0    nan │
├────────────────────────────┼─────────────────────────┼───────────────────────────────────────┼───────────────────────────────────────┼─────────────────────────┼─────────────────┤
│     coq-mathcomp-ssreflect │   57.51    57.52  -0.02 │   158723615340    158111770020   0.39 │   188747799815    188769862883  -0.01 │  521356   521132   0.04 │   0    0    nan │
├────────────────────────────┼─────────────────────────┼───────────────────────────────────────┼───────────────────────────────────────┼─────────────────────────┼─────────────────┤
│           coq-math-classes │  188.96   188.95   0.01 │   520967227905    520339094888   0.12 │   654483994413    654434568098   0.01 │  479712   479756  -0.01 │   0    0    nan │
├────────────────────────────┼─────────────────────────┼───────────────────────────────────────┼───────────────────────────────────────┼─────────────────────────┼─────────────────┤
│             coq-verdi-raft │ 1248.11  1247.40   0.06 │  3470928248876   3465043626917   0.17 │  4624849704456   4624470545145   0.01 │  899936   900220  -0.03 │   0    0    nan │
├────────────────────────────┼─────────────────────────┼───────────────────────────────────────┼───────────────────────────────────────┼─────────────────────────┼─────────────────┤
│         coq-mathcomp-field │  239.72   239.53   0.08 │   667392897372    666993237275   0.06 │   953650355422    953608586797   0.00 │  664568   664884  -0.05 │   0    0    nan │
├────────────────────────────┼─────────────────────────┼───────────────────────────────────────┼───────────────────────────────────────┼─────────────────────────┼─────────────────┤
│            coq-lambda-rust │ 1357.49  1356.32   0.09 │  3778867781559   3770235044614   0.23 │  5108526981736   5108391478640   0.00 │ 1110300  1130076  -1.75 │   0    0    nan │
├────────────────────────────┼─────────────────────────┼───────────────────────────────────────┼───────────────────────────────────────┼─────────────────────────┼─────────────────┤
│            coq-fiat-crypto │ 5094.73  5090.32   0.09 │ 14186499100336  14173572029410   0.09 │ 23744793220361  23747330388647  -0.01 │ 2210092  2205612   0.20 │   0    0    nan │
├────────────────────────────┼─────────────────────────┼───────────────────────────────────────┼───────────────────────────────────────┼─────────────────────────┼─────────────────┤
│                   coq-corn │ 1579.54  1577.74   0.11 │  4387763052083   4385997163789   0.04 │  5995469374465   5995402941508   0.00 │  790028   790112  -0.01 │   0    0    nan │
├────────────────────────────┼─────────────────────────┼───────────────────────────────────────┼───────────────────────────────────────┼─────────────────────────┼─────────────────┤
│              coq-fourcolor │ 2720.57  2717.38   0.12 │  7577545866195   7569171415343   0.11 │ 12246830546714  12249738897721  -0.02 │  730672   730836  -0.02 │   0    0    nan │
├────────────────────────────┼─────────────────────────┼───────────────────────────────────────┼───────────────────────────────────────┼─────────────────────────┼─────────────────┤
│                coq-unimath │ 4174.17  4169.03   0.12 │ 11598940030231  11582516364905   0.14 │ 21246288689685  21243235559878   0.01 │ 1083968  1121260  -3.33 │   0    0    nan │
├────────────────────────────┼─────────────────────────┼───────────────────────────────────────┼───────────────────────────────────────┼─────────────────────────┼─────────────────┤
│                coq-coqutil │   61.71    61.63   0.13 │   170021258255    169419706157   0.36 │   210780369700    210502790999   0.13 │  522644   522872  -0.04 │   0    0    nan │
├────────────────────────────┼─────────────────────────┼───────────────────────────────────────┼───────────────────────────────────────┼─────────────────────────┼─────────────────┤
│                coq-bignums │   59.56    59.48   0.13 │   164232745974    164099107704   0.08 │   209718715231    209746855703  -0.01 │  463688   463628   0.01 │   0    0    nan │
├────────────────────────────┼─────────────────────────┼───────────────────────────────────────┼───────────────────────────────────────┼─────────────────────────┼─────────────────┤
│               coq-bedrock2 │  335.36   334.90   0.14 │   931113733728    929065101237   0.22 │  1535373304469   1534140439189   0.08 │  793364   774060   2.49 │   0    0    nan │
├────────────────────────────┼─────────────────────────┼───────────────────────────────────────┼───────────────────────────────────────┼─────────────────────────┼─────────────────┤
│              coq-perennial │ 7302.00  7291.68   0.14 │ 20305869894584  20277145630543   0.14 │ 29106097750308  29107483410092  -0.00 │ 3115764  3115788  -0.00 │   0    0    nan │
├────────────────────────────┼─────────────────────────┼───────────────────────────────────────┼───────────────────────────────────────┼─────────────────────────┼─────────────────┤
│     coq-mathcomp-odd-order │ 1135.44  1133.82   0.14 │  3161907887246   3156899144676   0.16 │  4713618247146   4713443547740   0.00 │  903712   904300  -0.07 │   0    0    nan │
├────────────────────────────┼─────────────────────────┼───────────────────────────────────────┼───────────────────────────────────────┼─────────────────────────┼─────────────────┤
│      coq-mathcomp-fingroup │   52.15    52.06   0.17 │   144859007519    144666322502   0.13 │   188809466082    188875058364  -0.03 │  481180   481216  -0.01 │   0    0    nan │
├────────────────────────────┼─────────────────────────┼───────────────────────────────────────┼───────────────────────────────────────┼─────────────────────────┼─────────────────┤
│               coq-rewriter │  723.22   721.88   0.19 │  2012227941229   2008815216999   0.17 │  2936595535355   2935762079795   0.03 │ 1100512  1100712  -0.02 │   0    0    nan │
├────────────────────────────┼─────────────────────────┼───────────────────────────────────────┼───────────────────────────────────────┼─────────────────────────┼─────────────────┤
│      coq-mathcomp-solvable │  185.10   184.71   0.21 │   514880730213    513932536149   0.18 │   681141038974    681179014975  -0.01 │  691220   691608  -0.06 │   0    0    nan │
├────────────────────────────┼─────────────────────────┼───────────────────────────────────────┼───────────────────────────────────────┼─────────────────────────┼─────────────────┤
│ coq-performance-tests-lite │ 1691.45  1686.99   0.26 │  4720853825609   4717943136917   0.06 │  7463980325849   7458143214480   0.08 │ 1904648  1904748
[message truncated]

view this post on Zulip Bench bot (May 15 2021 at 12:07):

Bench at https://gitlab.com/coq/coq/-/jobs/1264577173
For packages coq-bignums coq-hott coq-performance-tests-lite coq-engine-bench-lite coq-mathcomp-ssreflect coq-mathcomp-fingroup coq-mathcomp-algebra coq-mathcomp-solvable coq-mathcomp-field coq-mathcomp-character coq-mathcomp-odd-order coq-math-classes coq-corn coq-flocq coq-compcert coq-geocoq coq-color coq-coqprime coq-coqutil coq-bedrock2 coq-rewriter coq-fiat-core coq-fiat-parsers coq-fiat-crypto coq-unimath coq-coquelicot coq-lambda-rust coq-verdi coq-verdi-raft coq-fourcolor coq-rewriter-perf-SuperFast coq-perennial coq-vst

view this post on Zulip Bench bot (May 15 2021 at 15:12):

Bench at https://gitlab.com/coq/coq/-/jobs/1264692032
For packages coq-bignums coq-hott coq-performance-tests-lite coq-engine-bench-lite coq-mathcomp-ssreflect coq-mathcomp-fingroup coq-mathcomp-algebra coq-mathcomp-solvable coq-mathcomp-field coq-mathcomp-character coq-mathcomp-odd-order coq-math-classes coq-corn coq-flocq coq-compcert coq-geocoq coq-color coq-coqprime coq-coqutil coq-bedrock2 coq-rewriter coq-fiat-core coq-fiat-parsers coq-fiat-crypto coq-unimath coq-coquelicot coq-lambda-rust coq-verdi coq-verdi-raft coq-fourcolor coq-rewriter-perf-SuperFast coq-perennial coq-vst

Failed 'rendered_results="$($program_path/render_results "$log_dir" $num_of_iterations $new_coq_commit_long $old_coq_commit_long 0 user_time_pdiff $installable_coq_opam_packages)"' with exit code 2.

view this post on Zulip Bench bot (May 15 2021 at 16:58):

Bench at https://gitlab.com/coq/coq/-/jobs/1264758870
For packages coq-bignums coq-hott coq-performance-tests-lite coq-engine-bench-lite coq-mathcomp-ssreflect coq-mathcomp-fingroup coq-mathcomp-algebra coq-mathcomp-solvable coq-mathcomp-field coq-mathcomp-character coq-mathcomp-odd-order coq-math-classes coq-corn coq-flocq coq-compcert coq-geocoq coq-color coq-coqprime coq-coqutil coq-bedrock2 coq-rewriter coq-fiat-core coq-fiat-parsers coq-fiat-crypto coq-unimath coq-coquelicot coq-lambda-rust coq-verdi coq-verdi-raft coq-fourcolor coq-rewriter-perf-SuperFast coq-perennial coq-vst

Failed 'rendered_results="$($program_path/render_results "$log_dir" $num_of_iterations $new_coq_commit_long $old_coq_commit_long 0 user_time_pdiff $installable_coq_opam_packages)"' with exit code 2.

view this post on Zulip Bench bot (May 15 2021 at 19:19):

Bench at https://gitlab.com/coq/coq/-/jobs/1264849425
For packages coq-bignums coq-hott coq-performance-tests-lite coq-engine-bench-lite coq-mathcomp-ssreflect coq-mathcomp-fingroup coq-mathcomp-algebra coq-mathcomp-solvable coq-mathcomp-field coq-mathcomp-character coq-mathcomp-odd-order coq-math-classes coq-corn coq-flocq coq-compcert coq-geocoq coq-color coq-coqprime coq-coqutil coq-bedrock2 coq-rewriter coq-fiat-core coq-fiat-parsers coq-fiat-crypto coq-unimath coq-coquelicot coq-lambda-rust coq-verdi coq-verdi-raft coq-fourcolor coq-rewriter-perf-SuperFast coq-perennial coq-vst

Failed 'rendered_results="$($program_path/render_results "$log_dir" $num_of_iterations $new_coq_commit_long $old_coq_commit_long 0 user_time_pdiff $installable_coq_opam_packages)"' with exit code 2.

view this post on Zulip Bench bot (May 16 2021 at 11:55):

Bench at https://gitlab.com/coq/coq/-/jobs/1265531293
For packages coq-bignums coq-hott coq-performance-tests-lite coq-engine-bench-lite coq-mathcomp-ssreflect coq-mathcomp-fingroup coq-mathcomp-algebra coq-mathcomp-solvable coq-mathcomp-field coq-mathcomp-character coq-mathcomp-odd-order coq-math-classes coq-corn coq-flocq coq-compcert coq-geocoq coq-color coq-coqprime coq-coqutil coq-bedrock2 coq-rewriter coq-fiat-core coq-fiat-parsers coq-fiat-crypto coq-unimath coq-coquelicot coq-lambda-rust coq-verdi coq-verdi-raft coq-fourcolor coq-rewriter-perf-SuperFast coq-perennial coq-vst

┌────────────────────────────┬─────────────────────────┬───────────────────────────────────────┬───────────────────────────────────────┬─────────────────────────┬─────────────────┐
│                            │      user time [s]      │              CPU cycles               │           CPU instructions            │  max resident mem [KB]  │   mem faults    │
│                            │                         │                                       │                                       │                         │                 │
│               package_name │     NEW      OLD  PDIFF │            NEW             OLD  PDIFF │            NEW             OLD  PDIFF │     NEW      OLD  PDIFF │ NEW  OLD  PDIFF │
├────────────────────────────┼─────────────────────────┼───────────────────────────────────────┼───────────────────────────────────────┼─────────────────────────┼─────────────────┤
│               coq-coqprime │ 1476.12  1490.08  -0.94 │  4110949764220   4148879083873  -0.91 │  6591514927162   6590541289852   0.01 │ 1056232  1056292  -0.01 │   0    0    nan │
│                        coq │    4.50     4.53  -0.66 │    12452378986     12486901690  -0.28 │    23229593762     23237534802  -0.03 │  275384   275292   0.03 │   0    0    nan │
│                 coq-stdlib │  420.65   423.02  -0.56 │  1181474568051   1186614389324  -0.43 │  1473128060928   1473036086108   0.01 │  569280   569172   0.02 │   0    0    nan │
│                coq-coqutil │   61.43    61.73  -0.49 │   169691635646    170343005936  -0.38 │   210846140347    210540528447   0.15 │  522640   522804  -0.03 │   0    0    nan │
│      coq-mathcomp-fingroup │   52.11    52.35  -0.46 │   144819872881    144751197439   0.05 │   188872284013    188878862968  -0.00 │  481228   481264  -0.01 │   0    0    nan │
│      coq-engine-bench-lite │  335.28   336.18  -0.27 │   942233577037    943728663884  -0.16 │  1651703067786   1654503611917  -0.17 │ 3541092  3541080   0.00 │   0    0    nan │
│                   coq-hott │  296.98   297.77  -0.27 │   807116978676    806500953981   0.08 │  1176845140209   1176795554683   0.00 │  584928   584856   0.01 │   0    0    nan │
│             coq-verdi-raft │ 1241.22  1244.31  -0.25 │  3453786315398   3461318721144  -0.22 │  4617297086418   4616781520037   0.01 │  901084   901140  -0.01 │   0    0    nan │
│     coq-mathcomp-ssreflect │   57.70    57.84  -0.24 │   158878967988    158625322580   0.16 │   188838321158    188812702079   0.01 │  521328   521224   0.02 │   0    0    nan │
│                  coq-flocq │  158.36   158.53  -0.11 │   440295582780    440843622102  -0.12 │   508446353560    508401758012   0.01 │  820732   820760  -0.00 │   0    0    nan │
│              coq-fourcolor │ 2700.92  2703.74  -0.10 │  7520704813606   7529956057946  -0.12 │ 12243928424622  12242255835093   0.01 │  730676   730916  -0.03 │   0    0    nan │
│       coq-mathcomp-algebra │  150.77   150.89  -0.08 │   418959398726    419522343014  -0.13 │   507971377014    508089892517  -0.02 │  556200   556048   0.03 │   0    0    nan │
│           coq-fiat-parsers │  647.99   648.44  -0.07 │  1800224546908   1800749254075  -0.03 │  2562203547681   2561328747709   0.03 │ 3677820  3677872  -0.00 │   0    0    nan │
│         coq-mathcomp-field │  239.96   240.01  -0.02 │   667369248317    666498739202   0.13 │   953925411244    953698515850   0.02 │  664776   664824  -0.01 │   0    0    nan │
│     coq-mathcomp-odd-order │ 1137.67  1137.52   0.01 │  3164092171880   3162261519455   0.06 │  4713708838901   4713678216911   0.00 │  904236   903224   0.11 │   0    0    nan │
│                coq-bignums │   59.47    59.45   0.03 │   164385780042    164739867991  -0.21 │   209763635589    209755374903   0.00 │  463584   463484   0.02 │   0    0    nan │
│            coq-lambda-rust │ 1356.89  1356.30   0.04 │  3777028844864   3776821618747   0.01 │  5103026974332   5101285576587   0.03 │ 1106480  1106352   0.01 │   0    0    nan │
│           coq-math-classes │  189.40   189.30   0.05 │   520994601581    521648884813  -0.13 │   654567577663    654525814080   0.01 │  479740   479704   0.01 │   0    0    nan │
│      coq-mathcomp-solvable │  185.22   185.10   0.06 │   514677030959    514888244942  -0.04 │   681225563481    681162173437   0.01 │  691324   691504  -0.03 │   0    0    nan │
│                  coq-color │  529.65   529.19   0.09 │  1466015665795   1465453457665   0.04 │  1729543523129   1728815411179   0.04 │ 1146116  1103876   3.83 │   0    0    nan │
│                   coq-corn │ 1580.78  1579.40   0.09 │  4384651731139   4389336867329  -0.11 │  5995462915509   5995356425292   0.00 │  789972   790208  -0.03 │   0    0    nan │
│               coq-bedrock2 │  335.41   335.07   0.10 │   932671524494    930392033057   0.25 │  1534761730286   1533891725492   0.06 │  793292   773864   2.51 │   0    0    nan │
│                coq-unimath │ 4165.35  4161.09   0.10 │ 11576137502609  11575513844481   0.01 │ 21234118662174  21237220470400  -0.01 │ 1084144  1121176  -3.30 │   0    0    nan │
│ coq-performance-tests-lite │ 1693.59  1691.77   0.11 │  4726970537996   4721145206374   0.12 │  7462837381636   7458841816246   0.05 │ 1904748  1904748   0.00 │   0    0    nan │
│              coq-perennial │ 7280.87  7270.38   0.14 │ 20269298888393  20250850923044   0.09 │ 29092391808388  29091521276561   0.00 │ 3097216  3096460   0.02 │   0    0    nan │
│     coq-mathcomp-character │  164.23   163.95   0.17 │   456576875815    455702318175   0.19 │   597040913976    597062721149  -0.00 │  745844   745904  -0.01 │   0    0    nan │
│                 coq-geocoq │ 1464.75  1462.13   0.18 │  4062244072950   4053117838129   0.23 │  5639854934055   5639296452403   0.01 │  992236   992200   0.00 │   0    0    nan │
│                  coq-verdi │  105.36   105.12   0.23 │   291514457354    290302396252   0.42 │   385639039348    384337237018   0.34 │  544480   544560  -0.01 │   0    0    nan │
│                   coq-core │  110.48   109.85   0.57 │   308742709791    307896075608   0.27 │   453784850708    453773646919   0.00 │  294568   294536   0.01 │   0    0    nan │
│              coq-fiat-core │  116.80   115.95   0.73 │   327738038777    326421532565   0.40 │   408874222755    407069986307   0.44 │  478780   478648   0.03 │   0    0    nan │
│             coq-coquelicot │   74.23    73.32   1.24 │   204541409608    202664171276   0.93 │   240309188327    239077637544   0.52 │  559524   559460   0.01 │   0    0    nan │
└────────────────────────────┴─────────────────────────┴───────────────────────────────────────┴───────────────────────────────────────┴─────────────────────────┴─────────────────┘

Bench complete, failed to install packages:
coq-compcert
coq-fiat-crypto
coq-rewriter
coq-rewriter-perf-SuperFast
coq-vst

view this post on Zulip Bench bot (May 24 2021 at 08:50):

Bench at https://gitlab.com/coq/coq/-/jobs/1287968128
For packages coq-bignums coq-hott coq-performance-tests-lite coq-engine-bench-lite coq-mathcomp-ssreflect coq-mathcomp-fingroup coq-mathcomp-algebra coq-mathcomp-solvable coq-mathcomp-field coq-mathcomp-character coq-mathcomp-odd-order coq-math-classes coq-corn coq-flocq coq-compcert coq-geocoq coq-color coq-coqprime coq-coqutil coq-bedrock2 coq-rewriter coq-fiat-core coq-fiat-parsers coq-fiat-crypto coq-unimath coq-coquelicot coq-lambda-rust coq-verdi coq-verdi-raft coq-fourcolor coq-rewriter-perf-SuperFast coq-perennial coq-vst

┌─────────────────────────────┬─────────────────────────┬───────────────────────────────────────┬───────────────────────────────────────┬─────────────────────────┬───────────────────┐
│                             │      user time [s]      │              CPU cycles               │           CPU instructions            │  max resident mem [KB]  │    mem faults     │
│                             │                         │                                       │                                       │                         │                   │
│                package_name │     NEW      OLD  PDIFF │            NEW             OLD  PDIFF │            NEW             OLD  PDIFF │     NEW      OLD  PDIFF │ NEW  OLD    PDIFF │
├─────────────────────────────┼─────────────────────────┼───────────────────────────────────────┼───────────────────────────────────────┼─────────────────────────┼───────────────────┤
│             coq-fiat-crypto │ 5081.03  5119.55  -0.75 │ 14148774764226  14257626165275  -0.76 │ 23732613163687  23912217623867  -0.75 │ 2209944  2210356  -0.02 │ 120  121    -0.83 │
│            coq-math-classes │  187.30   188.11  -0.43 │   517412730000    518300288689  -0.17 │   652506126902    652877324413  -0.06 │  479988   479800   0.04 │   0    0      nan │
│               coq-fourcolor │ 2700.46  2710.94  -0.39 │  7515213452625   7542867982633  -0.37 │ 12243043239273  12244801134229  -0.01 │  730760   730852  -0.01 │   0    0      nan │
│ coq-rewriter-perf-SuperFast │  797.78   800.50  -0.34 │  2219130099302   2232190897601  -0.59 │  3307560446724   3309111824195  -0.05 │ 1101136  1101012   0.01 │   4    0      nan │
│              coq-verdi-raft │ 1240.58  1244.44  -0.31 │  3446807173399   3455192459631  -0.24 │  4613781544511   4614108929078  -0.01 │  902692   902680   0.00 │   0    0      nan │
│                coq-rewriter │  728.41   730.45  -0.28 │  2027931855295   2032773413815  -0.24 │  2947639360296   2944362240657   0.11 │ 1177336  1101184   6.92 │ 896  626    43.13 │
│              coq-coquelicot │   74.00    74.20  -0.27 │   204319801828    205031705142  -0.35 │   241063189570    240232818622   0.35 │  559144   559896  -0.13 │ 166    0      nan │
│                 coq-bignums │   59.62    59.78  -0.27 │   164622232994    164812800871  -0.12 │   209777108589    209932821989  -0.07 │  463664   464020  -0.08 │   0    0      nan │
│               coq-perennial │ 7259.19  7276.83  -0.24 │ 20186668656998  20238480657894  -0.26 │ 29059179035187  29082845634536  -0.08 │ 3112108  3130644  -0.59 │   0    1  -100.00 │
│               coq-fiat-core │  116.21   116.48  -0.23 │   327376609743    327290542867   0.03 │   409406993085    407889330813   0.37 │  479660   479564   0.02 │  32   12   166.67 │
│                    coq-corn │ 1570.90  1574.42  -0.22 │  4366452592323   4376346577236  -0.23 │  5983355080643   5986078649570  -0.05 │  816784   816852  -0.01 │   0    0      nan │
│            coq-fiat-parsers │  644.23   645.56  -0.21 │  1790427012909   1794348609984  -0.22 │  2556589260400   2554365613275   0.09 │ 3274416  3274420  -0.00 │   0    0      nan │
│                   coq-verdi │  105.81   106.00  -0.18 │   292377281971    292645521365  -0.09 │   386600138318    385865406253   0.19 │  539836   540216  -0.07 │   0    0      nan │
│             coq-lambda-rust │ 1356.74  1359.00  -0.17 │  3771458035812   3782787566336  -0.30 │  5112686601174   5117721923592  -0.10 │ 1106556  1106396   0.01 │   0    0      nan │
│                coq-coqprime │ 1490.99  1492.01  -0.07 │  4151579632678   4154202106226  -0.06 │  6590841016548   6588753960162   0.03 │ 1056576  1056572   0.00 │   0    0      nan │
│                  coq-stdlib │  420.98   420.76   0.05 │  1180699940648   1180339052384   0.03 │  1474513924678   1470309452790   0.29 │  570372   566756   0.64 │   0    0      nan │
│                  coq-geocoq │ 1459.00  1457.18   0.12 │  4048884203156   4040469478843   0.21 │  5625960652407   5634206270921  -0.15 │  992500   992272   0.02 │   0    0      nan │
│                 coq-unimath │ 4175.44  4170.01   0.13 │ 11612758560038  11589965940633   0.20 │ 21235693769400  21231495561439   0.02 │ 1123528  1121324   0.20 │   6    4    50.00 │
│                   coq-color │  527.14   526.24   0.17 │  1461767477722   1460703604392   0.07 │  1723425169654   1723852960957  -0.02 │ 1132864  1131964   0.08 │   0    0      nan │
│  coq-performance-tests-lite │ 1686.66  1683.57   0.18 │  4709413843016   4699160640389   0.22 │  7444246000775   7446568514794  -0.03 │ 1904604  1904664  -0.00 │   0    0      nan │
│      coq-mathcomp-odd-order │ 1136.55  1134.27   0.20 │  3159671964281   3154940889423   0.15 │  4699684514663   4707868996650  -0.17 │  910928   911008  -0.01 │   0    0      nan │
│       coq-engine-bench-lite │  338.02   337.18   0.25 │   949365053561    946685404206   0.28 │  1655768249054   1652985658018   0.17 │ 3541036  3541064  -0.00 │   0    0      nan │
│                 coq-coqutil │   62.30    62.14   0.26 │   171929914855    171722070534   0.12 │   213994364019    213722186039   0.13 │  598580   598408   0.03 │   0    0      nan │
│       coq-mathcomp-solvable │  185.40   184.88   0.28 │   515275324433    513116918980   0.42 │   680086537407    680734588192  -0.10 │  683680   690000  -0.92 │   0    0      nan │
│          coq-mathcomp-field │  240.70   239.94   0.32 │   669285906705    667325474910   0.29 │   953186713827    953604947207  -0.04 │  664768   664772  -0.00 │   0    0      nan │
│      coq-mathcomp-character │  163.76   163.23   0.32 │   455327596082    454214744476   0.25 │   596106549267    596429110005  -0.05 │  714020   744116  -4.04 │   0    0      nan │
│        coq-mathcomp-algebra │  151.05   150.48   0.38 │   419819946880    418757228278   0.25 │   507310929602    507666991729  -0.07 │  552468   552600  -0.02 │   0    0      nan │
│                    coq-hott │  300.64   298.76   0.63 │   813276561288    810955273751   0.29 │  1186390312856   1186876871831  -0.04 │  584012   584024  -0.00 │   0    0      nan │
│                    coq-core │  111.26   110.56   0.63 │   311384329868    309862630279   0.49 │   456686251139    456502414830   0.04 │  295552   295588  -0.01 │   0    0      nan │
│       coq-mathcomp-fingroup │   52.46    52.12   0.65 │   145051673634    144664340821   0.27 │   188766636971    188868357041  -0.05 │  482236   482144   0.02 │   0    0      nan │
│                         coq │    4.62     4.57   1.09 │    12569943110     12534503935   0.28 │    23440867837     23432767410   0.03 │  276408   276408   0.00 │   0    0      nan │
│      coq-mathcomp-ssreflect │   58.60    57.78   1.42 │   160290978693    159638494894   0.41 │   189591772757    189790350609  -0.10 │  523276   523052   0.04 │   0    0      nan │
└─────────────────────────────┴─────────────────────────┴───────────────────────────────────────┴───────────────────────────────────────┴─────────────────────────┴───────────────────┘

Bench complete, failed to install packages:
coq-bedrock2
coq-compcert
coq-flocq
coq-vst

view this post on Zulip Jason Gross (May 24 2021 at 17:48):

Are the bench table separators supposed to be misaligned? What's going on?

view this post on Zulip Gaëtan Gilbert (May 24 2021 at 17:53):

looks aligned to me

view this post on Zulip Gaëtan Gilbert (May 24 2021 at 17:54):

Screenshot_20210524_195357.png

view this post on Zulip Jason Gross (May 24 2021 at 17:55):

Huh, it's aligned on my desktop but not on the mobile client

view this post on Zulip Jason Gross (May 24 2021 at 17:57):

Screenshot_20210524-135629.png

view this post on Zulip Jason Gross (May 24 2021 at 17:58):

I guess the issue would already be present with

┌─┬
│ │

and

┌───┬
│   │

view this post on Zulip Jason Gross (May 24 2021 at 17:59):

Indeed, this seems like an issue with the font zulip uses on Android for fixed width

view this post on Zulip Jason Gross (May 24 2021 at 17:59):

Screenshot_20210524-135912.png

view this post on Zulip Bench bot (May 25 2021 at 06:15):

Bench at https://gitlab.com/coq/coq/-/jobs/1286786849
For packages coq-bignums coq-hott coq-performance-tests-lite coq-engine-bench-lite coq-mathcomp-ssreflect coq-mathcomp-fingroup coq-mathcomp-algebra coq-mathcomp-solvable coq-mathcomp-field coq-mathcomp-character coq-mathcomp-odd-order coq-math-classes coq-corn coq-flocq coq-compcert coq-geocoq coq-color coq-coqprime coq-coqutil coq-bedrock2 coq-rewriter coq-fiat-core coq-fiat-parsers coq-fiat-crypto coq-unimath coq-coquelicot coq-lambda-rust coq-verdi coq-verdi-raft coq-fourcolor coq-rewriter-perf-SuperFast coq-perennial coq-vst

┌─────────────────────────────┬─────────────────────────┬───────────────────────────────────────┬───────────────────────────────────────┬──────────────────────────┬─────────────────┐
│                             │      user time [s]      │              CPU cycles               │           CPU instructions            │  max resident mem [KB]   │   mem faults    │
│                             │                         │                                       │                                       │                          │                 │
│                package_name │     NEW      OLD  PDIFF │            NEW             OLD  PDIFF │            NEW             OLD  PDIFF │     NEW      OLD   PDIFF │ NEW  OLD  PDIFF │
├─────────────────────────────┼─────────────────────────┼───────────────────────────────────────┼───────────────────────────────────────┼──────────────────────────┼─────────────────┤
│                 coq-bignums │   59.63    60.19  -0.93 │   164883856562    166154463527  -0.76 │   209916291475    209913056564   0.00 │  463832   463900   -0.01 │   0    0    nan │
│  coq-performance-tests-lite │ 1674.02  1686.98  -0.77 │  4678708600459   4707742172907  -0.62 │  7446210177148   7452188998275  -0.08 │ 1904648  1904616    0.00 │   0    0    nan │
│       coq-engine-bench-lite │  337.10   339.04  -0.57 │   947649877080    951703361269  -0.43 │  1657315451606   1661971650383  -0.28 │ 3541064  3541196   -0.00 │   0    0    nan │
│                coq-bedrock2 │  332.19   333.82  -0.49 │   923491291449    926970183233  -0.38 │  1534019737644   1534073299465  -0.00 │  752804   752736    0.01 │   1    0    nan │
│              coq-verdi-raft │ 1241.68  1247.47  -0.46 │  3448386456704   3464629611954  -0.47 │  4615550973191   4614712943559   0.02 │  902336   902520   -0.02 │   0    0    nan │
│                    coq-corn │ 1572.46  1579.69  -0.46 │  4363633993688   4382096221307  -0.42 │  5986244679839   5986033446134   0.00 │  816948   817040   -0.01 │   0    0    nan │
│                 coq-coqutil │   62.26    62.51  -0.40 │   171665237219    172473446087  -0.47 │   214099978663    213661863864   0.21 │  597516   598252   -0.12 │   0    0    nan │
│                coq-rewriter │  725.60   728.07  -0.34 │  2017398464436   2024327210557  -0.34 │  2947521925931   2945645889326   0.06 │ 1101236  1101096    0.01 │   0    0    nan │
│            coq-math-classes │  187.81   188.36  -0.29 │   517778659129    518900502337  -0.22 │   652842042871    652843913832  -0.00 │  479732   479980   -0.05 │   0    0    nan │
│               coq-fourcolor │ 2710.71  2717.55  -0.25 │  7540918317223   7560336550278  -0.26 │ 12248703809002  12245924745217   0.02 │  730848   730640    0.03 │   0    0    nan │
│ coq-rewriter-perf-SuperFast │  798.68   800.68  -0.25 │  2222990529698   2230021482486  -0.32 │  3309525741496   3309410761633   0.00 │ 1101084  1101056    0.00 │   0    0    nan │
│             coq-fiat-crypto │ 5117.83  5129.15  -0.22 │ 14238475653258  14266553862478  -0.20 │ 23932707337664  23918583288506   0.06 │ 2206120  2209764   -0.16 │   0    0    nan │
│                   coq-verdi │  106.02   106.22  -0.19 │   292412047117    292451661614  -0.01 │   387024097557    386251658303   0.20 │  540104   539384    0.13 │   0    0    nan │
│               coq-perennial │ 7255.70  7265.38  -0.13 │ 20173452528147  20201341453226  -0.14 │ 29078177339600  29086556855547  -0.03 │ 3128036  3113964    0.45 │   0    0    nan │
│                  coq-stdlib │  420.57   421.03  -0.11 │  1182903505643   1181124676610   0.15 │  1470218071635   1469982046383   0.02 │  566852   566700    0.03 │   0    0    nan │
│      coq-mathcomp-odd-order │ 1133.40  1134.51  -0.10 │  3151157678852   3155311824582  -0.13 │  4712017854024   4707915807149   0.09 │  911896   911008    0.10 │   0    0    nan │
│                    coq-hott │  298.75   299.03  -0.09 │   811436983639    810381816183   0.13 │  1187616844446   1187487952608   0.01 │  583908   583912   -0.00 │   0    0    nan │
│                   coq-color │  526.28   526.77  -0.09 │  1460561713572   1463910475917  -0.23 │  1724699290586   1724032984844   0.04 │ 1125340  1105020    1.84 │   0    0    nan │
│      coq-mathcomp-ssreflect │   57.90    57.94  -0.07 │   160137553450    159571896354   0.35 │   189778045300    189734128289   0.02 │  522528   523072   -0.10 │   0    0    nan │
│            coq-fiat-parsers │  644.61   644.88  -0.04 │  1787975120347   1790971606413  -0.17 │  2555573835505   2555512792917   0.00 │ 3274472  3274500   -0.00 │   0    0    nan │
│          coq-mathcomp-field │  239.26   239.36  -0.04 │   665447064181    666290495918  -0.13 │   953661886132    953486585615   0.02 │  665996   663936    0.31 │   0    0    nan │
│      coq-mathcomp-character │  163.16   163.20  -0.02 │   453489242667    453860716775  -0.08 │   596538126065    596382438419   0.03 │  744564   744096    0.06 │   0    0    nan │
│               coq-fiat-core │  116.33   116.32   0.01 │   327209049463    327078663336   0.04 │   409796098833    408635075660   0.28 │  479688   479620    0.01 │   0    0    nan │
│       coq-mathcomp-solvable │  184.50   184.45   0.03 │   513393926648    513599668042  -0.04 │   680805504871    680655458968   0.02 │  683704   690040   -0.92 │   0    0    nan │
│                  coq-geocoq │ 1460.52  1460.12   0.03 │  4058536554287   4057504482022   0.03 │  5633897020631   5633178778675   0.01 │  992244   992296   -0.01 │   0    0    nan │
│        coq-mathcomp-algebra │  150.34   150.24   0.07 │   418279693547    417957254255   0.08 │   507666516258    507589840110   0.02 │  552740   552656    0.02 │   0    0    nan │
│             coq-lambda-rust │ 1361.46  1360.44   0.07 │  3785060295803   3787481734347  -0.06 │  5128472621387   5120121662136   0.16 │ 1110568  1122156   -1.03 │   0    0    nan │
│                 coq-unimath │ 4174.37  4168.73   0.14 │ 11607968880318  11599155388362   0.08 │ 21237903844588  21234558498017   0.02 │ 1005884  1121408  -10.30 │   0    0    nan │
│                    coq-core │  110.82   110.60   0.20 │   310158820658    310177564411  -0.01 │   456547048278    456542904143   0.00 │  295148   295160   -0.00 │   4    0    nan │
│              coq-coquelicot │   74.36    74.15   0.28 │   205243955325    204595762516   0.32 │   241337130792    240542483932   0.33 │  559896   559220    0.12 │   0    0    nan │
│                coq-coqprime │ 1491.30  1487.03   0.29 │  4145121988977   4139449474811   0.14 │  6590284197790   6589662530096   0.01 │ 1056296  1056416   -0.01 │   0    0    nan │
│       coq-mathcomp-fingroup │   52.29    52.06   0.44 │   144390475438    144634758398  -0.17 │   188865698639    188824835737   0.02 │  482192   482144    0.01 │   0    0    nan │
│                         coq │    4.54     4.50   0.89 │    12463427479     12492554417  -0.23 │    23420818394     23424320980  -0.01 │  276440   276436    0.00 │   0    0    nan │
└─────────────────────────────┴─────────────────────────┴───────────────────────────────────────┴───────────────────────────────────────┴──────────────────────────┴─────────────────┘

Bench complete, failed to install packages:
coq-compcert
coq-flocq
coq-vst

view this post on Zulip Bench bot (May 26 2021 at 02:36):

Bench at https://gitlab.com/coq/coq/-/jobs/1288994065
For packages coq-bignums coq-hott coq-performance-tests-lite coq-engine-bench-lite coq-mathcomp-ssreflect coq-mathcomp-fingroup coq-mathcomp-algebra coq-mathcomp-solvable coq-mathcomp-field coq-mathcomp-character coq-mathcomp-odd-order coq-math-classes coq-corn coq-flocq coq-compcert coq-geocoq coq-color coq-coqprime coq-coqutil coq-bedrock2 coq-rewriter coq-fiat-core coq-fiat-parsers coq-fiat-crypto coq-unimath coq-coquelicot coq-lambda-rust coq-verdi coq-verdi-raft coq-fourcolor coq-rewriter-perf-SuperFast coq-perennial coq-vst

┌─────────────────────────────┬─────────────────────────┬───────────────────────────────────────┬───────────────────────────────────────┬─────────────────────────┬─────────────────┐
│                             │      user time [s]      │              CPU cycles               │           CPU instructions            │  max resident mem [KB]  │   mem faults    │
│                             │                         │                                       │                                       │                         │                 │
│                package_name │     NEW      OLD  PDIFF │            NEW             OLD  PDIFF │            NEW             OLD  PDIFF │     NEW      OLD  PDIFF │ NEW  OLD  PDIFF │
├─────────────────────────────┼─────────────────────────┼───────────────────────────────────────┼───────────────────────────────────────┼─────────────────────────┼─────────────────┤
│                    coq-core │  110.65   111.15  -0.45 │   309935564053    310484564157  -0.18 │   456542693124    456424919539   0.03 │  276724   276724   0.00 │   0    0    nan │
│                    coq-hott │  299.18   299.99  -0.27 │   812280212249    811077215464   0.15 │  1188035343361   1187583484902   0.04 │  565616   583912  -3.13 │   0    0    nan │
│                         coq │    4.56     4.56   0.00 │    12506414584     12523924831  -0.14 │    23420935021     23412291276   0.04 │  276684   276668   0.01 │   0    0    nan │
│                 coq-unimath │ 4172.26  4172.22   0.00 │ 11591413971602  11607856310002  -0.14 │ 21271396959204  21233630514543   0.18 │ 1121336  1121344  -0.00 │   0    0    nan │
│                  coq-geocoq │ 1462.25  1461.18   0.07 │  4056744017650   4059562550690  -0.07 │  5641687333817   5634837471452   0.12 │  992440   992368   0.01 │   0    0    nan │
│       coq-engine-bench-lite │  336.40   336.11   0.09 │   945295212226    944207221955   0.12 │  1661715738110   1654932989426   0.41 │ 3541112  3540928   0.01 │   0    0    nan │
│               coq-fourcolor │ 2713.64  2709.11   0.17 │  7550671271226   7537628771650   0.17 │ 12248537719462  12246352333621   0.02 │  730724   730772  -0.01 │   0    0    nan │
│                 coq-bignums │   59.85    59.75   0.17 │   164791360524    164366063187   0.26 │   210137580669    209809805963   0.16 │  464216   463100   0.24 │   0    0    nan │
│                 coq-coqutil │   62.37    62.24   0.21 │   172919936920    171760316612   0.68 │   214216648792    213656352246   0.26 │  598556   598596  -0.01 │   0    0    nan │
│                coq-rewriter │  726.63   724.93   0.23 │  2023632400366   2017384171841   0.31 │  2950340173335   2945656900178   0.16 │ 1100396  1101240  -0.08 │   0    0    nan │
│  coq-performance-tests-lite │ 1682.12  1678.09   0.24 │  4693691984144   4696480355812  -0.06 │  7457768182760   7448271383078   0.13 │ 2154100  1904612  13.10 │   0    0    nan │
│      coq-mathcomp-character │  163.74   163.26   0.29 │   454742086747    453789871106   0.21 │   598176496953    596411594963   0.30 │  744124   744624  -0.07 │   0    0    nan │
│             coq-fiat-crypto │ 5139.26  5124.01   0.30 │ 14309367045078  14269504633278   0.28 │ 24020987595289  23981145815567   0.17 │ 2207996  2215856  -0.35 │   0    0    nan │
│                   coq-verdi │  106.36   105.99   0.35 │   293106898406    291967017730   0.39 │   387773621541    386388941120   0.36 │  542276   539948   0.43 │   0    0    nan │
│          coq-mathcomp-field │  240.01   239.17   0.35 │   667151964389    664808417427   0.35 │   955136983117    953496779251   0.17 │  663240   663944  -0.11 │   0    0    nan │
│              coq-verdi-raft │ 1242.94  1238.38   0.37 │  3459003208309   3445495927192   0.39 │  4624390804995   4615038152557   0.20 │  901148   902536  -0.15 │   0    0    nan │
│       coq-mathcomp-solvable │  185.16   184.48   0.37 │   514281953613    512218776895   0.40 │   682472223295    680583745759   0.28 │  689864   688836   0.15 │   0    0    nan │
│      coq-mathcomp-ssreflect │   57.98    57.75   0.40 │   160440059681    159411154338   0.65 │   190075871911    189752050552   0.17 │  522212   523020  -0.15 │   0    0    nan │
│               coq-perennial │ 7296.35  7266.88   0.41 │ 20289568497589  20234321762296   0.27 │ 29127964381827  29082984224104   0.15 │ 3133664  3114416   0.62 │   0    0    nan │
│                   coq-color │  529.63   527.35   0.43 │  1468566720192   1460173671678   0.57 │  1727539409335   1723851665073   0.21 │ 1145984  1131824   1.25 │   0    0    nan │
│                  coq-stdlib │  423.23   421.22   0.48 │  1185831300466   1181622982787   0.36 │  1472082645417   1470069469855   0.14 │  569692   566320   0.60 │   0    0    nan │
│             coq-lambda-rust │ 1365.54  1358.87   0.49 │  3802904563482   3777995313578   0.66 │  5135652811088   5119602657013   0.31 │ 1110332  1122096  -1.05 │   0    0    nan │
│            coq-fiat-parsers │  647.45   644.10   0.52 │  1799275287041   1789571228617   0.54 │  2564525707851   2554988896501   0.37 │ 3677880  3274768  12.31 │   0    0    nan │
│ coq-rewriter-perf-SuperFast │  801.27   796.64   0.58 │  2230661406069   2219114906591   0.52 │  3313855290931   3309387469694   0.14 │ 1100300  1101048  -0.07 │   0    0    nan │
│                    coq-corn │ 1580.52  1570.72   0.62 │  4383533075966   4358748265754   0.57 │  6006428348696   5986082371010   0.34 │  810084   816960  -0.84 │   0    0    nan │
│               coq-fiat-core │  116.47   115.72   0.65 │   327358536903    326133744989   0.38 │   409990207931    408665940384   0.32 │  479172   479564  -0.08 │   0    0    nan │
│      coq-mathcomp-odd-order │ 1139.31  1130.39   0.79 │  3167874326266   3144119274366   0.76 │  4717110956627   4707618485378   0.20 │  903760   911160  -0.81 │   0    0    nan │
│        coq-mathcomp-algebra │  151.33   150.10   0.82 │   420005343698    416882631458   0.75 │   508931353147    507588092851   0.26 │  552992   552852   0.03 │   0    0    nan │
│            coq-math-classes │  189.29   187.66   0.87 │   520454563712    517447438190   0.58 │   653302983892    652803901470   0.08 │  479964   479904   0.01 │   0    0    nan │
│                coq-bedrock2 │  335.52   332.36   0.95 │   932380846140    923653120281   0.94 │  1537324667425   1534214748760   0.20 │  752860   752788   0.01 │   0    0    nan │
│       coq-mathcomp-fingroup │   52.22    51.69   1.03 │   144740343650    144065582758   0.47 │   189321810285    188818228284   0.27 │  480796   482112  -0.27 │   0    0    nan │
│              coq-coquelicot │   74.86    74.01   1.15 │   206476391626    204171486903   1.13 │   241770220912    240561567083   0.50 │  558804   559144  -0.06 │   0    0    nan │
│                coq-coqprime │ 1499.00  1481.32   1.19 │  4166220819560   4117617316181   1.18 │  6594054211879   6589654252533   0.07 │ 1056228  1056320  -0.01 │   0    0    nan │
└─────────────────────────────┴─────────────────────────┴───────────────────────────────────────┴───────────────────────────────────────┴─────────────────────────┴─────────────────┘

Bench complete, failed to install packages:
coq-compcert
coq-flocq
coq-vst

view this post on Zulip Bench bot (May 26 2021 at 22:58):

Bench at https://gitlab.com/coq/coq/-/jobs/1291815742
For packages coq-bignums coq-hott coq-performance-tests-lite coq-engine-bench-lite coq-mathcomp-ssreflect coq-mathcomp-fingroup coq-mathcomp-algebra coq-mathcomp-solvable coq-mathcomp-field coq-mathcomp-character coq-mathcomp-odd-order coq-math-classes coq-corn coq-flocq coq-compcert coq-geocoq coq-color coq-coqprime coq-coqutil coq-bedrock2 coq-rewriter coq-fiat-core coq-fiat-parsers coq-fiat-crypto coq-unimath coq-coquelicot coq-lambda-rust coq-verdi coq-verdi-raft coq-fourcolor coq-rewriter-perf-SuperFast coq-perennial coq-vst
Testing Tentatively more efficient implementation of monomials.

┌─────────────────────────────┬──────────────────────────┬────────────────────────────────────────┬────────────────────────────────────────┬─────────────────────────┬─────────────────┐
│                             │      user time [s]       │               CPU cycles               │            CPU instructions            │  max resident mem [KB]  │   mem faults    │
│                             │                          │                                        │                                        │                         │                 │
│                package_name │     NEW      OLD   PDIFF │            NEW             OLD   PDIFF │            NEW             OLD   PDIFF │     NEW      OLD  PDIFF │ NEW  OLD  PDIFF │
├─────────────────────────────┼──────────────────────────┼────────────────────────────────────────┼────────────────────────────────────────┼─────────────────────────┼─────────────────┤
│                coq-coqprime │ 1151.53  1490.74  -22.75 │  3205367310087   4150096930628  -22.76 │  5104517793434   6590530694000  -22.55 │ 1056184  1056440  -0.02 │   0    0    nan │
│       coq-engine-bench-lite │  337.91   339.55   -0.48 │   948655193401    953757550627   -0.53 │  1657602576744   1660238907238   -0.16 │ 3541036  3541112  -0.00 │   0    0    nan │
│       coq-mathcomp-fingroup │   52.25    52.42   -0.32 │   145000174491    144968596783    0.02 │   188955040367    188984087000   -0.02 │  482056   482008   0.01 │   0    0    nan │
│                    coq-core │  110.27   110.52   -0.23 │   310273590116    310334948351   -0.02 │   457048292680    457128506760   -0.02 │  276836   276848  -0.00 │   0    0    nan │
│            coq-math-classes │  188.50   188.89   -0.21 │   519260528786    518870460742    0.08 │   653111005037    653081651555    0.00 │  479884   479732   0.03 │   0    0    nan │
│               coq-perennial │ 7289.63  7302.72   -0.18 │ 20270589823739  20306213296519   -0.18 │ 29136107428299  29174012613412   -0.13 │ 3115920  3126088  -0.33 │   0    0    nan │
│                 coq-bignums │   59.52    59.62   -0.17 │   164343262758    164383141471   -0.02 │   209245096586    210001275896   -0.36 │  462740   463164  -0.09 │   0    0    nan │
│                    coq-hott │  299.08   299.49   -0.14 │   811441105905    810659408333    0.10 │  1188029884599   1187946488235    0.01 │  583912   584000  -0.02 │   0    0    nan │
│            coq-fiat-parsers │  644.98   645.66   -0.11 │  1793264679238   1795644496343   -0.13 │  2555863890117   2555546932288    0.01 │ 3274636  3274624   0.00 │   0    0    nan │
│                 coq-unimath │ 4166.87  4167.93   -0.03 │ 11578942787381  11584140223711   -0.04 │ 21237860790166  21236309681602    0.01 │ 1121412  1121392   0.00 │   0    0    nan │
│  coq-performance-tests-lite │ 1681.25  1681.64   -0.02 │  4702111734817   4695310162069    0.14 │  7449034499152   7450885845399   -0.02 │ 1904592  1904608  -0.00 │   0    0    nan │
│                 coq-coqutil │   62.23    62.21    0.03 │   171368010968    171542126458   -0.10 │   214054711404    213824646937    0.11 │  598316   598424  -0.02 │   0    0    nan │
│                coq-bedrock2 │  334.82   334.71    0.03 │   928405288499    928945549304   -0.06 │  1532838224460   1534447254110   -0.10 │  752916   752796   0.02 │   0    0    nan │
│              coq-verdi-raft │ 1243.71  1243.23    0.04 │  3459878780686   3457232892806    0.08 │  4615107285218   4615272372079   -0.00 │  902380   902468  -0.01 │   0    0    nan │
│             coq-fiat-crypto │ 5136.35  5133.30    0.06 │ 14290107395232  14280509027511    0.07 │ 23995258858063  23999551965245   -0.02 │ 2215408  2216628  -0.06 │   0    0    nan │
│               coq-fourcolor │ 2717.90  2715.43    0.09 │  7568532132994   7562970970834    0.07 │ 12245962897780  12246270927189   -0.00 │  730884   730864   0.00 │   0    0    nan │
│                coq-rewriter │  727.96   727.04    0.13 │  2026133878376   2022616089071    0.17 │  2947698741720   2945830574796    0.06 │ 1101180  1101308  -0.01 │   0    0    nan │
│                  coq-geocoq │ 1458.99  1457.03    0.13 │  4044747884305   4040760445443    0.10 │  5635637286847   5633773314081    0.03 │  992272   992280  -0.00 │   0    0    nan │
│ coq-rewriter-perf-SuperFast │  800.03   798.94    0.14 │  2230474880811   2227927606133    0.11 │  3309445903830   3309318885879    0.00 │ 1101048  1101100  -0.00 │   0    0    nan │
│                    coq-corn │ 1577.54  1575.34    0.14 │  4382152661002   4378394846874    0.09 │  5984747502845   5986204700686   -0.02 │  816892   816932  -0.00 │   0    0    nan │
│          coq-mathcomp-field │  239.50   239.12    0.16 │   666065393869    664775116955    0.19 │   953683579015    953753577117   -0.01 │  664732   663960   0.12 │   0    0    nan │
│                   coq-color │  527.94   527.09    0.16 │  1466084242310   1462020158080    0.28 │  1724432008186   1724037201895    0.02 │ 1104776  1123260  -1.65 │   0    0    nan │
│                         coq │    4.59     4.58    0.22 │    12625698632     12562938169    0.50 │    23566113732     23566476940   -0.00 │  276788   276776   0.00 │   0    0    nan │
│      coq-mathcomp-ssreflect │   58.24    58.09    0.26 │   160640660649    159786680750    0.53 │   189901053329    189892834333    0.00 │  523244   523256  -0.00 │   0    0    nan │
│      coq-mathcomp-odd-order │ 1135.49  1132.14    0.30 │  3157109256061   3149464505103    0.24 │  4707722235449   4707696108439    0.00 │  908616   911084  -0.27 │   0    0    nan │
│        coq-mathcomp-algebra │  151.10   150.62    0.32 │   419293876438    418572054241    0.17 │   507759707557    507693811467    0.01 │  552648   552792  -0.03 │   0    0    nan │
│                  coq-stdlib │  422.31   420.82    0.35 │  1182853654096   1180456996460    0.20 │  1469145126191   1470072429154   -0.06 │  566328   566216   0.02 │   0    0    nan │
│               coq-fiat-core │  116.82   116.39    0.37 │   328772898838    327423632003    0.41 │   409904787570    408801178878    0.27 │  479764   479660   0.02 │   0    0    nan │
│             coq-lambda-rust │ 1362.88  1357.58    0.39 │  3787185861126   3780054766932    0.19 │  5121831607518   5121279362645    0.01 │ 1096048  1097600  -0.14 │   0    0    nan │
│       coq-mathcomp-solvable │  185.24   184.51    0.40 │   514613201309    512659547182    0.38 │   680784728375    680742248403    0.01 │  683720   689988  -0.91 │   0    0    nan │
│      coq-mathcomp-character │  163.69   163.03    0.40 │   454783363264    453464791321    0.29 │   596566101433    596679700840   -0.02 │  744620   713912   4.30 │   0    0    nan │
│                   coq-verdi │  106.39   105.89    0.47 │   292978223781    291728028240    0.43 │   387282041523    386524866146    0.20 │  540276   540148   0.02 │   0    0    nan │
│              coq-coquelicot │   74.53    73.98    0.74 │   205839188824    204067291864    0.87 │   241454880559    240722302456    0.30 │  559200   559132   0.01 │   0    0    nan │
└─────────────────────────────┴──────────────────────────┴────────────────────────────────────────┴────────────────────────────────────────┴─────────────────────────┴─────────────────┘

Bench complete, failed to install packages:
coq-compcert
coq-flocq
coq-vst

view this post on Zulip Bench bot (May 27 2021 at 19:16):

Bench at https://gitlab.com/coq/coq/-/jobs/1294686381
For packages coq-bignums coq-hott coq-performance-tests-lite coq-engine-bench-lite coq-mathcomp-ssreflect coq-mathcomp-fingroup coq-mathcomp-algebra coq-mathcomp-solvable coq-mathcomp-field coq-mathcomp-character coq-mathcomp-odd-order coq-math-classes coq-corn coq-flocq coq-compcert coq-geocoq coq-color coq-coqprime coq-coqutil coq-bedrock2 coq-rewriter coq-fiat-core coq-fiat-parsers coq-fiat-crypto coq-unimath coq-coquelicot coq-lambda-rust coq-verdi coq-verdi-raft coq-fourcolor coq-rewriter-perf-SuperFast coq-perennial coq-vst
Testing Update test-suite, changelog, and documentation

┌─────────────────────────────┬─────────────────────────┬───────────────────────────────────────┬───────────────────────────────────────┬─────────────────────────┬─────────────────┐
│                             │      user time [s]      │              CPU cycles               │           CPU instructions            │  max resident mem [KB]  │   mem faults    │
│                             │                         │                                       │                                       │                         │                 │
│                package_name │     NEW      OLD  PDIFF │            NEW             OLD  PDIFF │            NEW             OLD  PDIFF │     NEW      OLD  PDIFF │ NEW  OLD  PDIFF │
├─────────────────────────────┼─────────────────────────┼───────────────────────────────────────┼───────────────────────────────────────┼─────────────────────────┼─────────────────┤
│  coq-performance-tests-lite │ 1680.40  1687.66  -0.43 │  4695039279543   4710206978177  -0.32 │  7452216937427   7454586890554  -0.03 │ 1902280  1902140   0.01 │   0    0    nan │
│       coq-engine-bench-lite │  337.60   339.03  -0.42 │   947942760539    949949282665  -0.21 │  1655522592291   1655979430249  -0.03 │ 3536356  3536276   0.00 │   0    0    nan │
│          coq-mathcomp-field │  239.16   239.93  -0.32 │   665298024969    666827659014  -0.23 │   953692717350    953721373057  -0.00 │  664644   664592   0.01 │   0    0    nan │
│              coq-coquelicot │   74.08    74.25  -0.23 │   204746555258    204758342575  -0.01 │   241326447436    240706391768   0.26 │  560108   559240   0.16 │   0    0    nan │
│                 coq-unimath │ 4174.71  4179.29  -0.11 │ 11601730287444  11614377704817  -0.11 │ 21238730052039  21235278729183   0.02 │ 1123052  1123024   0.00 │   0    0    nan │
│                   coq-color │  527.40   527.90  -0.09 │  1461885140785   1463054711743  -0.08 │  1724774726953   1723898074972   0.05 │ 1131868  1131624   0.02 │   0    0    nan │
│       coq-mathcomp-solvable │  184.55   184.72  -0.09 │   512343751370    512699705543  -0.07 │   680575724107    680683580196  -0.02 │  683484   683428   0.01 │   0    0    nan │
│             coq-lambda-rust │ 1359.81  1360.97  -0.09 │  3786432233462   3788151621986  -0.05 │  5118477431329   5121415517383  -0.06 │ 1105072  1109104  -0.36 │   0    0    nan │
│      coq-mathcomp-character │  163.20   163.33  -0.08 │   453448048879    454125066380  -0.15 │   596477679372    596537700293  -0.01 │  744432   744972  -0.07 │   0    0    nan │
│        coq-mathcomp-algebra │  150.09   150.20  -0.07 │   417716713404    418026944426  -0.07 │   507650317925    507713548663  -0.01 │  552144   552580  -0.08 │   0    0    nan │
│      coq-mathcomp-odd-order │ 1131.11  1131.78  -0.06 │  3146963188924   3148288876385  -0.04 │  4707098723563   4707528284729  -0.01 │  903608   911540  -0.87 │   0    0    nan │
│               coq-perennial │ 7289.67  7291.20  -0.02 │ 20302502811957  20309172756631  -0.03 │ 29178705898729  29181617710245  -0.01 │ 3115000  3128088  -0.42 │   0    0    nan │
│                    coq-hott │  300.55   300.50   0.02 │   811951006147    811477305800   0.06 │  1187929397859   1187967458204  -0.00 │  584280   583924   0.06 │   0    0    nan │
│            coq-fiat-parsers │  645.18   645.07   0.02 │  1789565357679   1791811894051  -0.13 │  2555410935562   2555665473984  -0.01 │ 3270980  3270800   0.01 │   0    0    nan │
│                    coq-corn │ 1573.52  1572.90   0.04 │  4367802454165   4368088611048  -0.01 │  5985770579741   5986181771168  -0.01 │  816968   816980  -0.00 │   0    0    nan │
│                coq-bedrock2 │  334.92   334.62   0.09 │   930227610610    928641136296   0.17 │  1534703561354   1532982392593   0.11 │  752832   752724   0.01 │   0    0    nan │
│                  coq-geocoq │ 1462.25  1459.73   0.17 │  4060370823714   4055898157894   0.11 │  5633342744651   5631897164529   0.03 │  991324   991188   0.01 │   0    0    nan │
│             coq-fiat-crypto │ 5136.02  5126.29   0.19 │ 14301014942093  14271162268583   0.21 │ 24017046448036  24003677257273   0.06 │ 2209664  2216424  -0.30 │   0    0    nan │
│ coq-rewriter-perf-SuperFast │  798.70   797.02   0.21 │  2227304326212   2221872774694   0.24 │  3309607607655   3309367673872   0.01 │ 1099912  1100012  -0.01 │   0    0    nan │
│               coq-fiat-core │  116.40   116.11   0.25 │   327534848797    326980494489   0.17 │   409784194088    408725042330   0.26 │  479472   479504  -0.01 │   0    0    nan │
│                    coq-core │  110.92   110.63   0.26 │   310244344242    310611827204  -0.12 │   457044165258    457040675581   0.00 │  295660   295752  -0.03 │   0    0    nan │
│              coq-verdi-raft │ 1243.83  1240.42   0.27 │  3462109575990   3446104833275   0.46 │  4614155913464   4613437871166   0.02 │  902392   902684  -0.03 │   0    0    nan │
│                coq-rewriter │  727.73   725.66   0.29 │  2022321402185   2016621283849   0.28 │  2947786784020   2945613442937   0.07 │ 1100120  1100132  -0.00 │   0    0    nan │
│                  coq-stdlib │  422.25   420.86   0.33 │  1184778209110   1181124259005   0.31 │  1469941691972   1469961202518  -0.00 │  566404   566056   0.06 │   0    0    nan │
│                 coq-bignums │   59.69    59.48   0.35 │   164690330293    164249046608   0.27 │   209977100438    209943478758   0.02 │  473732   473696   0.01 │   0    0    nan │
│       coq-mathcomp-fingroup │   52.23    52.04   0.37 │   144526070015    144616721590  -0.06 │   188947961554    188936907421   0.01 │  482040   481916   0.03 │   0    0    nan │
│               coq-fourcolor │ 2706.76  2696.56   0.38 │  7535870099959   7511028061171   0.33 │ 12245655965721  12244217828260   0.01 │  730180   730244  -0.01 │   0    0    nan │
│                         coq │    4.56     4.54   0.44 │    12510602602     12544964466  -0.27 │    23497982294     23494264155   0.02 │  276960   276924   0.01 │   0    0    nan │
│            coq-math-classes │  188.92   188.08   0.45 │   519243558603    518286650128   0.18 │   652974109444    652976449156  -0.00 │  479876   479832   0.01 │   0    0    nan │
│      coq-mathcomp-ssreflect │   58.42    58.07   0.60 │   160153096870    159780561108   0.23 │   189829389590    189856607009  -0.01 │  523020   523372  -0.07 │   0    0    nan │
│                   coq-verdi │  106.25   105.60   0.62 │   292933186841    292193084061   0.25 │   387254746313    386461617024   0.21 │  540232   540260  -0.01 │   0    0    nan │
│                coq-coqprime │ 1498.22  1488.90   0.63 │  4172728443195   4144866513626   0.67 │  6592762717816   6592172864818   0.01 │ 1055644  1055564   0.01 │   0    0    nan │
│                 coq-coqutil │   62.79    62.13   1.06 │   172807000788    171399770406   0.82 │   214162470911    213824674586   0.16 │  598440   597684   0.13 │   0    0    nan │
└─────────────────────────────┴─────────────────────────┴───────────────────────────────────────┴───────────────────────────────────────┴─────────────────────────┴─────────────────┘

Bench complete, failed to install packages:
coq-compcert
coq-flocq
coq-vst

view this post on Zulip Bench bot (May 28 2021 at 15:37):

Bench at https://gitlab.com/coq/coq/-/jobs/1301186577
For packages coq-bignums coq-hott coq-performance-tests-lite coq-engine-bench-lite coq-mathcomp-ssreflect coq-mathcomp-fingroup coq-mathcomp-algebra coq-mathcomp-solvable coq-mathcomp-field coq-mathcomp-character coq-mathcomp-odd-order coq-math-classes coq-corn coq-flocq coq-compcert coq-geocoq coq-color coq-coqprime coq-coqutil coq-bedrock2 coq-rewriter coq-fiat-core coq-fiat-parsers coq-fiat-crypto coq-unimath coq-coquelicot coq-lambda-rust coq-verdi coq-verdi-raft coq-fourcolor coq-rewriter-perf-SuperFast coq-perennial coq-vst
Testing Do not consider scutinees of projections and cases as heads for hint mode "!"

┌─────────────────────────────┬─────────────────────────┬───────────────────────────────────────┬───────────────────────────────────────┬─────────────────────────┬─────────────────┐
│                             │      user time [s]      │              CPU cycles               │           CPU instructions            │  max resident mem [KB]  │   mem faults    │
│                             │                         │                                       │                                       │                         │                 │
│                package_name │     NEW      OLD  PDIFF │            NEW             OLD  PDIFF │            NEW             OLD  PDIFF │     NEW      OLD  PDIFF │ NEW  OLD  PDIFF │
├─────────────────────────────┼─────────────────────────┼───────────────────────────────────────┼───────────────────────────────────────┼─────────────────────────┼─────────────────┤
│                         coq │    4.52     4.55  -0.66 │    12571747546     12632825682  -0.48 │    23620671860     23626734175  -0.03 │  284544   277224   2.64 │   0    0    nan │
│                    coq-corn │ 1583.61  1593.15  -0.60 │  4392132371746   4418937978885  -0.61 │  6021740653945   6022039254895  -0.00 │  818636   818460   0.02 │   0    0    nan │
│            coq-math-classes │  188.97   189.96  -0.52 │   520615584052    523632129069  -0.58 │   654332491741    654306184348   0.00 │  481032   481096  -0.01 │   0    0    nan │
│                coq-coqprime │ 1480.40  1487.67  -0.49 │  4121852981759   4134838602576  -0.31 │  6591701505524   6590488924009   0.02 │ 1036796  1036860  -0.01 │   0    0    nan │
│               coq-perennial │ 7301.95  7332.77  -0.42 │ 20338383860611  20425354727227  -0.43 │ 29159423190500  29190346968974  -0.11 │ 3074416  3119492  -1.44 │   0    0    nan │
│             coq-lambda-rust │ 1366.64  1372.39  -0.42 │  3805408382818   3813721820217  -0.22 │  5132641844250   5127133058975   0.11 │ 1099556  1095208   0.40 │   0    0    nan │
│            coq-fiat-parsers │  646.56   649.19  -0.41 │  1798854529929   1805311651772  -0.36 │  2559166202521   2558235852965   0.04 │ 3193580  3193420   0.01 │   0    0    nan │
│               coq-fourcolor │ 2711.75  2720.82  -0.33 │  7552424478460   7577507680145  -0.33 │ 12249176373824  12247285471316   0.02 │  732968   733068  -0.01 │   0    0    nan │
│                 coq-coqutil │   63.23    63.44  -0.33 │   173129760759    174316685387  -0.68 │   214909491981    214505387522   0.19 │  598544   598472   0.01 │   0    0    nan │
│                 coq-unimath │ 4182.92  4196.55  -0.32 │ 11624323336271  11662164352785  -0.32 │ 21256458832351  21252849918562   0.02 │ 1123668  1123680  -0.00 │   0    0    nan │
│                 coq-bignums │   59.76    59.94  -0.30 │   165385663771    165737945674  -0.21 │   210350659987    210320318569   0.01 │  462376   462316   0.01 │   0    0    nan │
│ coq-rewriter-perf-SuperFast │  812.74   814.82  -0.26 │  2267052786734   2272733642355  -0.25 │  3341921916375   3341732259945   0.01 │ 1089800  1089820  -0.00 │   0    0    nan │
│             coq-fiat-crypto │ 5155.62  5167.89  -0.24 │ 14357668107170  14376843203819  -0.13 │ 24007715548121  24002575981082   0.02 │ 2220800  2221964  -0.05 │   0    0    nan │
│                coq-rewriter │  740.82   742.39  -0.21 │  2060439100693   2064985284068  -0.22 │  2977293808616   2974609106337   0.09 │ 1089928  1089840   0.01 │   0    0    nan │
│      coq-mathcomp-odd-order │ 1142.66  1144.90  -0.20 │  3178700909381   3182460492155  -0.12 │  4709580545535   4709346324801   0.00 │  941324   941168   0.02 │   0    0    nan │
│              coq-verdi-raft │ 1245.70  1248.06  -0.19 │  3465509455463   3473380710994  -0.23 │  4617609188386   4617344967087   0.01 │  903632   903748  -0.01 │   0    0    nan │
│                coq-bedrock2 │  330.12   330.61  -0.15 │   915838918410    917269207342  -0.16 │  1519099984789   1518671646099   0.03 │  799884   799872   0.00 │   0    0    nan │
│               coq-fiat-core │  117.40   117.56  -0.14 │   330223805126    330069258689   0.05 │   411833101371    410684757319   0.28 │  480732   480680   0.01 │   0    0    nan │
│       coq-mathcomp-fingroup │   52.46    52.52  -0.11 │   145705553980    145571982155   0.09 │   189279691217    189261411441   0.01 │  482480   482608  -0.03 │   0    0    nan │
│                   coq-color │  531.24   531.83  -0.11 │  1471577451218   1473789372839  -0.15 │  1729190346450   1728307485899   0.05 │ 1132828  1133352  -0.05 │   0    0    nan │
│                    coq-core │  110.78   110.78   0.00 │   309982563298    310052448123  -0.02 │   456964494434    457092449787  -0.03 │  277276   277248   0.01 │   0    0    nan │
│                   coq-verdi │  106.72   106.69   0.03 │   294315355217    294403268358  -0.03 │   387828473275    387115581996   0.18 │  542504   542524  -0.00 │   0    0    nan │
│                    coq-hott │  367.00   366.81   0.05 │   997546304919    995715877461   0.18 │  1406080530640   1406078884367   0.00 │  582332   582228   0.02 │   0    0    nan │
│      coq-mathcomp-character │  164.46   164.27   0.12 │   457497836039    456777870315   0.16 │   597015393662    596873316183   0.02 │  718652   733088  -1.97 │   0    0    nan │
│       coq-mathcomp-solvable │  186.25   186.03   0.12 │   516932617417    517035377624  -0.02 │   681542358319    681566304212  -0.00 │  695684   681184   2.13 │   0    0    nan │
│          coq-mathcomp-field │  240.79   240.43   0.15 │   669764754137    669096456678   0.10 │   953907021381    953932850579  -0.00 │  662052   662024   0.00 │   0    0    nan │
│        coq-mathcomp-algebra │  151.43   151.20   0.15 │   421029812237    420100551265   0.22 │   508148289547    508159756271  -0.00 │  553160   553076   0.02 │   0    0    nan │
│      coq-mathcomp-ssreflect │   58.39    58.28   0.19 │   161242320922    160796541185   0.28 │   190363658522    190367922239  -0.00 │  524068   524008   0.01 │   0    0    nan │
│       coq-engine-bench-lite │  338.42   337.77   0.19 │   951340425818    948158141694   0.34 │  1659283500116   1660020097507  -0.04 │ 3506792  3506740   0.00 │   0    0    nan │
│                  coq-stdlib │  429.81   428.85   0.22 │  1204559137548   1203156287276   0.12 │  1491430683037   1491571664247  -0.01 │  568604   568520   0.01 │   0    0    nan │
│                  coq-geocoq │ 1466.22  1461.59   0.32 │  4073332387684   4065709783264   0.19 │  5638563747247   5638196025104   0.01 │  989536   978924   1.08 │   0    0    nan │
│  coq-performance-tests-lite │ 1693.25  1687.41   0.35 │  4727300851558   4710406394366   0.36 │  7454379956278   7450063781096   0.06 │ 1851556  1851688  -0.01 │   0    0    nan │
│              coq-coquelicot │   75.12    74.62   0.67 │   207065053237    206410205168   0.32 │   242010679280    241350637100   0.27 │  560864   560948  -0.01 │   0    0    nan │
└─────────────────────────────┴─────────────────────────┴───────────────────────────────────────┴───────────────────────────────────────┴─────────────────────────┴─────────────────┘

Failed '$program_path/timelog2html $new_opam_root/$new_base_path/${vo%%o} $old_opam_root/$old_base_path/${vo%%o}.timing $new_opam_root/$new_base_path/${vo%%o}.timing > $working_dir/html/$coq_opam_package/${vo%%o}.html' with exit code 1.

view this post on Zulip Bench bot (May 29 2021 at 12:45):

Bench at https://gitlab.com/coq/coq/-/jobs/1303567423
For packages coq-bignums coq-hott coq-performance-tests-lite coq-engine-bench-lite coq-mathcomp-ssreflect coq-mathcomp-fingroup coq-mathcomp-algebra coq-mathcomp-solvable coq-mathcomp-field coq-mathcomp-character coq-mathcomp-odd-order coq-math-classes coq-corn coq-flocq coq-compcert coq-geocoq coq-color coq-coqprime coq-coqutil coq-bedrock2 coq-rewriter coq-fiat-core coq-fiat-parsers coq-fiat-crypto coq-unimath coq-coquelicot coq-lambda-rust coq-verdi coq-verdi-raft coq-fourcolor coq-rewriter-perf-SuperFast coq-perennial coq-vst
Testing guard against timelog2html failure

┌─────────────────────────────┬─────────────────────────┬───────────────────────────────────────┬───────────────────────────────────────┬─────────────────────────┬─────────────────┐
│                             │      user time [s]      │              CPU cycles               │           CPU instructions            │  max resident mem [KB]  │   mem faults    │
│                             │                         │                                       │                                       │                         │                 │
│                package_name │     NEW      OLD  PDIFF │            NEW             OLD  PDIFF │            NEW             OLD  PDIFF │     NEW      OLD  PDIFF │ NEW  OLD  PDIFF │
├─────────────────────────────┼─────────────────────────┼───────────────────────────────────────┼───────────────────────────────────────┼─────────────────────────┼─────────────────┤
│                 coq-coqutil │   62.02    62.54  -0.83 │   171859923372    172424433051  -0.33 │   214961827959    214579774158   0.18 │  601340   601460  -0.02 │   0    0    nan │
│        coq-mathcomp-algebra │  150.76   151.45  -0.46 │   418989673041    420135176022  -0.27 │   509580699678    509628710904  -0.01 │  554268   554296  -0.01 │   0    0    nan │
│               coq-fourcolor │ 2708.92  2720.04  -0.41 │  7546412265737   7575234397283  -0.38 │ 12249780447073  12252481243960  -0.02 │  732972   732848   0.02 │   0    0    nan │
│                    coq-hott │  365.56   366.98  -0.39 │   992964844181    995256698562  -0.23 │  1410417867456   1410663127726  -0.02 │  566248   566332  -0.01 │   0    0    nan │
│      coq-mathcomp-ssreflect │   58.11    58.32  -0.36 │   160147230141    160700204071  -0.34 │   190764168653    190761351692   0.00 │  522608   522744  -0.03 │   0    0    nan │
│      coq-mathcomp-character │  163.80   164.21  -0.25 │   455392240406    456142348975  -0.16 │   598945712473    599036560809  -0.02 │  732876   732916  -0.01 │   0    0    nan │
│              coq-verdi-raft │ 1241.69  1244.46  -0.22 │  3454157118227   3463215319434  -0.26 │  4626006068020   4627307728602  -0.03 │  902564   902496   0.01 │   0    0    nan │
│       coq-mathcomp-solvable │  185.37   185.71  -0.18 │   514768463906    515692135601  -0.18 │   683654021015    683734345412  -0.01 │  674116   674200  -0.01 │   0    0    nan │
│             coq-lambda-rust │ 1363.24  1365.57  -0.17 │  3795304544897   3795795367150  -0.01 │  5140354409020   5139905254382   0.01 │ 1099472  1099820  -0.03 │   0    0    nan │
│                   coq-color │  530.18   531.06  -0.17 │  1468522290251   1471046521769  -0.17 │  1730958469679   1729941823875   0.06 │ 1138728  1138492   0.02 │   0    0    nan │
│                  coq-stdlib │  427.51   428.16  -0.15 │  1198763406640   1200236807908  -0.12 │  1492782939873   1492943747076  -0.01 │  570708   570784  -0.01 │   0    0    nan │
│              coq-coquelicot │   74.38    74.48  -0.13 │   205044716556    205435360337  -0.19 │   242372245655    241731913566   0.26 │  559288   559828  -0.10 │   0    0    nan │
│                 coq-bignums │   59.94    60.02  -0.13 │   164762712914    165453592465  -0.42 │   209895022349    209917802821  -0.01 │  467108   467036   0.02 │   0    0    nan │
│                    coq-corn │ 1582.63  1584.21  -0.10 │  4397558669830   4403910579178  -0.14 │  6040985192561   6040907445857   0.00 │  810772   810832  -0.01 │   0    0    nan │
│            coq-math-classes │  187.97   188.13  -0.09 │   518025972026    519679177875  -0.32 │   654801654437    654783796641   0.00 │  481108   481176  -0.01 │   0    0    nan │
│      coq-mathcomp-odd-order │ 1135.53  1136.41  -0.08 │  3158691138935   3161687052287  -0.09 │  4724297592578   4724331915697  -0.00 │  941196   941288  -0.01 │   0    0    nan │
│ coq-rewriter-perf-SuperFast │  812.29   812.63  -0.04 │  2265218904106   2267734177191  -0.11 │  3347642868539   3347120021502   0.02 │ 1089032  1089176  -0.01 │   0    0    nan │
│               coq-perennial │ 7297.74  7298.49  -0.01 │ 20325422300724  20329092037420  -0.02 │ 29181745044654  29193436911610  -0.04 │ 3119720  3096284   0.76 │   0    0    nan │
│                   coq-verdi │  106.41   106.41   0.00 │   293560469475    293364672221   0.07 │   388719949229    387998759492   0.19 │  544540   544864  -0.06 │   0    0    nan │
│          coq-mathcomp-field │  239.73   239.72   0.00 │   666555115624    667004024937  -0.07 │   955658664112    955646081199   0.00 │  659952   659816   0.02 │   0    0    nan │
│                  coq-geocoq │ 1461.57  1461.47   0.01 │  4062047453409   4061235910635   0.02 │  5645726986861   5645214815315   0.01 │  983996   984084  -0.01 │   0    0    nan │
│                coq-rewriter │  739.28   739.18   0.01 │  2055311403594   2054114062321   0.06 │  2979981985432   2977852804337   0.07 │ 1089304  1089176   0.01 │   0    0    nan │
│       coq-mathcomp-fingroup │   52.31    52.30   0.02 │   144987811693    145546739220  -0.38 │   189809640693    189800522599   0.00 │  480420   480348   0.01 │   0    0    nan │
│            coq-fiat-parsers │  648.25   648.08   0.03 │  1800007696455   1801662094946  -0.09 │  2567340993195   2566922664626   0.02 │ 3584792  3584840  -0.00 │   0    0    nan │
│                    coq-core │  110.66   110.50   0.14 │   310344510803    310238165642   0.03 │   457184652448    457191523048  -0.00 │  277328   277244   0.03 │   0    0    nan │
│                coq-bedrock2 │  327.54   327.06   0.15 │   910049215277    909267310124   0.09 │  1520807702232   1520326521681   0.03 │  770988   799900  -3.61 │   0    0    nan │
│             coq-fiat-crypto │ 5151.14  5143.26   0.15 │ 14346529577939  14315636522370   0.22 │ 24024792129917  24007228778534   0.07 │ 2224324  2221548   0.12 │   0    0    nan │
│  coq-performance-tests-lite │ 1683.66  1680.92   0.16 │  4700927750981   4700000932095   0.02 │  7469949084145   7469497127176   0.01 │ 2084924  2085008  -0.00 │   0    0    nan │
│               coq-fiat-core │  117.64   117.44   0.17 │   329722932907    330019894665  -0.09 │   412037511150    410965224080   0.26 │  479580   479472   0.02 │   0    0    nan │
│                 coq-unimath │ 4181.62  4170.60   0.26 │ 11620863965476  11591676085897   0.25 │ 21286129110924  21286256313975  -0.00 │ 1130968  1130892   0.01 │   0    0    nan │
│       coq-engine-bench-lite │  336.51   335.06   0.43 │   945981672359    941544595250   0.47 │  1660352093305   1656623094464   0.23 │ 3507160  3507156   0.00 │   0    0    nan │
│                coq-coqprime │ 1151.50  1144.16   0.64 │  3205348898961   3185316254938   0.63 │  5104107684768   5111102958446  -0.14 │ 1036696  1036988  -0.03 │   0    0    nan │
│                         coq │    4.60     4.53   1.55 │    12697683833     12558488725   1.11 │    23621591185     23626827986  -0.02 │  277284   277224   0.02 │   0    0    nan │
└─────────────────────────────┴─────────────────────────┴───────────────────────────────────────┴───────────────────────────────────────┴─────────────────────────┴─────────────────┘

Bench complete, failed to install packages:
coq-compcert
coq-flocq
coq-vst

view this post on Zulip Bench bot (May 30 2021 at 18:38):

Bench at https://gitlab.com/coq/coq/-/jobs/1304591833
For packages coq-bignums coq-hott coq-performance-tests-lite coq-engine-bench-lite coq-mathcomp-ssreflect coq-mathcomp-fingroup coq-mathcomp-algebra coq-mathcomp-solvable coq-mathcomp-field coq-mathcomp-character coq-mathcomp-odd-order coq-math-classes coq-corn coq-flocq coq-compcert coq-geocoq coq-color coq-coqprime coq-coqutil coq-bedrock2 coq-rewriter coq-fiat-core coq-fiat-parsers coq-fiat-crypto coq-unimath coq-coquelicot coq-lambda-rust coq-verdi coq-verdi-raft coq-fourcolor coq-rewriter-perf-SuperFast coq-perennial coq-vst
Testing Prevent a quadratic blowup in Micromega annotations.

┌─────────────────────────────┬─────────────────────────┬───────────────────────────────────────┬───────────────────────────────────────┬─────────────────────────┬─────────────────┐
│                             │      user time [s]      │              CPU cycles               │           CPU instructions            │  max resident mem [KB]  │   mem faults    │
│                             │                         │                                       │                                       │                         │                 │
│                package_name │     NEW      OLD  PDIFF │            NEW             OLD  PDIFF │            NEW             OLD  PDIFF │     NEW      OLD  PDIFF │ NEW  OLD  PDIFF │
├─────────────────────────────┼─────────────────────────┼───────────────────────────────────────┼───────────────────────────────────────┼─────────────────────────┼─────────────────┤
│                coq-coqprime │ 1051.21  1137.62  -7.60 │  2925285456095   3160503588764  -7.44 │  4807668903703   5103445962648  -5.80 │  940192  1036884  -9.33 │   0    0    nan │
│                    coq-core │  110.93   111.29  -0.32 │   310531808880    310422361789   0.04 │   457113633868    457113124336   0.00 │  311056   311124  -0.02 │   0    0    nan │
│       coq-engine-bench-lite │  336.11   336.58  -0.14 │   944150975087    944993127192  -0.09 │  1654602748347   1656403240127  -0.11 │ 3507164  3507044   0.00 │   0    0    nan │
│  coq-performance-tests-lite │ 1688.42  1690.72  -0.14 │  4722813667628   4721967351859   0.02 │  7469311908485   7472852057010  -0.05 │ 2084944  2084936   0.00 │   0    0    nan │
│                 coq-unimath │ 4185.30  4190.06  -0.11 │ 11627678724456  11642056251252  -0.12 │ 21289108409446  21287750844503   0.01 │ 1130880  1130972  -0.01 │   0    0    nan │
│                   coq-color │  528.92   529.46  -0.10 │  1468424421904   1468965274519  -0.04 │  1730887058264   1729984659500   0.05 │ 1138724  1106724   2.89 │   0    0    nan │
│          coq-mathcomp-field │  239.85   240.04  -0.08 │   668058719868    668300704094  -0.04 │   955669368768    955564339335   0.01 │  659556   659388   0.03 │   0    0    nan │
│             coq-fiat-crypto │ 5146.69  5149.11  -0.05 │ 14331313707837  14325399664691   0.04 │ 24026802428732  24023012375258   0.02 │ 2218032  2218856  -0.04 │   0    0    nan │
│                         coq │    4.58     4.58   0.00 │    12692436234     12597460754   0.75 │    23634777448     23642336451  -0.03 │  284848   284832   0.01 │   0    0    nan │
│       coq-mathcomp-solvable │  185.79   185.78   0.01 │   516371926589    516339187828   0.01 │   683616647638    683654160993  -0.01 │  674104   674172  -0.01 │   0    0    nan │
│              coq-verdi-raft │ 1247.94  1247.66   0.02 │  3464167511375   3465024031301  -0.02 │  4627786752037   4625477064301   0.05 │  902040   902452  -0.05 │   0    0    nan │
│                    coq-corn │ 1593.18  1592.43   0.05 │  4417074963660   4416697510568   0.01 │  6041297321254   6040428815352   0.01 │  810668   810792  -0.02 │   0    0    nan │
│                coq-bedrock2 │  331.22   330.96   0.08 │   918941107556    918032598018   0.10 │  1521052077762   1520135870587   0.06 │  799940   769236   3.99 │   0    0    nan │
│            coq-fiat-parsers │  647.49   646.68   0.13 │  1799792558515   1795406282291   0.24 │  2567660949004   2567615899128   0.00 │ 3584764  3584796  -0.00 │   0    0    nan │
│      coq-mathcomp-odd-order │ 1141.02  1139.58   0.13 │  3172241840735   3169308837873   0.09 │  4723611908453   4723908357411  -0.01 │  941224   905656   3.93 │   0    0    nan │
│               coq-perennial │ 7303.41  7293.70   0.13 │ 20318562783996  20314780878361   0.02 │ 29189083747022  29192810534765  -0.01 │ 3098676  3124232  -0.82 │   0    0    nan │
│               coq-fiat-core │  117.10   116.94   0.14 │   329086671770    328196698956   0.27 │   412075928118    410915879430   0.28 │  479776   479800  -0.01 │   0    0    nan │
│        coq-mathcomp-algebra │  151.52   151.30   0.15 │   420702562285    419901946431   0.19 │   509574410360    509559718172   0.00 │  554216   554208   0.00 │   0    0    nan │
│ coq-rewriter-perf-SuperFast │  813.73   812.52   0.15 │  2269210781707   2265065892023   0.18 │  3347449159432   3346851662645   0.02 │ 1089044  1089036   0.00 │   0    0    nan │
│       coq-mathcomp-fingroup │   52.40    52.32   0.15 │   145108643137    145204436753  -0.07 │   189835621235    189795096624   0.02 │  480136   479992   0.03 │   0    0    nan │
│                coq-rewriter │  740.86   739.41   0.20 │  2058589396795   2056294307767   0.11 │  2979968968569   2977769124761   0.07 │ 1089328  1089368  -0.00 │   0    0    nan │
│              coq-coquelicot │   74.39    74.22   0.23 │   205617513440    204972288965   0.31 │   242371927587    241653411056   0.30 │  559728   559740  -0.00 │   0    0    nan │
│               coq-fourcolor │ 2723.56  2717.23   0.23 │  7577727040482   7558633307415   0.25 │ 12250690715128  12252584295570  -0.02 │  732928   732852   0.01 │   0    0    nan │
│            coq-math-classes │  189.28   188.83   0.24 │   520172159371    520058982917   0.02 │   654760253439    654781754470  -0.00 │  481220   481304  -0.02 │   0    0    nan │
│             coq-lambda-rust │ 1367.76  1364.35   0.25 │  3807777057459   3793008852940   0.39 │  5136079626275   5136492527769  -0.01 │ 1077456  1099484  -2.00 │   0    0    nan │
│                    coq-hott │  366.55   365.56   0.27 │   994470521356    996833231384  -0.24 │  1410588290272   1410579901406   0.00 │  566232   566324  -0.02 │   0    0    nan │
│                 coq-bignums │   59.86    59.69   0.28 │   164635750609    164375351381   0.16 │   210014492576    209997549279   0.01 │  467212   467012   0.04 │   0    0    nan │
│                  coq-stdlib │  429.12   427.85   0.30 │  1201995547388   1198055479144   0.33 │  1492867525419   1492954108146  -0.01 │  570900   570660   0.04 │   0    0    nan │
│      coq-mathcomp-character │  164.42   163.91   0.31 │   457056079674    455874166245   0.26 │   598866668913    598904960650  -0.01 │  732540   716248   2.27 │   0    0    nan │
│                  coq-geocoq │ 1463.28  1458.74   0.31 │  4058189677070   4046480147208   0.29 │  5645895989960   5644486819668   0.02 │  983816   984184  -0.04 │   0    0    nan │
│      coq-mathcomp-ssreflect │   58.49    58.27   0.38 │   160607025696    160244390620   0.23 │   190754588270    190725369656   0.02 │  522596   522760  -0.03 │   0    0    nan │
│                 coq-coqutil │   62.52    62.21   0.50 │   172229976220    171497948346   0.43 │   214972875092    214556479160   0.19 │  601732   601300   0.07 │   0    0    nan │
│                   coq-verdi │  106.65   106.12   0.50 │   294027689906    292760721346   0.43 │   388690265397    387996448041   0.18 │  544524   544540  -0.00 │   0    0    nan │
└─────────────────────────────┴─────────────────────────┴───────────────────────────────────────┴───────────────────────────────────────┴─────────────────────────┴─────────────────┘

Bench complete, failed to install packages:
coq-compcert
coq-flocq
coq-vst

view this post on Zulip Bench bot (May 31 2021 at 14:54):

Bench at https://gitlab.com/coq/coq/-/jobs/1305845432
For packages coq-coqprime
Testing Fast bound saturation in Micromega

┌──────────────┬─────────────────────────┬──────────────────────────────────────┬──────────────────────────────────────┬─────────────────────────┬─────────────────┐
│              │      user time [s]      │              CPU cycles              │           CPU instructions           │  max resident mem [KB]  │   mem faults    │
│              │                         │                                      │                                      │                         │                 │
│ package_name │    NEW      OLD   PDIFF │           NEW            OLD   PDIFF │           NEW            OLD   PDIFF │     NEW      OLD  PDIFF │ NEW  OLD  PDIFF │
├──────────────┼─────────────────────────┼──────────────────────────────────────┼──────────────────────────────────────┼─────────────────────────┼─────────────────┤
│ coq-coqprime │ 442.20  1143.58  -61.33 │ 1229104895591  3176935005078  -61.31 │ 1889957656121  5099909602882  -62.94 │ 1036124  1036408  -0.03 │   0    0    nan │
│          coq │   4.56     4.62   -1.30 │   12624910690    12699869704   -0.59 │   23690294327    23686002204    0.02 │  284244   284248  -0.00 │   0    0    nan │
│     coq-core │ 110.68   110.75   -0.06 │  310773742888   310858669945   -0.03 │  457445507639   457391030052    0.01 │  277352   277336   0.01 │   0    0    nan │
│   coq-stdlib │ 428.08   426.73    0.32 │ 1198756983567  1197681241595    0.09 │ 1492373921750  1493190148311   -0.05 │  570860   570900  -0.01 │   0    0    nan │
└──────────────┴─────────────────────────┴──────────────────────────────────────┴──────────────────────────────────────┴─────────────────────────┴─────────────────┘

Bench complete: all packages successfully installed.

view this post on Zulip Bench bot (Jun 01 2021 at 09:15):

Bench at https://gitlab.com/coq/coq/-/jobs/1306615590
For packages coq-bignums coq-hott coq-performance-tests-lite coq-engine-bench-lite coq-mathcomp-ssreflect coq-mathcomp-fingroup coq-mathcomp-algebra coq-mathcomp-solvable coq-mathcomp-field coq-mathcomp-character coq-mathcomp-odd-order coq-math-classes coq-corn coq-flocq coq-compcert coq-geocoq coq-color coq-coqprime coq-coqutil coq-bedrock2 coq-rewriter coq-fiat-core coq-fiat-parsers coq-fiat-crypto coq-unimath coq-coquelicot coq-lambda-rust coq-verdi coq-verdi-raft coq-fourcolor coq-rewriter-perf-SuperFast coq-perennial coq-vst
Testing Kernel sort comparison: fully delegate to ugraph

┌─────────────────────────────┬─────────────────────────┬───────────────────────────────────────┬───────────────────────────────────────┬─────────────────────────┬─────────────────┐
│                             │      user time [s]      │              CPU cycles               │           CPU instructions            │  max resident mem [KB]  │   mem faults    │
│                             │                         │                                       │                                       │                         │                 │
│                package_name │     NEW      OLD  PDIFF │            NEW             OLD  PDIFF │            NEW             OLD  PDIFF │     NEW      OLD  PDIFF │ NEW  OLD  PDIFF │
├─────────────────────────────┼─────────────────────────┼───────────────────────────────────────┼───────────────────────────────────────┼─────────────────────────┼─────────────────┤
│               coq-fiat-core │  111.29   111.53  -0.22 │   316838522138    316126865048   0.23 │   411688153438    410562498370   0.27 │  479328   479304   0.01 │   0    0    nan │
│             coq-fiat-crypto │ 5019.10  5024.75  -0.11 │ 13937229199434  13945539565588  -0.06 │ 24017069693475  24012161795451   0.02 │ 2221376  2223952  -0.12 │   0    0    nan │
│                    coq-core │  109.70   109.75  -0.05 │   303959760162    303729257322   0.08 │   457252021610    456987993855   0.06 │  296408   296504  -0.03 │   0    0    nan │
│            coq-fiat-parsers │  617.57   617.76  -0.03 │  1727292336684   1729715826929  -0.14 │  2560115580416   2558978390622   0.04 │ 3073188  3073368  -0.01 │   0    0    nan │
│                    coq-corn │ 1540.63  1540.88  -0.02 │  4289091763960   4290645753231  -0.04 │  6035930946402   6035714063983   0.00 │  810140   810056   0.01 │   0    0    nan │
│                   coq-color │  504.17   504.19  -0.00 │  1408742763122   1406033031157   0.19 │  1712928804570   1711961589700   0.06 │ 1141468  1141708  -0.02 │   0    0    nan │
│              coq-verdi-raft │ 1209.78  1209.73   0.00 │  3369679542996   3367047038554   0.08 │  4623803928338   4622957136339   0.02 │  901308   901680  -0.04 │   0    0    nan │
│       coq-mathcomp-solvable │  178.45   178.33   0.07 │   497676794982    496496611848   0.24 │   683193123514    683220290304  -0.00 │  693188   672544   3.07 │   0    0    nan │
│      coq-mathcomp-character │  158.11   157.96   0.09 │   439766434499    439003121419   0.17 │   598639051885    598678366180  -0.01 │  730820   715904   2.08 │   0    0    nan │
│             coq-lambda-rust │ 1325.07  1323.46   0.12 │  3692002748702   3688567131931   0.09 │  5139392732125   5137387249422   0.04 │ 1096004  1096396  -0.04 │   0    0    nan │
│  coq-performance-tests-lite │ 1654.55  1652.02   0.15 │  4612738224163   4610673898182   0.04 │  7469322834680   7470641587745  -0.02 │ 2077256  2077424  -0.01 │   0    0    nan │
│      coq-mathcomp-ssreflect │   55.69    55.58   0.20 │   154271394073    153700553715   0.37 │   190660750776    190711464290  -0.03 │  522116   522692  -0.11 │   0    0    nan │
│               coq-perennial │ 7093.65  7079.02   0.21 │ 19750223820529  19705326791457   0.23 │ 29183811229100  29187044268555  -0.01 │ 3095812  3091224   0.15 │   0    0    nan │
│                coq-rewriter │  721.00   719.20   0.25 │  2001597128908   1999264849385   0.12 │  2980004707299   2978088108425   0.06 │ 1071032  1071040  -0.00 │   0    0    nan │
│          coq-mathcomp-field │  231.42   230.74   0.29 │   645044244884    642931439534   0.33 │   955253158238    955324766840  -0.01 │  658992   657872   0.17 │   0    0    nan │
│               coq-fourcolor │ 2640.07  2631.81   0.31 │  7350356447813   7325929246089   0.33 │ 12249393114347  12250795219237  -0.01 │  730980   795200  -8.08 │   0    0    nan │
│ coq-rewriter-perf-SuperFast │  791.40   788.88   0.32 │  2203237688455   2198032077673   0.24 │  3345988763169   3345956234490   0.00 │ 1071080  1070804   0.03 │   0    0    nan │
│                    coq-hott │  351.46   350.25   0.35 │   974980672266    971885307680   0.32 │  1410519736900   1410309388450   0.01 │  568796   568780   0.00 │   0    0    nan │
│       coq-mathcomp-fingroup │   50.43    50.24   0.38 │   140314747431    140016501381   0.21 │   189763936308    189762137889   0.00 │  479888   479792   0.02 │   0    0    nan │
│                 coq-bignums │   58.04    57.82   0.38 │   160962494618    160378226820   0.36 │   210042502166    210064373496  -0.01 │  467316   467308   0.00 │   0    0    nan │
│            coq-math-classes │  182.46   181.68   0.43 │   507723213588    506819850062   0.18 │   654330474805    654297067059   0.01 │  481444   481436   0.00 │   0    0    nan │
│                  coq-geocoq │ 1423.62  1417.36   0.44 │  3968992876383   3950924725468   0.46 │  5641926510336   5640612149822   0.02 │  988756  1066908  -7.33 │   0    0    nan │
│              coq-coquelicot │   71.82    71.50   0.45 │   196948221701    196080046403   0.44 │   242306323396    241585587535   0.30 │  558724   558820  -0.02 │   0    0    nan │
│        coq-mathcomp-algebra │  145.32   144.59   0.50 │   405114707246    403135347550   0.49 │   509298785049    509271318758   0.01 │  553256   552864   0.07 │   0    0    nan │
│      coq-mathcomp-odd-order │ 1105.51  1099.82   0.52 │  3076549800483   3062656926302   0.45 │  4721473578731   4721758530276  -0.01 │  938432   903888   3.82 │   0    0    nan │
│                 coq-unimath │ 4073.74  4051.99   0.54 │ 11334574241844  11283572493513   0.45 │ 21288086984923  21281800334290   0.03 │ 1128284  1128448  -0.01 │   0    0    nan │
│       coq-engine-bench-lite │  328.56   326.74   0.56 │   925343971948    921919754733   0.37 │  1667280436456   1660924526185   0.38 │ 3506700  3506748  -0.00 │   0    0    nan │
│                  coq-stdlib │  425.02   422.16   0.68 │  1188334261974   1182678734969   0.48 │  1492161561523   1492103280575   0.00 │  596132   596088   0.01 │   0    0    nan │
│                coq-coqprime │ 1103.81  1095.98   0.71 │  3070120685318   3052618578124   0.57 │  5104521563847   5103563831382   0.02 │ 1035316  1035504  -0.02 │   0    0    nan │
│                   coq-verdi │  103.40   102.62   0.76 │   285066681233    283750871314   0.46 │   388577834874    387895076390   0.18 │  543948   544164  -0.04 │   0    0    nan │
│                coq-bedrock2 │  320.53   317.72   0.88 │   890641309583    883084221536   0.86 │  1520642003538   1519999012899   0.04 │  770432   797880  -3.44 │   0    0    nan │
│                 coq-coqutil │   60.56    59.68   1.47 │   167829566602    166561106660   0.76 │   214883323584    214490937780   0.18 │  600632   600740  -0.02 │   0    0    nan │
│                         coq │    4.58     4.48   2.23 │    12138758740     12129282221   0.08 │    23631551312     23656997642  -0.11 │  302092   302080   0.00 │   0    0    nan │
└─────────────────────────────┴─────────────────────────┴───────────────────────────────────────┴───────────────────────────────────────┴─────────────────────────┴─────────────────┘

Bench complete, failed to install packages:
coq-compcert
coq-flocq
coq-vst

view this post on Zulip Bench bot (Jun 02 2021 at 04:51):

Bench at https://gitlab.com/coq/coq/-/jobs/1309511962
For packages coq-bignums coq-hott coq-performance-tests-lite coq-engine-bench-lite coq-mathcomp-ssreflect coq-mathcomp-fingroup coq-mathcomp-algebra coq-mathcomp-solvable coq-mathcomp-field coq-mathcomp-character coq-mathcomp-odd-order coq-math-classes coq-corn coq-flocq coq-compcert coq-geocoq coq-color coq-coqprime coq-coqutil coq-bedrock2 coq-rewriter coq-fiat-core coq-fiat-parsers coq-fiat-crypto coq-unimath coq-coquelicot coq-lambda-rust coq-verdi coq-verdi-raft coq-fourcolor coq-rewriter-perf-SuperFast coq-perennial coq-vst
Testing Make a lookup of the canonical structure table faster

┌─────────────────────────────┬─────────────────────────┬───────────────────────────────────────┬───────────────────────────────────────┬─────────────────────────┬─────────────────┐
│                             │      user time [s]      │              CPU cycles               │           CPU instructions            │  max resident mem [KB]  │   mem faults    │
│                             │                         │                                       │                                       │                         │                 │
│                package_name │     NEW      OLD  PDIFF │            NEW             OLD  PDIFF │            NEW             OLD  PDIFF │     NEW      OLD  PDIFF │ NEW  OLD  PDIFF │
├─────────────────────────────┼─────────────────────────┼───────────────────────────────────────┼───────────────────────────────────────┼─────────────────────────┼─────────────────┤
│                         coq │    4.44     4.48  -0.89 │    12102594044     12108697225  -0.05 │    23664662608     23669008442  -0.02 │  277468   277460   0.00 │   0    0    nan │
│       coq-mathcomp-solvable │  178.11   178.06   0.03 │   495917381631    495100081683   0.17 │   682972481897    683200603706  -0.03 │  672672   693608  -3.02 │   0    0    nan │
│       coq-engine-bench-lite │  325.22   325.05   0.05 │   917005756547    917251377870  -0.03 │  1658617661041   1657926658425   0.04 │ 3506772  3506720   0.00 │   0    0    nan │
│ coq-rewriter-perf-SuperFast │  791.11   789.76   0.17 │  2202903478075   2198522369050   0.20 │  3347083683907   3345887093021   0.04 │ 1071016  1071024  -0.00 │   0    0    nan │
│                    coq-core │  110.05   109.86   0.17 │   303853798564    303994777699  -0.05 │   457011609310    456922085264   0.02 │  297008   297000   0.00 │   0    0    nan │
│       coq-mathcomp-fingroup │   50.28    50.19   0.18 │   139990953388    139535381110   0.33 │   189696298136    189759460843  -0.03 │  479856   479860  -0.00 │   0    0    nan │
│                coq-rewriter │  718.64   717.33   0.18 │  1999389071822   1992927309489   0.32 │  2979826887308   2978068916596   0.06 │ 1070956  1071040  -0.01 │   0    0    nan │
│            coq-math-classes │  181.28   180.94   0.19 │   505633628306    504535975796   0.22 │   654308147553    654280349644   0.00 │  481508   481640  -0.03 │   0    0    nan │
│                  coq-geocoq │ 1419.81  1417.08   0.19 │  3955362245529   3950688486984   0.12 │  5641799152570   5641060829240   0.01 │  985076   988612  -0.36 │   0    0    nan │
│  coq-performance-tests-lite │ 1654.39  1650.64   0.23 │  4613545020642   4602444892492   0.24 │  7470151219679   7470870083478  -0.01 │ 2077512  2077388   0.01 │   0    0    nan │
│      coq-mathcomp-character │  157.65   157.26   0.25 │   438631815680    437898242007   0.17 │   598131041060    598643413131  -0.09 │  731056   714208   2.36 │   0    0    nan │
│                    coq-hott │  349.66   348.75   0.26 │   971871616990    968166531926   0.38 │  1410534067810   1410652189924  -0.01 │  568848   568828   0.00 │   0    0    nan │
│        coq-mathcomp-algebra │  144.94   144.50   0.30 │   403317086149    402850255762   0.12 │   509167415054    509259865840  -0.02 │  553292   553072   0.04 │   0    0    nan │
│             coq-lambda-rust │ 1321.62  1317.50   0.31 │  3677550419290   3663289543062   0.39 │  5140605897493   5137933202040   0.05 │ 1076504  1096024  -1.78 │   0    0    nan │
│                   coq-verdi │  103.06   102.73   0.32 │   284659093442    283372103148   0.45 │   388592555249    387942462339   0.17 │  544112   544136  -0.00 │   0    0    nan │
│      coq-mathcomp-ssreflect │   55.66    55.48   0.32 │   153970958470    153274629273   0.45 │   190652989524    190641951680   0.01 │  522728   522900  -0.03 │   0    0    nan │
│          coq-mathcomp-field │  231.37   230.62   0.33 │   643224488993    642670722781   0.09 │   955152245813    955504569719  -0.04 │  662580   658864   0.56 │   0    0    nan │
│            coq-fiat-parsers │  619.07   617.06   0.33 │  1730844994204   1727456013476   0.20 │  2561736549762   2559459547542   0.09 │ 3073212  3073408  -0.01 │   0    0    nan │
│              coq-verdi-raft │ 1209.66  1205.72   0.33 │  3368068311144   3358182961476   0.29 │  4623943721237   4623140268844   0.02 │  900844   901260  -0.05 │   0    0    nan │
│             coq-fiat-crypto │ 5026.57  5007.17   0.39 │ 13956229697182  13898309185528   0.42 │ 24014019836622  24021045189065  -0.03 │ 2224684  2222256   0.11 │   0    0    nan │
│               coq-perennial │ 7072.93  7044.33   0.41 │ 19690893709774  19612171238228   0.40 │ 29212254271429  29187412097585   0.09 │ 3103756  3105768  -0.06 │   0    0    nan │
│                   coq-color │  505.64   502.92   0.54 │  1410429324220   1404743749100   0.40 │  1713012956330   1712008538076   0.06 │ 1141772  1141456   0.03 │   0    0    nan │
│      coq-mathcomp-odd-order │ 1100.07  1093.87   0.57 │  3060676222538   3043659725113   0.56 │  4718660678788   4721825086661  -0.07 │  938476   938436   0.00 │   0    0    nan │
│                    coq-corn │ 1542.83  1533.84   0.59 │  4295074450326   4271018407601   0.56 │  6037281938147   6036396537434   0.01 │  809716   809744  -0.00 │   0    0    nan │
│                 coq-unimath │ 4061.44  4037.57   0.59 │ 11300695399737  11241810024243   0.52 │ 21283011319787  21283930984620  -0.00 │ 1128324  1128328  -0.00 │   0    0    nan │
│              coq-coquelicot │   71.82    71.39   0.60 │   196589807391    195701140984   0.45 │   242292502579    241623988744   0.28 │  558688   558648   0.01 │   0    0    nan │
│                  coq-stdlib │  424.69   422.04   0.63 │  1187263930216   1181683894582   0.47 │  1493972336809   1493876786621   0.01 │  596024   596064  -0.01 │   0    0    nan │
│                coq-bedrock2 │  319.52   317.50   0.64 │   886894366021    882109664076   0.54 │  1520476386392   1519848258994   0.04 │  797744   770336   3.56 │   0    0    nan │
│                 coq-bignums │   57.92    57.52   0.70 │   160539787263    160105212664   0.27 │   210030559636    210073305920  -0.02 │  467560   467572  -0.00 │   0    0    nan │
│                coq-coqprime │ 1014.30  1006.58   0.77 │  2820980933748   2799448915955   0.77 │  4809441648778   4806234711082   0.07 │  854952   939028  -8.95 │   0    0    nan │
│                 coq-coqutil │   60.17    59.64   0.89 │   167279832459    166482851666   0.48 │   214866909673    214464424983   0.19 │  601948   601604   0.06 │   0    0    nan │
│               coq-fourcolor │ 2646.80  2623.29   0.90 │  7368993417830   7312043591678   0.78 │ 12248403068103  12248512672624  -0.00 │  730896   730976  -0.01 │   0    0    nan │
│               coq-fiat-core │  111.70   110.13   1.43 │   317148026481    315538270717   0.51 │   411629229236    410493982170   0.28 │  479400   479300   0.02 │   0    0    nan │
└─────────────────────────────┴─────────────────────────┴───────────────────────────────────────┴───────────────────────────────────────┴─────────────────────────┴─────────────────┘

Bench complete, failed to install packages:
coq-compcert
coq-flocq
coq-vst

view this post on Zulip Bench bot (Jun 04 2021 at 12:44):

Bench at https://gitlab.com/coq/coq/-/jobs/1318849165
For packages coq-bignums coq-hott coq-performance-tests-lite coq-engine-bench-lite coq-mathcomp-ssreflect coq-mathcomp-fingroup coq-mathcomp-algebra coq-mathcomp-solvable coq-mathcomp-field coq-mathcomp-character coq-mathcomp-odd-order coq-math-classes coq-corn coq-flocq coq-compcert coq-geocoq coq-color coq-coqprime coq-coqutil coq-bedrock2 coq-rewriter coq-fiat-core coq-fiat-parsers coq-fiat-crypto coq-unimath coq-coquelicot coq-lambda-rust coq-verdi coq-verdi-raft coq-fourcolor coq-rewriter-perf-SuperFast coq-perennial coq-vst
Testing Use the new refiner for Tactics.descend_in_conjunctions.

┌─────────────────────────────┬─────────────────────────┬───────────────────────────────────────┬───────────────────────────────────────┬─────────────────────────┬─────────────────┐
│                             │      user time [s]      │              CPU cycles               │           CPU instructions            │  max resident mem [KB]  │   mem faults    │
│                             │                         │                                       │                                       │                         │                 │
│                package_name │     NEW      OLD  PDIFF │            NEW             OLD  PDIFF │            NEW             OLD  PDIFF │     NEW      OLD  PDIFF │ NEW  OLD  PDIFF │
├─────────────────────────────┼─────────────────────────┼───────────────────────────────────────┼───────────────────────────────────────┼─────────────────────────┼─────────────────┤
│              coq-verdi-raft │ 1150.24  1209.18  -4.87 │  3202680467534   3366625655148  -4.87 │  4419623272465   4625467405834  -4.45 │  900492   900796  -0.03 │   0    0    nan │
│                  coq-geocoq │ 1382.98  1422.03  -2.75 │  3852273728619   3965073508169  -2.84 │  5493183656288   5641186564428  -2.62 │  987508   988824  -0.13 │   0    0    nan │
│                coq-rewriter │  705.07   718.72  -1.90 │  1962236272207   1999660747323  -1.87 │  2923613089375   2978994082316  -1.86 │ 1071760  1071172   0.05 │   0    0    nan │
│             coq-lambda-rust │ 1312.24  1330.04  -1.34 │  3656797264778   3700771540791  -1.19 │  5097498102277   5156868488715  -1.15 │ 1085252  1100344  -1.37 │   0    0    nan │
│                         coq │    4.46     4.52  -1.33 │    12081178813     12145498008  -0.53 │    23694198280     23696716414  -0.01 │  285728   285424   0.11 │   0    0    nan │
│ coq-rewriter-perf-SuperFast │  780.39   790.82  -1.32 │  2172693058323   2201454481744  -1.31 │  3290304307474   3346720718118  -1.69 │ 1071540  1071036   0.05 │   0    0    nan │
│              coq-coquelicot │   70.77    71.64  -1.21 │   194711045105    196638339403  -0.98 │   240108066268    241679463463  -0.65 │  555504   558828  -0.59 │   0    0    nan │
│                   coq-verdi │  101.81   102.94  -1.10 │   280269479793    284364391334  -1.44 │   383005562096    388064417851  -1.30 │  541664   544284  -0.48 │   0    0    nan │
│                coq-coqprime │  344.63   348.14  -1.01 │   957460884154    965928181297  -0.88 │  1597560956559   1596772936480   0.05 │  854652   854992  -0.04 │   0    0    nan │
│      coq-mathcomp-ssreflect │   55.72    56.05  -0.59 │   154347111453    154263973311   0.05 │   191328127317    191287731387   0.02 │  528828   528284   0.10 │   0    0    nan │
│                 coq-bignums │   57.24    57.49  -0.43 │   159421307604    160323723208  -0.56 │   208566615977    208554128814   0.01 │  465916   466024  -0.02 │   0    0    nan │
│                    coq-hott │  349.44   350.66  -0.35 │   969797122509    974153615871  -0.45 │  1410243781644   1410400318607  -0.01 │  568620   568772  -0.03 │   0    0    nan │
│  coq-performance-tests-lite │ 1647.50  1651.99  -0.27 │  4605290070072   4619384582281  -0.31 │  7471296946281   7470727176838   0.01 │ 2077432  2077348   0.00 │   0    0    nan │
│      coq-mathcomp-character │  157.81   158.24  -0.27 │   439298748475    440220494097  -0.21 │   598172076691    598241272893  -0.01 │  730920   717332   1.89 │   0    0    nan │
│       coq-mathcomp-solvable │  178.08   178.54  -0.26 │   496779533177    498063107960  -0.26 │   683167815474    683160301213   0.00 │  679492   693532  -2.02 │   0    0    nan │
│      coq-mathcomp-odd-order │ 1100.78  1103.46  -0.24 │  3067299077417   3075067789142  -0.25 │  4718975109822   4718704609828   0.01 │  904264   904208   0.01 │   0    0    nan │
│                    coq-core │  109.56   109.81  -0.23 │   304023803509    303849504912   0.06 │   457147035323    457119832994   0.01 │  277996   296724  -6.31 │   0    0    nan │
│        coq-mathcomp-algebra │  144.91   145.24  -0.23 │   403458912022    404988551379  -0.38 │   509219145778    509251629207  -0.01 │  553252   553088   0.03 │   0    0    nan │
│               coq-perennial │ 7081.75  7097.32  -0.22 │ 19714153810309  19755964359461  -0.21 │ 29161552320033  29197386658086  -0.12 │ 3116884  3101212   0.51 │   0    0    nan │
│            coq-fiat-parsers │  616.71   617.92  -0.20 │  1729226002992   1730961974451  -0.10 │  2557908812108   2559409821472  -0.06 │ 3073556  3073340   0.01 │   0    0    nan │
│                    coq-corn │ 1531.69  1534.52  -0.18 │  4274773692547   4284809425317  -0.23 │  6025097132220   6036676482263  -0.19 │  809992   810004  -0.00 │   0    0    nan │
│                 coq-coqutil │   60.42    60.52  -0.17 │   168575567001    168446074632   0.08 │   214673718926    214441805370   0.11 │  601068   600964   0.02 │   0    0    nan │
│               coq-fiat-core │  110.23   110.40  -0.15 │   316122416288    316323899516  -0.06 │   410664145916    410625297855   0.01 │  480144   479416   0.15 │   0    0    nan │
│                coq-bedrock2 │  318.78   319.08  -0.09 │   885173110239    886692350413  -0.17 │  1516179247981   1519904284852  -0.25 │  797628   757188   5.34 │   0    0    nan │
│            coq-math-classes │  180.59   180.72  -0.07 │   504276439141    506298233708  -0.40 │   651640212080    654350632988  -0.41 │  481736   481600   0.03 │   0    0    nan │
│             coq-fiat-crypto │ 5020.80  5021.44  -0.01 │ 13949757923537  13954426070213  -0.03 │ 24001406345262  24012506836454  -0.05 │ 2217516  2219680  -0.10 │   0    0    nan │
│               coq-fourcolor │ 2628.09  2628.19  -0.00 │  7314814076435   7325506031273  -0.15 │ 12249192151712  12249100765934   0.00 │  730852   730776   0.01 │   0    0    nan │
│       coq-mathcomp-fingroup │   50.28    50.26   0.04 │   139975001309    140044037763  -0.05 │   189789825532    189774198235   0.01 │  479596   479548   0.01 │   0    0    nan │
│       coq-engine-bench-lite │  326.60   326.46   0.04 │   920969446918    921127100297  -0.02 │  1659776398866   1655918053698   0.23 │ 3506196  3506420  -0.01 │   0    0    nan │
│          coq-mathcomp-field │  232.02   231.89   0.06 │   646176716674    646302307631  -0.02 │   955272713094    955207848908   0.01 │  661644   662972  -0.20 │   0    0    nan │
│                   coq-color │  504.44   504.05   0.08 │  1407907295458   1408225352691  -0.02 │  1712617292624   1712170791422   0.03 │ 1142348  1141532   0.07 │   0    0    nan │
│                  coq-stdlib │  424.41   423.01   0.33 │  1186520302308   1185390728672   0.10 │  1492532645969   1493497335502  -0.06 │  596028   595964   0.01 │   0    0    nan │
│                 coq-unimath │ 4089.16  4066.40   0.56 │ 11394052652951  11332399633219   0.54 │ 21285194779127  21283531365232   0.01 │ 1067552  1128420  -5.39 │   0    0    nan │
└─────────────────────────────┴─────────────────────────┴───────────────────────────────────────┴───────────────────────────────────────┴─────────────────────────┴─────────────────┘

Bench complete, failed to install packages:
coq-compcert
coq-flocq
coq-vst

view this post on Zulip Bench bot (Jun 06 2021 at 14:34):

Bench at https://gitlab.com/coq/coq/-/jobs/1322242837
For packages coq-bignums coq-hott coq-performance-tests-lite coq-engine-bench-lite coq-mathcomp-ssreflect coq-mathcomp-fingroup coq-mathcomp-algebra coq-mathcomp-solvable coq-mathcomp-field coq-mathcomp-character coq-mathcomp-odd-order coq-math-classes coq-corn coq-flocq coq-compcert coq-geocoq coq-color coq-coqprime coq-coqutil coq-bedrock2 coq-rewriter coq-fiat-core coq-fiat-parsers coq-fiat-crypto coq-unimath coq-coquelicot coq-lambda-rust coq-verdi coq-verdi-raft coq-fourcolor coq-rewriter-perf-SuperFast coq-perennial coq-vst
Testing Do not retype the argument of Equality.instantiate_lemma.

┌─────────────────────────────┬─────────────────────────┬───────────────────────────────────────┬───────────────────────────────────────┬─────────────────────────┬─────────────────┐
│                             │      user time [s]      │              CPU cycles               │           CPU instructions            │  max resident mem [KB]  │   mem faults    │
│                             │                         │                                       │                                       │                         │                 │
│                package_name │     NEW      OLD  PDIFF │            NEW             OLD  PDIFF │            NEW             OLD  PDIFF │     NEW      OLD  PDIFF │ NEW  OLD  PDIFF │
├─────────────────────────────┼─────────────────────────┼───────────────────────────────────────┼───────────────────────────────────────┼─────────────────────────┼─────────────────┤
│       coq-engine-bench-lite │  324.93   328.84  -1.19 │   916261806334    925812703106  -1.03 │  1658126782400   1661126610945  -0.18 │ 3506472  3506956  -0.01 │   0    0    nan │
│            coq-fiat-parsers │  613.92   617.05  -0.51 │  1720271771643   1729456795333  -0.53 │  2548684492500   2559945821152  -0.44 │ 3073520  3073180   0.01 │   0    0    nan │
│                coq-coqprime │  345.66   347.37  -0.49 │   960025037114    965650169668  -0.58 │  1597565165956   1597316835166   0.02 │  855124   854988   0.02 │   0    0    nan │
│                    coq-hott │  348.74   350.32  -0.45 │   968130083636    973293573261  -0.53 │  1408428637421   1409826589855  -0.10 │  568680   568636   0.01 │   0    0    nan │
│                  coq-geocoq │ 1419.26  1423.20  -0.28 │  3956943197896   3963586502111  -0.17 │  5642450309233   5641896427759   0.01 │  988936   988932   0.00 │   0    0    nan │
│                 coq-bignums │   57.55    57.69  -0.24 │   159076061977    160430478749  -0.84 │   208866215822    209129703697  -0.13 │  462152   466012  -0.83 │   0    0    nan │
│  coq-performance-tests-lite │ 1653.97  1657.24  -0.20 │  4612187684485   4619987522013  -0.17 │  7471263316259   7471315589167  -0.00 │ 2077380  2077260   0.01 │   0    0    nan │
│                  coq-stdlib │  423.03   423.82  -0.19 │  1184865118740   1184992124082  -0.01 │  1493811890962   1494043420647  -0.02 │  595972   596076  -0.02 │   0    0    nan │
│             coq-fiat-crypto │ 5013.85  5022.31  -0.17 │ 13932808648829  13956129726868  -0.17 │ 24001455446808  24015898608977  -0.06 │ 2223264  2222532   0.03 │   0    0    nan │
│      coq-mathcomp-odd-order │ 1103.92  1105.06  -0.10 │  3072703778854   3075138189827  -0.08 │  4719682120219   4719412968269   0.01 │  939392   939500  -0.01 │   0    0    nan │
│                   coq-verdi │  103.18   103.25  -0.07 │   285192178701    284960831924   0.08 │   389326780083    388735834108   0.15 │  543256   544320  -0.20 │   0    0    nan │
│            coq-math-classes │  181.70   181.82  -0.07 │   507219597784    506069430771   0.23 │   654988402023    654943803215   0.01 │  481656   481608   0.01 │   0    0    nan │
│               coq-perennial │ 7100.87  7105.20  -0.06 │ 19769313563362  19777056766267  -0.04 │ 29214916216188  29220593064687  -0.02 │ 3066948  3073036  -0.20 │   0    0    nan │
│                   coq-color │  504.65   504.89  -0.05 │  1408627840864   1408011296549   0.04 │  1713346769277   1712748490649   0.03 │ 1141496  1141476   0.00 │   0    0    nan │
│              coq-verdi-raft │ 1209.26  1209.80  -0.04 │  3368019538189   3368086304398  -0.00 │  4625774511381   4626196110334  -0.01 │  900528   900856  -0.04 │   0    0    nan │
│ coq-rewriter-perf-SuperFast │  791.68   791.64   0.01 │  2202868851128   2203970114500  -0.05 │  3345065485840   3347451204762  -0.07 │ 1071332  1070916   0.04 │   0    0    nan │
│       coq-mathcomp-solvable │  178.72   178.62   0.06 │   497786100465    497867679940  -0.02 │   683769848204    683737668270   0.00 │  692060   693204  -0.17 │   0    0    nan │
│               coq-fiat-core │  111.22   111.13   0.08 │   316961008813    316375237412   0.19 │   412268911638    411178210308   0.27 │  479536   479332   0.04 │   0    0    nan │
│                    coq-corn │ 1538.48  1536.99   0.10 │  4286283289572   4279555403603   0.16 │  6036689956043   6037321561076  -0.01 │  810000   810008  -0.00 │   0    0    nan │
│                 coq-coqutil │   60.68    60.62   0.10 │   168940113125    168213057446   0.43 │   215201779326    215041836207   0.07 │  598220   600964  -0.46 │   0    0    nan │
│      coq-mathcomp-character │  158.28   158.08   0.13 │   441043870187    440537827321   0.11 │   598760686421    598798828234  -0.01 │  730936   717576   1.86 │   0    0    nan │
│                    coq-core │  109.67   109.50   0.16 │   304348714281    304062903238   0.09 │   457724042611    457678702726   0.01 │  281936   281948  -0.00 │   0    0    nan │
│        coq-mathcomp-algebra │  145.06   144.82   0.17 │   404235511761    404442231965  -0.05 │   509849065828    509865786372  -0.00 │  553152   553316  -0.03 │   0    0    nan │
│              coq-coquelicot │   71.70    71.57   0.18 │   197076947680    196783047757   0.15 │   242898917645    242278213275   0.26 │  558848   558536   0.06 │   0    0    nan │
│                coq-rewriter │  719.86   718.43   0.20 │  2000337291651   1996780216745   0.18 │  2977809655351   2979474672948  -0.06 │ 1071460  1071120   0.03 │   0    0    nan │
│          coq-mathcomp-field │  232.24   231.70   0.23 │   647472714975    645822032916   0.26 │   955766191466    955743497893   0.00 │  661536   661604  -0.01 │   0    0    nan │
│             coq-lambda-rust │ 1329.80  1325.70   0.31 │  3699596881743   3695779104382   0.10 │  5157303414364   5157693461741  -0.01 │ 1075456  1100264  -2.25 │   0    0    nan │
│                coq-bedrock2 │  320.36   319.22   0.36 │   889851345716    887147143614   0.30 │  1520627591283   1520432479351   0.01 │  797884   797628   0.03 │   0    0    nan │
│               coq-fourcolor │ 2638.80  2628.92   0.38 │  7347431444141   7321789994828   0.35 │ 12249707436593  12249099125893   0.00 │  730772   730764   0.00 │   0    0    nan │
│       coq-mathcomp-fingroup │   50.49    50.29   0.40 │   140506487150    140299534595   0.15 │   190400812217    190369857996   0.02 │  479592   479720  -0.03 │   0    0    nan │
│                 coq-unimath │ 4086.28  4055.76   0.75 │ 11387840278329  11303092066485   0.75 │ 21250663943704  21282766996717  -0.15 │ 1124960  1128424  -0.31 │   0    0    nan │
│      coq-mathcomp-ssreflect │   56.50    55.95   0.98 │   154511787074    154448440633   0.04 │   191862969832    191877197572  -0.01 │  528512   528804  -0.06 │   0    0    nan │
└─────────────────────────────┴─────────────────────────┴───────────────────────────────────────┴───────────────────────────────────────┴─────────────────────────┴─────────────────┘

Bench complete, failed to install packages:
coq-compcert
coq-flocq
coq-vst

view this post on Zulip Bench bot (Jun 07 2021 at 12:23):

Bench at https://gitlab.com/coq/coq/-/jobs/1324044303
For packages coq-bignums coq-hott coq-performance-tests-lite coq-engine-bench-lite coq-mathcomp-ssreflect coq-mathcomp-fingroup coq-mathcomp-algebra coq-mathcomp-solvable coq-mathcomp-field coq-mathcomp-character coq-mathcomp-odd-order coq-math-classes coq-corn coq-flocq coq-compcert coq-geocoq coq-color coq-coqprime coq-coqutil coq-bedrock2 coq-rewriter coq-fiat-core coq-fiat-parsers coq-fiat-crypto coq-unimath coq-coquelicot coq-lambda-rust coq-verdi coq-verdi-raft coq-fourcolor coq-rewriter-perf-SuperFast coq-perennial coq-vst
Testing Clenv compact defs

┌─────────────────────────────┬─────────────────────────┬───────────────────────────────────────┬───────────────────────────────────────┬─────────────────────────┬─────────────────┐
│                             │      user time [s]      │              CPU cycles               │           CPU instructions            │  max resident mem [KB]  │   mem faults    │
│                             │                         │                                       │                                       │                         │                 │
│                package_name │     NEW      OLD  PDIFF │            NEW             OLD  PDIFF │            NEW             OLD  PDIFF │     NEW      OLD  PDIFF │ NEW  OLD  PDIFF │
├─────────────────────────────┼─────────────────────────┼───────────────────────────────────────┼───────────────────────────────────────┼─────────────────────────┼─────────────────┤
│                 coq-unimath │ 4051.04  4090.76  -0.97 │ 11270452861195  11383279875271  -0.99 │ 21231131472956  21240647640193  -0.04 │ 1109608  1125012  -1.37 │   0    0    nan │
│            coq-math-classes │  181.11   181.92  -0.45 │   504975565898    506172540889  -0.24 │   654057514274    655223608740  -0.18 │  482048   482012   0.01 │   0    0    nan │
│             coq-fiat-crypto │ 5018.51  5040.59  -0.44 │ 13928502980637  13988591086829  -0.43 │ 23987684264555  24000972690503  -0.06 │ 2223112  2228092  -0.22 │   0    0    nan │
│                  coq-geocoq │ 1414.18  1417.93  -0.26 │  3939478043059   3952414079444  -0.33 │  5611418007364   5641787184370  -0.54 │  979008  1043892  -6.22 │   0    0    nan │
│          coq-mathcomp-field │  231.80   232.24  -0.19 │   646001645604    645325302156   0.10 │   955900189682    955945068064  -0.00 │  663056   662836   0.03 │   0    0    nan │
│                    coq-core │  109.32   109.48  -0.15 │   304280951810    304097535018   0.06 │   457884127737    457909589269  -0.01 │  301164   301156   0.00 │   0    0    nan │
│      coq-mathcomp-ssreflect │   55.89    55.95  -0.11 │   154721928857    154347436511   0.24 │   191976126539    192016284118  -0.02 │  527816   528624  -0.15 │   0    0    nan │
│       coq-mathcomp-fingroup │   50.54    50.56  -0.04 │   140495887835    140226053480   0.19 │   190510123186    190510067023   0.00 │  479760   479424   0.07 │   0    0    nan │
│               coq-fiat-core │  111.19   111.19   0.00 │   317291193046    317046721527   0.08 │   412776451686    411839561746   0.23 │  481976   479936   0.43 │   0    0    nan │
│                coq-bedrock2 │  319.74   319.64   0.03 │   888145009828    887848110551   0.03 │  1519081156888   1520173158579  -0.07 │  797628   770396   3.53 │   0    0    nan │
│                 coq-coqutil │   60.23    60.20   0.05 │   168019569775    167810514650   0.12 │   215266103236    214987586017   0.13 │  598388   598296   0.02 │   0    0    nan │
│      coq-mathcomp-character │  158.02   157.93   0.06 │   439761402054    439715633788   0.01 │   598747998959    598820006547  -0.01 │  715848   731132  -2.09 │   0    0    nan │
│                    coq-corn │ 1536.51  1535.38   0.07 │  4278881578943   4276368216931   0.06 │  6026999203519   6037904084543  -0.18 │  797556   809780  -1.51 │   0    0    nan │
│              coq-verdi-raft │ 1206.20  1205.11   0.09 │  3356847794021   3356101664257   0.02 │  4607760915869   4623585087670  -0.34 │  905332   900772   0.51 │   0    0    nan │
│ coq-rewriter-perf-SuperFast │  790.54   789.81   0.09 │  2202420186775   2199879885792   0.12 │  3344668038392   3344811734632  -0.00 │ 1071320  1071228   0.01 │   0    0    nan │
│               coq-fourcolor │ 2630.54  2627.98   0.10 │  7321567108720   7314328376168   0.10 │ 12251785506091  12250233500249   0.01 │  795452   731064   8.81 │   0    0    nan │
│            coq-fiat-parsers │  614.87   614.07   0.13 │  1722845586588   1721739114216   0.06 │  2550488772484   2549587391935   0.04 │ 3073532  3073448   0.00 │   0    0    nan │
│      coq-mathcomp-odd-order │ 1104.13  1102.61   0.14 │  3073442873038   3067958854437   0.18 │  4719777405103   4719332434131   0.01 │  939512   904360   3.89 │   0    0    nan │
│        coq-mathcomp-algebra │  145.20   144.98   0.15 │   404168146767    403760226421   0.10 │   509930549824    509976529052  -0.01 │  553716   553104   0.11 │   0    0    nan │
│                   coq-verdi │  102.90   102.74   0.16 │   284524151821    284216405545   0.11 │   389241224069    388812032783   0.11 │  545728   543104   0.48 │   0    0    nan │
│             coq-lambda-rust │ 1326.94  1324.77   0.16 │  3692853004351   3683865539909   0.24 │  5158410971229   5158552729540  -0.00 │ 1096200  1093344   0.26 │   0    0    nan │
│               coq-perennial │ 7082.61  7066.61   0.23 │ 19715050047021  19671395865426   0.22 │ 29217627955003  29227081258301  -0.03 │ 3116392  3071336   1.47 │   0    0    nan │
│                   coq-color │  504.05   502.66   0.28 │  1406760053706   1403020207695   0.27 │  1711308590624   1712883692175  -0.09 │ 1154392  1142736   1.02 │   0    0    nan │
│              coq-coquelicot │   71.74    71.52   0.31 │   197081331114    196271900697   0.41 │   242980843531    242421777370   0.23 │  559448   558900   0.10 │   0    0    nan │
│                coq-rewriter │  720.12   717.82   0.32 │  2001597068627   1995594552512   0.30 │  2980514911788   2976850391193   0.12 │ 1191772  1071552  11.22 │   0    0    nan │
│                  coq-stdlib │  424.61   423.22   0.33 │  1188775462534   1183689248080   0.43 │  1495751836940   1497223425818  -0.10 │  596352   596060   0.05 │   0    0    nan │
│       coq-engine-bench-lite │  328.88   327.62   0.38 │   926600879401    923190233910   0.37 │  1672502913548   1664784790329   0.46 │ 3505968  3506596  -0.02 │   0    0    nan │
│                    coq-hott │  350.12   348.77   0.39 │   970806757319    968487696547   0.24 │  1408163009811   1408641005475  -0.03 │  568588   568648  -0.01 │   0    0    nan │
│  coq-performance-tests-lite │ 1656.56  1648.95   0.46 │  4616437848011   4598989171576   0.38 │  7467337416386   7470166506570  -0.04 │ 2077436  2077424   0.00 │   0    0    nan │
│                 coq-bignums │   57.43    57.12   0.54 │   159598172406    158896425025   0.44 │   208928897810    209053555365  -0.06 │  460876   464620  -0.81 │   0    0    nan │
│       coq-mathcomp-solvable │  179.06   178.06   0.56 │   497404937758    496816150091   0.12 │   683770916430    683799785786  -0.00 │  693956   693300   0.09 │   0    0    nan │
│                coq-coqprime │  357.26   345.47   3.41 │   992504651611    960189844408   3.37 │  1597880458896   1598908954663  -0.06 │  855816   855764   0.01 │   0    0    nan │
└─────────────────────────────┴─────────────────────────┴───────────────────────────────────────┴───────────────────────────────────────┴─────────────────────────┴─────────────────┘

Bench complete, failed to install packages:
coq-compcert
coq-flocq
coq-vst

view this post on Zulip Bench bot (Jun 10 2021 at 09:42):

Bench at https://gitlab.com/coq/coq/-/jobs/1334468045
For packages coq-bignums coq-hott coq-performance-tests-lite coq-engine-bench-lite coq-mathcomp-ssreflect coq-mathcomp-fingroup coq-mathcomp-algebra coq-mathcomp-solvable coq-mathcomp-field coq-mathcomp-character coq-mathcomp-odd-order coq-math-classes coq-corn coq-flocq coq-compcert coq-geocoq coq-color coq-coqprime coq-coqutil coq-bedrock2 coq-rewriter coq-fiat-core coq-fiat-parsers coq-fiat-crypto coq-unimath coq-coquelicot coq-lambda-rust coq-verdi coq-verdi-raft coq-fourcolor coq-rewriter-perf-SuperFast coq-perennial coq-vst
Testing [impargs] use clos_whd_all (by need, rather than by name)

┌─────────────────────────────┬─────────────────────────┬───────────────────────────────────────┬───────────────────────────────────────┬──────────────────────────┬─────────────────┐
│                             │      user time [s]      │              CPU cycles               │           CPU instructions            │  max resident mem [KB]   │   mem faults    │
│                             │                         │                                       │                                       │                          │                 │
│                package_name │     NEW      OLD  PDIFF │            NEW             OLD  PDIFF │            NEW             OLD  PDIFF │     NEW      OLD   PDIFF │ NEW  OLD  PDIFF │
├─────────────────────────────┼─────────────────────────┼───────────────────────────────────────┼───────────────────────────────────────┼──────────────────────────┼─────────────────┤
│                coq-coqprime │  342.02   349.73  -2.20 │   951475566299    972052723753  -2.12 │  1599428505579   1598953008209   0.03 │  855748   855796   -0.01 │   0    0    nan │
│                 coq-bignums │   57.12    57.69  -0.99 │   158980464490    159593189796  -0.38 │   208938350146    208883960541   0.03 │  464892   465008   -0.02 │   0    0    nan │
│                    coq-hott │  348.57   351.77  -0.91 │   967232770220    975949650083  -0.89 │  1410525832040   1410254318938   0.02 │  568488   568572   -0.01 │   0    0    nan │
│               coq-perennial │ 7040.67  7091.09  -0.71 │ 19596918928742  19734340152807  -0.70 │ 29189352722527  29183542228717   0.02 │ 3078668  3079324   -0.02 │   0    0    nan │
│            coq-math-classes │  180.44   181.62  -0.65 │   504233093406    507535092228  -0.65 │   653661020793    653659529113   0.00 │  482132   482056    0.02 │   0    0    nan │
│  coq-performance-tests-lite │ 1645.31  1655.88  -0.64 │  4592595897123   4619558983391  -0.58 │  7470019451030   7469851094132   0.00 │ 2079280  2079148    0.01 │   0    0    nan │
│      coq-mathcomp-ssreflect │   56.02    56.32  -0.53 │   154507808878    154575372364  -0.04 │   192054659021    191943187002   0.06 │  527340   528720   -0.26 │   0    0    nan │
│             coq-lambda-rust │ 1309.30  1315.48  -0.47 │  3641934839095   3658276114670  -0.45 │  5101917669831   5104879905828  -0.06 │ 1077396  1096240   -1.72 │   0    0    nan │
│      coq-mathcomp-odd-order │ 1098.07  1102.89  -0.44 │  3053993656444   3070178611369  -0.53 │  4719568931623   4720015325672  -0.01 │  939772   904344    3.92 │   0    0    nan │
│                    coq-corn │ 1533.31  1539.65  -0.41 │  4269310157620   4288315673871  -0.44 │  6027604303542   6028584084086  -0.02 │  809788   809924   -0.02 │   0    0    nan │
│                coq-bedrock2 │  316.96   317.98  -0.32 │   880280835718    883039026578  -0.31 │  1514733377886   1514063476321   0.04 │  798180   798244   -0.01 │   0    0    nan │
│                  coq-stdlib │  424.03   425.38  -0.32 │  1186160196933   1188684615340  -0.21 │  1495704083705   1495246860234   0.03 │  595964   596264   -0.05 │   0    0    nan │
│              coq-coquelicot │   70.93    71.14  -0.30 │   194980662891    195093265545  -0.06 │   240643204595    239995138562   0.27 │  555808   555840   -0.01 │   0    0    nan │
│                  coq-geocoq │ 1378.93  1382.95  -0.29 │  3839827971729   3856491900936  -0.43 │  5489676152216   5489174517974   0.01 │ 1003864   988200    1.59 │   0    0    nan │
│            coq-fiat-parsers │  613.20   614.90  -0.28 │  1713034368672   1719577506756  -0.38 │  2548502053473   2547732018399   0.03 │ 3076092  3076076    0.00 │   0    0    nan │
│                   coq-verdi │  101.16   101.38  -0.22 │   279899839613    280278891036  -0.14 │   383232711729    382493419042   0.19 │  541940   542224   -0.05 │   0    0    nan │
│              coq-verdi-raft │ 1143.72  1146.01  -0.20 │  3184454724106   3191916706963  -0.23 │  4407824088883   4407651240643   0.00 │  900600   900456    0.02 │   0    0    nan │
│       coq-engine-bench-lite │  325.50   326.09  -0.18 │   916582375783    917972143637  -0.15 │  1655670800842   1656106063201  -0.03 │ 3506104  3506452   -0.01 │   0    0    nan │
│                    coq-core │  109.77   109.91  -0.13 │   304247864530    304133473355   0.04 │   457704825560    457944183394  -0.05 │  282644   282616    0.01 │   0    0    nan │
│             coq-fiat-crypto │ 5002.19  5008.22  -0.12 │ 13903756318804  13907186655973  -0.02 │ 23988540512198  23983416224088   0.02 │ 2229036  2228040    0.04 │   0    0    nan │
│       coq-mathcomp-solvable │  178.61   178.78  -0.10 │   496930598702    496845809058   0.02 │   683804925445    683751356161   0.01 │  687720   672804    2.22 │   0    0    nan │
│        coq-mathcomp-algebra │  145.29   145.26   0.02 │   404029998602    404001196160   0.01 │   509974994828    509805234491   0.03 │  555748   553164    0.47 │   0    0    nan │
│ coq-rewriter-perf-SuperFast │  775.37   775.08   0.04 │  2158587056733   2159366500705  -0.04 │  3286677263791   3290168408010  -0.11 │ 1071484  1153884   -7.14 │   0    0    nan │
│                coq-rewriter │  703.21   702.91   0.04 │  1954413308080   1953566874134   0.04 │  2921251506321   2919205444314   0.07 │ 1071336  1071384   -0.00 │   0    0    nan │
│       coq-mathcomp-fingroup │   50.38    50.35   0.06 │   140223663891    140216572584   0.01 │   190369099990    190415371079  -0.02 │  479496   479576   -0.02 │   0    0    nan │
│                   coq-color │  503.44   503.09   0.07 │  1406086299248   1407587921567  -0.11 │  1714238950181   1712780400065   0.09 │ 1141964  1141456    0.04 │   0    0    nan │
│               coq-fourcolor │ 2637.78  2634.27   0.13 │  7344754379429   7340943655947   0.05 │ 12249250711874  12250178778179  -0.01 │  731072   731068    0.00 │   0    0    nan │
│          coq-mathcomp-field │  232.51   231.73   0.34 │   646587121843    644977422940   0.25 │   955624237626    955781052165  -0.02 │  663096   660768    0.35 │   0    0    nan │
│      coq-mathcomp-character │  158.28   157.74   0.34 │   439692676964    439549735453   0.03 │   598752948974    598729896154   0.00 │  731104   730892    0.03 │   0    0    nan │
│                 coq-coqutil │   60.54    60.27   0.45 │   167988338427    167680387922   0.18 │   215123150922    214740480089   0.18 │  598280   598056    0.04 │   0    0    nan │
│               coq-fiat-core │  111.96   111.23   0.66 │   317886770194    317587368118   0.09 │   414375011865    412813137212   0.38 │  480380   480300    0.02 │   0    0    nan │
│                 coq-unimath │ 4127.55  4049.71   1.92 │ 11485231788912  11268673587175   1.92 │ 21640869118814  21231767663563   1.93 │ 3040880  1123996  170.54 │   0    0    nan │
└─────────────────────────────┴─────────────────────────┴───────────────────────────────────────┴───────────────────────────────────────┴──────────────────────────┴─────────────────┘

Bench complete, failed to install packages:
coq-compcert
coq-flocq
coq-vst

view this post on Zulip Bench bot (Jun 11 2021 at 04:49):

Bench at https://gitlab.com/coq/coq/-/jobs/1335869478
For packages coq-bignums coq-hott coq-performance-tests-lite coq-engine-bench-lite coq-mathcomp-ssreflect coq-mathcomp-fingroup coq-mathcomp-algebra coq-mathcomp-solvable coq-mathcomp-field coq-mathcomp-character coq-mathcomp-odd-order coq-math-classes coq-corn coq-flocq coq-compcert coq-geocoq coq-color coq-coqprime coq-coqutil coq-bedrock2 coq-rewriter coq-fiat-core coq-fiat-parsers coq-fiat-crypto coq-unimath coq-coquelicot coq-lambda-rust coq-verdi coq-verdi-raft coq-fourcolor coq-rewriter-perf-SuperFast coq-perennial coq-vst
Testing Factorize the merge and cleaning of ltle nodes in get_new_edges.

┌─────────────────────────────┬─────────────────────────┬───────────────────────────────────────┬───────────────────────────────────────┬─────────────────────────┬─────────────────┐
                                   user time [s]                    CPU cycles                          CPU instructions              max resident mem [KB]     mem faults    
                                                                                                                                                                              
                package_name      NEW      OLD  PDIFF             NEW             OLD  PDIFF             NEW             OLD  PDIFF      NEW      OLD  PDIFF  NEW  OLD  PDIFF 
├─────────────────────────────┼─────────────────────────┼───────────────────────────────────────┼───────────────────────────────────────┼─────────────────────────┼─────────────────┤
                coq-coqprime   344.78   350.09  -1.52    958336867673    971831440455  -1.39   1599532027870   1598845074956   0.04   855652   855884  -0.03    0    0    nan 
       coq-engine-bench-lite   326.15   327.86  -0.52    918836647550    923211113333  -0.47   1658298345864   1660618575188  -0.14  3506424  3506292   0.00    0    0    nan 
                 coq-bignums    57.16    57.41  -0.44    159060934737    158991467493   0.04    208842329419    208837252199   0.00   465012   464824   0.04    0    0    nan 
                coq-bedrock2   318.16   318.66  -0.16    884721837221    884431873151   0.03   1515490644324   1514920788744   0.04   798244   798228   0.00    0    0    nan 
                  coq-geocoq  1375.78  1377.29  -0.11   3843346166295   3846070460742  -0.07   5489528063961   5489224533503   0.01  1003648  1003428   0.02    0    0    nan 
              coq-verdi-raft  1143.99  1144.27  -0.02   3191223854788   3185826024054   0.17   4408439385380   4407584735511   0.02   900380   900628  -0.03    0    0    nan 
      coq-mathcomp-ssreflect    56.05    56.04   0.02    154561117361    154074051881   0.32    191905793866    191923353218  -0.01   528432   528472  -0.01    0    0    nan 
            coq-fiat-parsers   614.11   613.64   0.08   1718786178091   1715969372402   0.16   2548681541393   2547865985673   0.03  3076112  3076084   0.00    0    0    nan 
 coq-rewriter-perf-SuperFast   776.83   776.11   0.09   2161418063499   2162398961056  -0.05   3286967660866   3287600071060  -0.02  1071484  1071564  -0.01    0    0    nan 
               coq-fourcolor  2633.96  2631.46   0.10   7334735338250   7327810743777   0.09  12251660440390  12250731015714   0.01   795484   795412   0.01    0    0    nan 
       coq-mathcomp-fingroup    50.59    50.54   0.10    140434440184    140207786095   0.16    190382981587    190382957026   0.00   479428   479440  -0.00    0    0    nan 
               coq-fiat-core   111.68   111.56   0.11    318229692264    317364076563   0.27    413913686703    412844968294   0.26   480412   480296   0.02    0    0    nan 
             coq-lambda-rust  1310.79  1309.26   0.12   3652216552863   3642466347459   0.27   5100201646295   5101053874074  -0.02  1089332  1077308   1.12    0    0    nan 
                    coq-hott   349.46   349.01   0.13    968933550062    968894390418   0.00   1410441019555   1410249132520   0.01   568460   568656  -0.03    0    0    nan 
  coq-performance-tests-lite  1652.63  1650.32   0.14   4607380551437   4603441103736   0.09   7469516921410   7469636096566  -0.00  2079152  2079180  -0.00    0    0    nan 
               coq-perennial  7065.16  7054.92   0.15  19668714639088  19645537902284   0.12  29188569206077  29184022375984   0.02  3096536  3078948   0.57    0    0    nan 
                 coq-unimath  4076.95  4070.60   0.16  11347825582576  11330038796084   0.16  21233564883487  21231595854233   0.01  1128244  1123956   0.38    0    0    nan 
                    coq-corn  1534.38  1531.71   0.17   4284601463579   4278034086934   0.15   6027018278229   6028406241707  -0.02   809800   809716   0.01    0    0    nan 
                   coq-color   504.34   503.17   0.23   1409205389825   1405167904687   0.29   1714306352053   1712824976962   0.09  1142200  1142472  -0.02    0    0    nan 
             coq-fiat-crypto  5023.87  5012.08   0.24  13950552018766  13917723086977   0.24  23996429365042  23989272561414   0.03  2223340  2215876   0.34    0    0    nan 
        coq-mathcomp-algebra   145.50   145.08   0.29    404441222671    403750078546   0.17    509818870376    509790687401   0.01   552956   553024  -0.01    0    0    nan 
                    coq-core   110.16   109.84   0.29    304311440268    304332535362  -0.01    457819465822    457697595763   0.03   282908   282840   0.02    0    0    nan 
      coq-mathcomp-character   158.10   157.64   0.29    440212255790    438710802687   0.34    598755581747    598818070987  -0.01   731084   731312  -0.03    0    0    nan 
                coq-rewriter   707.05   704.75   0.33   1964034093880   1958494866461   0.28   2922030318039   2919503915966   0.09  1071416  1071492  -0.01    0    0    nan 
       coq-mathcomp-solvable   178.72   178.09   0.35    497655636853    495939635309   0.35    683782833568    683869167826  -0.01   684148   672684   1.70    0    0    nan 
                   coq-verdi   101.34   100.97   0.37    280150748899    279278655702   0.31    383137256793    382572394349   0.15   542044   542324  -0.05    0    0    nan 
          coq-mathcomp-field   232.31   231.46   0.37    646211019338    644328129254   0.29    955752299560    955686979318   0.01   663080   662812   0.04    0    0    nan 
      coq-mathcomp-odd-order  1105.21  1101.09   0.37   3075250619818   3065111348689   0.33   4719793966394   4719748638007   0.00   939748   939896  -0.02    0    0    nan 
                 coq-coqutil    60.26    60.03   0.38    167853494052    167182354017   0.40    215107037126    214787654313   0.15   598088   598100  -0.00    0    0    nan 
                  coq-stdlib   424.63   422.32   0.55   1187053854721   1183062058100   0.34   1493879946217   1495121219673  -0.08   596220   596332  -0.02    0    0    nan 
              coq-coquelicot    71.39    70.94   0.63    195417914725    194181296783   0.64    240610021702    239973101191   0.27   555704   555744  -0.01    0    0    nan 
            coq-math-classes   181.95   180.32   0.90    506207243528    505570202628   0.13    653642171176    653644212228  -0.00   481928   481952  -0.00    0    0    nan 
└─────────────────────────────┴─────────────────────────┴───────────────────────────────────────┴───────────────────────────────────────┴─────────────────────────┴─────────────────┘

Bench complete, failed to install packages:
coq-compcert
coq-flocq
coq-vst

view this post on Zulip Bench bot (Jun 11 2021 at 23:54):

Bench at https://gitlab.com/coq/coq/-/jobs/1339135031
For packages coq-bignums coq-hott coq-performance-tests-lite coq-engine-bench-lite coq-mathcomp-ssreflect coq-mathcomp-fingroup coq-mathcomp-algebra coq-mathcomp-solvable coq-mathcomp-field coq-mathcomp-character coq-mathcomp-odd-order coq-math-classes coq-corn coq-flocq coq-compcert coq-geocoq coq-color coq-coqprime coq-coqutil coq-bedrock2 coq-rewriter coq-fiat-core coq-fiat-parsers coq-fiat-crypto coq-unimath coq-coquelicot coq-lambda-rust coq-verdi coq-verdi-raft coq-fourcolor coq-rewriter-perf-SuperFast coq-perennial coq-vst
Testing [impargs] use clos_whd_all (by need, rather than by name)

┌─────────────────────────────┬─────────────────────────┬───────────────────────────────────────┬───────────────────────────────────────┬─────────────────────────┬─────────────────┐
                                   user time [s]                    CPU cycles                          CPU instructions              max resident mem [KB]     mem faults    
                                                                                                                                                                              
                package_name      NEW      OLD  PDIFF             NEW             OLD  PDIFF             NEW             OLD  PDIFF      NEW      OLD  PDIFF  NEW  OLD  PDIFF 
├─────────────────────────────┼─────────────────────────┼───────────────────────────────────────┼───────────────────────────────────────┼─────────────────────────┼─────────────────┤
                 coq-unimath  4430.39  4483.89  -1.19  12347214446052  12495833145183  -1.19  23402023711073  23436273664990  -0.15  3265388  3285868  -0.62    0    0    nan 
              coq-verdi-raft  1141.44  1147.49  -0.53   3177273524960   3191450759595  -0.44   4407975279728   4407452086813   0.01   900256   900480  -0.02    0    0    nan 
                coq-coqprime   343.85   345.61  -0.51    956263589712    959371807883  -0.32   1599524995261   1598928747566   0.04   855712   855636   0.01    0    0    nan 
      coq-mathcomp-odd-order  1096.97  1101.75  -0.43   3052369399073   3066651106627  -0.47   4720270255765   4720270596151  -0.00   939740   939872  -0.01    0    0    nan 
       coq-mathcomp-fingroup    50.23    50.44  -0.42    139785867398    140005270723  -0.16    190476294650    190467397254   0.00   479324   479532  -0.04    0    0    nan 
 coq-rewriter-perf-SuperFast   773.97   776.97  -0.39   2153627839407   2164363683009  -0.50   3286371265132   3288094127911  -0.05  1071488  1071656  -0.02    0    0    nan 
                 coq-bignums    57.00    57.22  -0.38    159085088922    158851731936   0.15    209050840022    208983440824   0.03   464764   464868  -0.02    0    0    nan 
                coq-rewriter   701.89   704.08  -0.31   1950221002496   1959117982834  -0.45   2923379699551   2919949823615   0.12  1108984  1071456   3.50    0    0    nan 
                    coq-corn  1531.60  1535.93  -0.28   4267849223468   4279278386070  -0.27   6027908812385   6028691668689  -0.01   809796   810012  -0.03    0    0    nan 
               coq-fourcolor  2623.92  2630.97  -0.27   7308406533256   7322802840264  -0.20  12250582485188  12249574795326   0.01   730920   730920   0.00    0    0    nan 
               coq-fiat-core   111.16   111.40  -0.22    317912804318    317514495930   0.13    414409418212    412955952492   0.35   480424   480264   0.03    0    0    nan 
       coq-mathcomp-solvable   178.00   178.36  -0.20    495191870014    496050045654  -0.17    683853652711    683890119056  -0.01   693028   672788   3.01    0    0    nan 
          coq-mathcomp-field   231.30   231.74  -0.19    643927509777    644943107799  -0.16    955935338804    955908411437   0.00   662684   662416   0.04    0    0    nan 
        coq-mathcomp-algebra   147.34   147.57  -0.16    410843606578    411038680389  -0.05    519711452772    519590112373   0.02   554844   553392   0.26    0    0    nan 
            coq-math-classes   181.09   181.31  -0.12    505097657251    506282532259  -0.23    653793821288    653784702466   0.00   482048   482224  -0.04    0    0    nan 
                   coq-color   503.24   503.70  -0.09   1406378126002   1405096829915   0.09   1714362019180   1712667853633   0.10  1142676  1142468   0.02    0    0    nan 
                    coq-core   109.77   109.87  -0.09    304368390497    304399760033  -0.01    457867667874    457890373048  -0.00   317608   317676  -0.02    0    0    nan 
                   coq-verdi   101.22   101.25  -0.03    280013747715    279622726927   0.14    383269159586    382654340392   0.16   541884   542052  -0.03    0    0    nan 
      coq-mathcomp-character   157.60   157.63  -0.02    438214671534    438807952128  -0.14    599015917939    598816923183   0.03   718032   731168  -1.80    0    0    nan 
            coq-fiat-parsers   614.10   614.13  -0.00   1718194904756   1716297476526   0.11   2548786542431   2547929373912   0.03  3076188  3076128   0.00    0    0    nan 
             coq-fiat-crypto  5016.65  5015.13   0.03  13927883574623  13923756705041   0.03  23991219890081  23994956287139  -0.02  2219984  2218728   0.06    0    0    nan 
             coq-lambda-rust  1312.47  1311.54   0.07   3650146747900   3648198128566   0.05   5101724271068   5101726836800  -0.00  1077296  1077368  -0.01    0    0    nan 
       coq-engine-bench-lite   326.23   325.90   0.10    919422128837    917772538150   0.18   1659780106791   1657290786211   0.15  3506240  3506320  -0.00    0    0    nan 
  coq-performance-tests-lite  1649.76  1647.62   0.13   4602051835857   4594975696378   0.15   7470977176329   7471042671722  -0.00  2079180  2079104   0.00    0    0    nan 
               coq-perennial  7059.83  7048.98   0.15  19654660219275  19647808908485   0.03  29195637722870  29188593263132   0.02  3061328  3078788  -0.57    0    0    nan 
                  coq-geocoq  1383.58  1381.37   0.16   3856282021568   3849408294036   0.18   5489884000024   5489242048551   0.01   988372  1003832  -1.54    0    0    nan 
                coq-bedrock2   318.83   318.16   0.21    885559649948    884705029114   0.10   1515639794272   1515008258073   0.04   798332   770504   3.61    0    0    nan 
                    coq-hott   350.30   349.15   0.33    969396153035    969035385295   0.04   1410693565413   1410443985233   0.02   568692   568512   0.03    0    0    nan 
                 coq-coqutil    60.38    60.14   0.40    167346867467    167459388738  -0.07    215249177699    214893566907   0.17   598180   598152   0.00    0    0    nan 
      coq-mathcomp-ssreflect    56.12    55.87   0.45    154324539690    154118102942   0.13    192201644235    192044850173   0.08   527408   528688  -0.24    0    0    nan 
              coq-coquelicot    71.29    70.92   0.52    194952135471    194794719855   0.08    240729699066    240094414947   0.26   555860   555776   0.02    0    0    nan 
                  coq-stdlib   425.25   422.78   0.58   1187092799409   1183917254531   0.27   1495657651074   1495290395703   0.02   596024   596220  -0.03    0    0    nan 
└─────────────────────────────┴─────────────────────────┴───────────────────────────────────────┴───────────────────────────────────────┴─────────────────────────┴─────────────────┘

Bench complete, failed to install packages:
coq-compcert
coq-flocq
coq-vst

view this post on Zulip Bench bot (Jun 12 2021 at 19:13):

Bench at https://gitlab.com/coq/coq/-/jobs/1341570424
For packages coq-bignums coq-hott coq-performance-tests-lite coq-engine-bench-lite coq-mathcomp-ssreflect coq-mathcomp-fingroup coq-mathcomp-algebra coq-mathcomp-solvable coq-mathcomp-field coq-mathcomp-character coq-mathcomp-odd-order coq-math-classes coq-corn coq-flocq coq-compcert coq-geocoq coq-color coq-coqprime coq-coqutil coq-bedrock2 coq-rewriter coq-fiat-core coq-fiat-parsers coq-fiat-crypto coq-unimath coq-coquelicot coq-lambda-rust coq-verdi coq-verdi-raft coq-fourcolor coq-rewriter-perf-SuperFast coq-perennial coq-vst
Testing Algorithmically more efficient substitution in application retyping.

┌─────────────────────────────┬─────────────────────────┬───────────────────────────────────────┬───────────────────────────────────────┬──────────────────────────┬─────────────────┐
                                   user time [s]                    CPU cycles                          CPU instructions              max resident mem [KB]      mem faults    
                                                                                                                                                                               
                package_name      NEW      OLD  PDIFF             NEW             OLD  PDIFF             NEW             OLD  PDIFF      NEW      OLD   PDIFF  NEW  OLD  PDIFF 
├─────────────────────────────┼─────────────────────────┼───────────────────────────────────────┼───────────────────────────────────────┼──────────────────────────┼─────────────────┤
                 coq-unimath  4375.86  4484.49  -2.42  12179328765941  12485396734770  -2.45  22761790844198  23433823428994  -2.87  2877844  3265388  -11.87    0    0    nan 
  coq-performance-tests-lite  1625.04  1646.94  -1.33   4545409768955   4605807678140  -1.31   7392858118640   7469547781423  -1.03  2079104  2079188   -0.00    0    0    nan 
                coq-rewriter   694.93   703.60  -1.23   1931572609259   1956006070035  -1.25   2871059113314   2919834762030  -1.67  1071748  1071292    0.04    0    0    nan 
                    coq-corn  1513.98  1532.74  -1.22   4227232005667   4280982690379  -1.26   5919742063879   6028501858024  -1.80   813236   809816    0.42    0    0    nan 
 coq-rewriter-perf-SuperFast   766.71   775.01  -1.07   2137368234773   2160792038412  -1.08   3241398321890   3288156495953  -1.42  1071748  1071512    0.02    0    0    nan 
            coq-math-classes   178.87   180.76  -1.05    500847181988    506284791038  -1.07    645576976734    653805836248  -1.26   481276   482128   -0.18    0    0    nan 
                coq-coqprime   342.42   345.79  -0.97    950419088826    960452948696  -1.04   1596260896799   1598968097353  -0.17   914404   855592    6.87    0    0    nan 
             coq-fiat-crypto  4967.69  5016.09  -0.96  13790172440032  13923852007000  -0.96  23786633570817  23991452807901  -0.85  2233460  2223740    0.44    0    0    nan 
             coq-lambda-rust  1302.01  1311.50  -0.72   3628354242808   3646640010828  -0.50   5078262785020   5101825273552  -0.46  1097616  1077308    1.89    0    0    nan 
                 coq-coqutil    59.62    60.02  -0.67    166971593359    167380465409  -0.24    214623119491    214872015447  -0.12   598656   598208    0.07    0    0    nan 
      coq-mathcomp-ssreflect    55.58    55.95  -0.66    153925234890    154291476072  -0.24    191112035067    192045430232  -0.49   528060   528384   -0.06    0    0    nan 
               coq-perennial  7004.46  7050.03  -0.65  19532572686289  19660687077487  -0.65  28964291013461  29180914841669  -0.74  3116824  3089600    0.88    0    0    nan 
      coq-mathcomp-character   157.00   157.97  -0.61    437813885421    440041051487  -0.51    595704005797    598810368189  -0.52   731752   731200    0.08    0    0    nan 
              coq-verdi-raft  1137.37  1144.35  -0.61   3172855418701   3192166260914  -0.60   4372363305593   4407555134834  -0.80   904628   900568    0.45    0    0    nan 
        coq-mathcomp-algebra   146.78   147.66  -0.60    409666476422    411301376829  -0.40    516542811007    519182501735  -0.51   553796   553396    0.07    0    0    nan 
                    coq-hott   345.87   347.84  -0.57    960813105313    968504635340  -0.79   1399818042519   1410423857418  -0.75   569704   568512    0.21    0    0    nan 
                coq-bedrock2   316.25   317.93  -0.53    878322100708    884781597108  -0.73   1510451964840   1515054019900  -0.30   770756   798188   -3.44    0    0    nan 
            coq-fiat-parsers   610.26   613.50  -0.53   1706189516601   1715550315682  -0.55   2532121073048   2548343966928  -0.64  3076108  3076144   -0.00    0    0    nan 
                  coq-geocoq  1374.38  1381.60  -0.52   3826436078252   3849072885821  -0.59   5472133247052   5489337148308  -0.31   992548  1003792   -1.12    0    0    nan 
      coq-mathcomp-odd-order  1094.65  1099.82  -0.47   3050226131662   3064833841914  -0.48   4705504616048   4720235137347  -0.31   939724   939748   -0.00    0    0    nan 
                   coq-verdi   100.69   101.10  -0.41    278788889571    279484970600  -0.25    382028169490    382658616586  -0.16   542652   542108    0.10    0    0    nan 
       coq-mathcomp-fingroup    50.17    50.36  -0.38    139473283039    140011911114  -0.38    189271091498    190460790791  -0.62   480040   479484    0.12    0    0    nan 
       coq-mathcomp-solvable   177.45   177.80  -0.20    494158435581    495833484557  -0.34    679982138468    683934447469  -0.58   672756   694300   -3.10    0    0    nan 
                   coq-color   501.58   502.33  -0.15   1399832962455   1404895656249  -0.36   1705719492748   1712736071603  -0.41  1162716  1142632    1.76    0    0    nan 
                    coq-core   109.70   109.83  -0.12    304112514873    304673449872  -0.18    457861881854    457880277650  -0.00   300176   300184   -0.00    0    0    nan 
                  coq-stdlib   422.88   423.36  -0.11   1182193592953   1184380568346  -0.18   1483279843556   1495524042266  -0.82   596776   596272    0.08    0    0    nan 
          coq-mathcomp-field   230.80   230.95  -0.06    643299511004    643841677570  -0.08    952994701525    956003609504  -0.31   669076   662392    1.01    0    0    nan 
                 coq-bignums    57.27    57.30  -0.05    158472989044    159106298325  -0.40    208524606326    208995092054  -0.23   465148   464828    0.07    0    0    nan 
               coq-fourcolor  2634.78  2634.18   0.02   7343493914245   7342509752370   0.01  12247933539964  12249439690281  -0.01   730972   730904    0.01    0    0    nan 
               coq-fiat-core   111.72   111.55   0.15    317070046443    317579689749  -0.16    412666049626    412940138307  -0.07   479836   480176   -0.07    0    0    nan 
              coq-coquelicot    71.17    70.98   0.27    194756072572    194597243683   0.08    239967798759    240133838906  -0.07   555764   555748    0.00    0    0    nan 
       coq-engine-bench-lite   325.57   322.67   0.90    918255669583    911291317399   0.76   1659847738716   1652287032813   0.46  3506472  3506380    0.00    0    0    nan 
└─────────────────────────────┴─────────────────────────┴───────────────────────────────────────┴───────────────────────────────────────┴──────────────────────────┴─────────────────┘

Bench complete, failed to install packages:
coq-compcert
coq-flocq
coq-vst

view this post on Zulip Bench bot (Jun 13 2021 at 14:26):

Bench at https://gitlab.com/coq/coq/-/jobs/1342472948
Testing Fast Typing for application rule
On packages coq-bignums coq-hott coq-performance-tests-lite coq-engine-bench-lite coq-mathcomp-ssreflect coq-mathcomp-fingroup coq-mathcomp-algebra coq-mathcomp-solvable coq-mathcomp-field coq-mathcomp-character coq-mathcomp-odd-order coq-math-classes coq-corn coq-flocq coq-compcert coq-geocoq coq-color coq-coqprime coq-coqutil coq-bedrock2 coq-rewriter coq-fiat-core coq-fiat-parsers coq-fiat-crypto coq-unimath coq-coquelicot coq-lambda-rust coq-verdi coq-verdi-raft coq-fourcolor coq-rewriter-perf-SuperFast coq-perennial coq-vst

┌─────────────────────────────┬─────────────────────────┬───────────────────────────────────────┬───────────────────────────────────────┬─────────────────────────┬─────────────────┐
                                   user time [s]                    CPU cycles                          CPU instructions              max resident mem [KB]     mem faults    
                                                                                                                                                                              
                package_name      NEW      OLD  PDIFF             NEW             OLD  PDIFF             NEW             OLD  PDIFF      NEW      OLD  PDIFF  NEW  OLD  PDIFF 
├─────────────────────────────┼─────────────────────────┼───────────────────────────────────────┼───────────────────────────────────────┼─────────────────────────┼─────────────────┤
       coq-mathcomp-solvable   169.92   172.37  -1.42    473662805335    479745748019  -1.27    673018313699    683931003589  -1.60   672876   672776   0.01    0    0    nan 
          coq-mathcomp-field   222.23   224.98  -1.22    618903313406    626052569469  -1.14    943898790300    955917116663  -1.26   670072   662752   1.10    0    0    nan 
      coq-mathcomp-character   150.66   152.50  -1.21    418813808684    423980132991  -1.22    588885577192    598900824248  -1.67   718636   731128  -1.71    0    0    nan 
      coq-mathcomp-odd-order  1054.98  1065.92  -1.03   2937842975305   2968090251064  -1.02   4684912572790   4720451951326  -0.75   939900   904152   3.95    0    0    nan 
                 coq-unimath  4357.42  4395.65  -0.87  12126569574531  12231335511426  -0.86  23347532694409  23435595648062  -0.38  3262988  3265472  -0.08    0    0    nan 
  coq-performance-tests-lite  1639.60  1650.28  -0.65   4574390699049   4603423153189  -0.63   7425226914971   7469764487554  -0.60  2079088  2079148  -0.00    0    0    nan 
 coq-rewriter-perf-SuperFast   746.02   750.68  -0.62   2077592013939   2090077835614  -0.60   3267409796374   3288219579697  -0.63  1071208  1071456  -0.02    0    0    nan 
        coq-mathcomp-algebra   141.50   142.36  -0.60    392982592099    396291435378  -0.83    513715367603    519239393704  -1.06   553460   553132   0.06    0    0    nan 
                coq-bedrock2   309.98   311.78  -0.58    859250483666    864300257480  -0.58   1513740783805   1515087707940  -0.09   798328   798244   0.01    0    0    nan 
                 coq-coqutil    58.37    58.64  -0.46    162841128137    162630019750   0.13    214919456056    214958603469  -0.02   599344   598048   0.22    0    0    nan 
                    coq-core   109.67   110.05  -0.35    304383549911    304189557445   0.06    457928961225    457765751668   0.04   301960   301960   0.00    0    0    nan 
                    coq-hott   348.37   349.56  -0.34    966058806984    969008579386  -0.30   1406804611698   1410469710109  -0.26   568696   568556   0.02    0    0    nan 
       coq-mathcomp-fingroup    48.60    48.74  -0.29    134074894469    135266617296  -0.88    187373193566    190549543765  -1.67   480356   479600   0.16    0    0    nan 
                coq-rewriter   676.39   678.17  -0.26   1877198020630   1884889154792  -0.41   2902670897188   2919620772243  -0.58  1071396  1071336   0.01    0    0    nan 
                coq-coqprime   328.34   329.15  -0.25    913013827748    915589456574  -0.28   1597363574133   1599131425732  -0.11   855752   855564   0.02    0    0    nan 
                   coq-verdi    98.12    98.36  -0.24    270527793385    270962695873  -0.16    381315393687    382755746568  -0.38   543172   542172   0.18    0    0    nan 
                  coq-stdlib   422.87   423.76  -0.21   1184675233032   1185624597114  -0.08   1492614242424   1495431279531  -0.19   596700   596316   0.06    0    0    nan 
       coq-engine-bench-lite   315.09   315.74  -0.21    889127907347    888664438166   0.05   1654448696578   1661432376418  -0.42  3506380  3506320   0.00    0    0    nan 
             coq-fiat-crypto  4876.52  4886.12  -0.20  13544947667819  13573493513143  -0.21  23943025702233  23983702924048  -0.17  2217612  2234540  -0.76    0    0    nan 
              coq-verdi-raft  1114.12  1116.23  -0.19   3101952707630   3108773657206  -0.22   4390383957504   4407555238444  -0.39   900560   900432   0.01    0    0    nan 
                   coq-color   486.52   487.11  -0.12   1359450731517   1358629472141   0.06   1710766880659   1712863955804  -0.12  1142452  1142432   0.00    0    0    nan 
                  coq-geocoq  1342.87  1344.23  -0.10   3740471250630   3744964909648  -0.12   5487858385985   5489348829675  -0.03   982348  1003604  -2.12    0    0    nan 
                    coq-corn  1496.16  1497.48  -0.09   4166327070603   4170232756381  -0.09   6015378876911   6028540923750  -0.22   810000   809804   0.02    0    0    nan 
             coq-lambda-rust  1267.83  1268.69  -0.07   3527336925990   3530189551964  -0.08   5094386382184   5101417389901  -0.14  1097036  1077248   1.84    0    0    nan 
               coq-perennial  6827.56  6824.09   0.05  19022380613509  19007766134222   0.08  29159988090506  29189599583153  -0.10  3086704  3089744  -0.10    0    0    nan 
      coq-mathcomp-ssreflect    54.25    54.21   0.07    147539379891    148335321153  -0.54    190969542070    192109864624  -0.59   528744   528608   0.03    0    0    nan 
            coq-fiat-parsers   591.41   590.95   0.08   1654735441262   1653816301001   0.06   2546083636816   2548285607781  -0.09  3076096  3076132  -0.00    0    0    nan 
               coq-fourcolor  2551.38  2549.26   0.08   7102059165416   7105976221678  -0.06  12245665400810  12249634584963  -0.03   731072   731048   0.00    0    0    nan 
               coq-fiat-core   108.76   108.65   0.10    306594867139    306846103348  -0.08    413787242472    413036471572   0.18   480372   480292   0.02    0    0    nan 
            coq-math-classes   176.54   176.36   0.10    492208007327    492042272589   0.03    652332822037    653864662370  -0.23   481712   481972  -0.05    0    0    nan 
              coq-coquelicot    68.60    68.44   0.23    186991617382    187364594909  -0.20    240118533835    240172711267  -0.02   556764   555844   0.17    0    0    nan 
                 coq-bignums    57.60    57.28   0.56    159560679582    159040457417   0.33    209059408272    209082624985  -0.01   465340   464896   0.10    0    0    nan 
└─────────────────────────────┴─────────────────────────┴───────────────────────────────────────┴───────────────────────────────────────┴─────────────────────────┴─────────────────┘

Bench complete, failed to install packages:
coq-compcert
coq-flocq
coq-vst

view this post on Zulip Bench bot (Jun 14 2021 at 09:56):

Bench at https://gitlab.com/coq/coq/-/jobs/1344164561
Testing Try to be cleverer in the fconstr to constr computation in CClosure.
On packages coq-bignums coq-hott coq-performance-tests-lite coq-engine-bench-lite coq-mathcomp-ssreflect coq-mathcomp-fingroup coq-mathcomp-algebra coq-mathcomp-solvable coq-mathcomp-field coq-mathcomp-character coq-mathcomp-odd-order coq-math-classes coq-corn coq-flocq coq-compcert coq-geocoq coq-color coq-coqprime coq-coqutil coq-bedrock2 coq-rewriter coq-fiat-core coq-fiat-parsers coq-fiat-crypto coq-unimath coq-coquelicot coq-lambda-rust coq-verdi coq-verdi-raft coq-fourcolor coq-rewriter-perf-SuperFast coq-perennial coq-vst

┌─────────────────────────────┬─────────────────────────┬───────────────────────────────────────┬───────────────────────────────────────┬─────────────────────────┬─────────────────┐
                                   user time [s]                    CPU cycles                          CPU instructions              max resident mem [KB]     mem faults    
                                                                                                                                                                              
                package_name      NEW      OLD  PDIFF             NEW             OLD  PDIFF             NEW             OLD  PDIFF      NEW      OLD  PDIFF  NEW  OLD  PDIFF 
├─────────────────────────────┼─────────────────────────┼───────────────────────────────────────┼───────────────────────────────────────┼─────────────────────────┼─────────────────┤
                 coq-coqutil    58.54    59.08  -0.91    162208319300    163599515452  -0.85    215335459457    214963914456   0.17   598536   598096   0.07    0    0    nan 
            coq-math-classes   175.36   176.84  -0.84    489718178873    490820662574  -0.22    653738585352    653911632511  -0.03   482132   481968   0.03    0    0    nan 
        coq-mathcomp-algebra   142.12   142.79  -0.47    395340989809    396662946943  -0.33    519688651053    519230415986   0.09   554452   553384   0.19    0    0    nan 
      coq-mathcomp-character   152.88   153.50  -0.40    424758673000    425785153823  -0.24    600149290128    598882844431   0.21   731080   731072   0.00    0    0    nan 
                 coq-bignums    56.08    56.30  -0.39    154745136248    154763958643  -0.01    209127875967    209087042142   0.02   465368   465044   0.07    0    0    nan 
  coq-performance-tests-lite  1600.89  1606.11  -0.33   4471412273955   4484237792948  -0.29   7472100955022   7470386357231   0.02  2079128  2079276  -0.01    0    0    nan 
            coq-fiat-parsers   589.90   591.80  -0.32   1649566267078   1653753626808  -0.25   2548729333198   2547981758488   0.03  3475188  3076196  12.97    0    0    nan 
       coq-mathcomp-fingroup    48.72    48.84  -0.25    135275807444    135529429082  -0.19    190725876369    190525150885   0.11   480564   479800   0.16    0    0    nan 
      coq-mathcomp-odd-order  1061.27  1063.74  -0.23   2955517640430   2962092869321  -0.22   4726226096158   4720414767507   0.12   937068   939628  -0.27    0    0    nan 
             coq-lambda-rust  1264.96  1267.73  -0.22   3519297519095   3527028257005  -0.22   5102009820180   5100518565754   0.03  1097104  1077340   1.83    0    0    nan 
               coq-fourcolor  2558.11  2563.64  -0.22   7131546360600   7137759262538  -0.09  12254867655481  12249197045900   0.05   730932   730984  -0.01    0    0    nan 
       coq-engine-bench-lite   315.06   315.59  -0.17    886974699277    887418360870  -0.05   1660064444934   1659852099926   0.01  3506236  3505896   0.01    0    0    nan 
 coq-rewriter-perf-SuperFast   747.26   748.39  -0.15   2080362054781   2083130556183  -0.13   3285678925970   3290458672791  -0.15  1071528  1154096  -7.15    0    0    nan 
               coq-perennial  6802.76  6812.98  -0.15  18946597481662  18975924445071  -0.15  29217494145594  29181589902721   0.12  3058124  3089952  -1.03    0    0    nan 
       coq-mathcomp-solvable   172.24   172.34  -0.06    479145817563    479486505149  -0.07    684828642269    683924813364   0.13   672644   672752  -0.02    0    0    nan 
             coq-fiat-crypto  4865.04  4867.73  -0.06  13511638980862  13516747980985  -0.04  23985945928360  23984719203476   0.01  2224908  2216360   0.39    0    0    nan 
               coq-fiat-core   108.38   108.31   0.06    305989005161    305003199965   0.32    414108724293    413053096179   0.26   480260   480044   0.04    0    0    nan 
                 coq-unimath  4389.87  4386.91   0.07  12211619184312  12210176238195   0.01  23451723416151  23430788171220   0.09  3263644  3265928  -0.07    0    0    nan 
              coq-verdi-raft  1114.17  1113.32   0.08   3101855678664   3100715398017   0.04   4407612560478   4407479412865   0.00   906140   900480   0.63    0    0    nan 
              coq-coquelicot    68.12    68.06   0.09    186846173818    186986821128  -0.08    240798645838    240140813266   0.27   555700   556040  -0.06    0    0    nan 
                   coq-verdi    98.62    98.53   0.09    271246736930    271646949079  -0.15    383385000826    382740139217   0.17   542968   542108   0.16    0    0    nan 
                    coq-hott   340.80   340.36   0.13    939811156428    940623041236  -0.09   1408473676848   1410635788955  -0.15   642044   568888  12.86    0    0    nan 
                    coq-corn  1492.91  1490.96   0.13   4158121598284   4151623977462   0.16   6039271116290   6028753685293   0.17   799096   809784  -1.32    0    0    nan 
                  coq-geocoq  1335.95  1334.00   0.15   3722018009364   3717881600093   0.11   5490312300394   5489136931390   0.02  1002320   988560   1.39    0    0    nan 
          coq-mathcomp-field   224.86   224.43   0.19    625176955416    625296237218  -0.02    958473109753    956083786274   0.25   670988   665012   0.90    0    0    nan 
                  coq-stdlib   416.60   415.69   0.22   1165231294271   1163295957903   0.17   1495645022960   1495500080155   0.01   596604   596288   0.05    0    0    nan 
                coq-bedrock2   311.40   310.22   0.38    862138488377    860305856432   0.21   1518045139440   1515107967278   0.19   798192   792772   0.68    0    0    nan 
                coq-coqprime   326.32   324.81   0.46    906069963458    903472725754   0.29   1598200796092   1597501446331   0.04   855876   855940  -0.01    0    0    nan 
                   coq-color   485.38   483.11   0.47   1355864711000   1352518549682   0.25   1713361800666   1712904583632   0.03  1142932  1142488   0.04    0    0    nan 
                coq-rewriter   680.27   677.02   0.48   1888187194826   1880578417460   0.40   2921403203481   2919246695516   0.07  1071584  1071320   0.02    0    0    nan 
      coq-mathcomp-ssreflect    54.16    53.72   0.82    147576623850    147872933470  -0.20    192126076224    192133207679  -0.00   529084   528472   0.12    0    0    nan 
                    coq-core   106.99   105.76   1.16    296384198725    296142425578   0.08    458095525269    458239921646  -0.03   283104   283124  -0.01    0    0    nan 
└─────────────────────────────┴─────────────────────────┴───────────────────────────────────────┴───────────────────────────────────────┴─────────────────────────┴─────────────────┘

Bench complete, failed to install packages:
coq-compcert
coq-flocq
coq-vst

view this post on Zulip Bench bot (Jun 15 2021 at 04:38):

Bench at https://gitlab.com/coq/coq/-/jobs/1341716513
Testing Refresh type in Tacred.abstract_scheme
On packages coq-bignums coq-hott coq-performance-tests-lite coq-engine-bench-lite coq-mathcomp-ssreflect coq-mathcomp-fingroup coq-mathcomp-algebra coq-mathcomp-solvable coq-mathcomp-field coq-mathcomp-character coq-mathcomp-odd-order coq-math-classes coq-corn coq-flocq coq-compcert coq-geocoq coq-color coq-coqprime coq-coqutil coq-bedrock2 coq-rewriter coq-fiat-core coq-fiat-parsers coq-fiat-crypto coq-unimath coq-coquelicot coq-lambda-rust coq-verdi coq-verdi-raft coq-fourcolor coq-rewriter-perf-SuperFast coq-perennial coq-vst

┌─────────────────────────────┬─────────────────────────┬───────────────────────────────────────┬───────────────────────────────────────┬─────────────────────────┬─────────────────┐
                                   user time [s]                    CPU cycles                          CPU instructions              max resident mem [KB]     mem faults    
                                                                                                                                                                              
                package_name      NEW      OLD  PDIFF             NEW             OLD  PDIFF             NEW             OLD  PDIFF      NEW      OLD  PDIFF  NEW  OLD  PDIFF 
├─────────────────────────────┼─────────────────────────┼───────────────────────────────────────┼───────────────────────────────────────┼─────────────────────────┼─────────────────┤
                 coq-unimath  4371.21  4407.16  -0.82  12154196733914  12262523954010  -0.88  23515654362740  23511165127517   0.02  3265428  3265396   0.00    0    0    nan 
               coq-fiat-core   108.02   108.50  -0.44    306243574539    306561445518  -0.10    414134103794    413004509491   0.27   480224   480260  -0.01    0    0    nan 
 coq-rewriter-perf-SuperFast   749.60   752.01  -0.32   2087066672304   2092163616281  -0.24   3286439872746   3287991627745  -0.05  1125488  1071516   5.04    0    0    nan 
          coq-mathcomp-field   223.90   224.49  -0.26    623556697158    624628164825  -0.17    956033239577    956166558683  -0.01   663284   665712  -0.36    0    0    nan 
      coq-mathcomp-ssreflect    53.98    54.11  -0.24    147621249574    147857543540  -0.16    192175315784    192182265810  -0.00   528532   528556  -0.00    0    0    nan 
            coq-math-classes   176.62   176.88  -0.15    492592416474    492319185034   0.06    653873798652    653872094655   0.00   482136   481996   0.03    0    0    nan 
                coq-rewriter   680.68   681.58  -0.13   1890278086943   1891697688543  -0.08   2922136131621   2921784870218   0.01  1072280  1147144  -6.53    0    0    nan 
      coq-mathcomp-odd-order  1063.57  1064.62  -0.10   2964148825731   2965126007541  -0.03   4720677275920   4720739367289  -0.00   939816   939788   0.00    0    0    nan 
              coq-verdi-raft  1118.11  1118.91  -0.07   3112875049632   3113898399786  -0.03   4408277830799   4407682880156   0.01   900520   900476   0.00    0    0    nan 
               coq-fourcolor  2548.90  2549.73  -0.03   7108049676481   7097505853566   0.15  12250907715953  12249543529612   0.01   730960   731052  -0.01    0    0    nan 
       coq-mathcomp-solvable   172.06   172.10  -0.02    479325350163    478512028633   0.17    684051986983    684005942246   0.01   672844   672736   0.02    0    0    nan 
                    coq-hott   343.19   343.15   0.01    946318396405    943739316610   0.27   1410662466828   1410681230576  -0.00   568572   568488   0.01    0    0    nan 
             coq-fiat-crypto  4885.10  4883.14   0.04  13569086133840  13561748938562   0.05  23983914692813  23982598627520   0.01  2218316  2227568  -0.42    0    0    nan 
        coq-mathcomp-algebra   142.48   142.42   0.04    396141377216    396193154821  -0.01    519413010978    519410153575   0.00   553484   553416   0.01    0    0    nan 
                  coq-geocoq  1342.23  1341.28   0.07   3743719671736   3736025062393   0.21   5490144071123   5489394468643   0.01   988852   988448   0.04    0    0    nan 
                    coq-corn  1498.38  1496.02   0.16   4171586093325   4166383758168   0.12   6028617379105   6028691089220  -0.00   809752   809792  -0.00    0    0    nan 
                   coq-color   487.08   486.20   0.18   1361068903361   1357027469984   0.30   1713828789665   1712947629963   0.05  1142576  1142660  -0.01    0    0    nan 
      coq-mathcomp-character   152.69   152.39   0.20    424154276726    423816651523   0.08    598925615685    598935882460  -0.00   716544   731320  -2.02    0    0    nan 
       coq-engine-bench-lite   314.98   314.29   0.22    886896149390    884261269719   0.30   1656471671380   1658622011136  -0.13  3506300  3506344  -0.00    0    0    nan 
            coq-fiat-parsers   592.09   590.62   0.25   1655855847422   1654436291005   0.09   2549353869387   2548418939099   0.04  3076272  3076272   0.00    0    0    nan 
                 coq-bignums    56.30    56.15   0.27    155050843437    154839273615   0.14    209062031109    209071998838  -0.00   464820   464888  -0.01    0    0    nan 
                coq-bedrock2   311.54   310.57   0.31    862915944778    860858044616   0.24   1515786341763   1515177863162   0.04   770532   798372  -3.49    0    0    nan 
               coq-perennial  6853.45  6826.70   0.39  19089284983192  19017017968442   0.38  29181706092958  29189192574001  -0.03  3089468  3089780  -0.01    0    0    nan 
              coq-coquelicot    68.77    68.48   0.42    187672083618    186766166185   0.49    240889305166    240210361109   0.28   555960   556012  -0.01    0    0    nan 
             coq-lambda-rust  1274.47  1269.00   0.43   3546135436542   3531187942492   0.42   5102056795759   5101483969155   0.01  1077312  1077384  -0.01    0    0    nan 
                  coq-stdlib   418.18   416.18   0.48   1171529967593   1165902264933   0.48   1495674760874   1495460816635   0.01   596252   596328  -0.01    0    0    nan 
  coq-performance-tests-lite  1615.10  1607.17   0.49   4507156250383   4486117650390   0.47   7465614958113   7470744738563  -0.07  2079224  2079188   0.00    0    0    nan 
       coq-mathcomp-fingroup    49.14    48.80   0.70    135593822629    135283870991   0.23    190664951858    190551175670   0.06   479596   479568   0.01    0    0    nan 
                 coq-coqutil    59.04    58.63   0.70    163062837086    162824348576   0.15    215340454351    214987702076   0.16   598100   598164  -0.01    0    0    nan 
                   coq-verdi    99.38    98.64   0.75    272568377138    271367120998   0.44    383452461861    382732739581   0.19   541844   542208  -0.07    0    0    nan 
                coq-coqprime   331.58   328.88   0.82    921500578743    914289000980   0.79   1599723372350   1599063828952   0.04   855808   855628   0.02    0    0    nan 
                    coq-core   106.72   105.44   1.21    295942986913    295724150973   0.07    457852651778    457884528739  -0.01   283228   283260  -0.01    0    0    nan 
└─────────────────────────────┴─────────────────────────┴───────────────────────────────────────┴───────────────────────────────────────┴─────────────────────────┴─────────────────┘

Bench complete, failed to install packages:
coq-compcert
coq-flocq
coq-vst

view this post on Zulip Bench bot (Jun 16 2021 at 11:19):

Bench at https://gitlab.com/coq/coq/-/jobs/1350838106
Testing Store the closedness of a term on its leave in unification matchrec.
On packages coq-bignums coq-hott coq-performance-tests-lite coq-engine-bench-lite coq-mathcomp-ssreflect coq-mathcomp-fingroup coq-mathcomp-algebra coq-mathcomp-solvable coq-mathcomp-field coq-mathcomp-character coq-mathcomp-odd-order coq-math-classes coq-corn coq-flocq coq-compcert coq-geocoq coq-color coq-coqprime coq-coqutil coq-bedrock2 coq-rewriter coq-fiat-core coq-fiat-parsers coq-fiat-crypto coq-unimath coq-coquelicot coq-lambda-rust coq-verdi coq-verdi-raft coq-fourcolor coq-rewriter-perf-SuperFast coq-perennial coq-vst

view this post on Zulip Bench bot (Jun 17 2021 at 12:05):

Bench at https://gitlab.com/coq/coq/-/jobs/1355130531
Testing Fast Typing for application rule
On packages coq-bignums coq-hott coq-performance-tests-lite coq-engine-bench-lite coq-mathcomp-ssreflect coq-mathcomp-fingroup coq-mathcomp-algebra coq-mathcomp-solvable coq-mathcomp-field coq-mathcomp-character coq-mathcomp-odd-order coq-math-classes coq-corn coq-flocq coq-compcert coq-geocoq coq-color coq-coqprime coq-coqutil coq-bedrock2 coq-rewriter coq-fiat-core coq-fiat-parsers coq-fiat-crypto coq-unimath coq-coquelicot coq-lambda-rust coq-verdi coq-verdi-raft coq-fourcolor coq-rewriter-perf-SuperFast coq-perennial coq-vst

┌─────────────────────────────┬─────────────────────────┬───────────────────────────────────────┬───────────────────────────────────────┬─────────────────────────┬─────────────────┐
                                   user time [s]                    CPU cycles                          CPU instructions              max resident mem [KB]     mem faults    
                                                                                                                                                                              
                package_name      NEW      OLD  PDIFF             NEW             OLD  PDIFF             NEW             OLD  PDIFF      NEW      OLD  PDIFF  NEW  OLD  PDIFF 
├─────────────────────────────┼─────────────────────────┼───────────────────────────────────────┼───────────────────────────────────────┼─────────────────────────┼─────────────────┤
       coq-mathcomp-solvable   169.29   171.60  -1.35    471067067465    476864428946  -1.22    668194200777    680202410959  -1.77   679452   672744   1.00    0    0    nan 
      coq-mathcomp-character   149.91   151.59  -1.11    416487180559    421317883260  -1.15    584822566435    595888266789  -1.86   714672   723844  -1.27    0    0    nan 
       coq-mathcomp-fingroup    48.02    48.34  -0.66    132973397318    134415008101  -1.07    186055236391    189475909322  -1.81   481248   479832   0.30    0    0    nan 
          coq-mathcomp-field   221.28   222.56  -0.58    616129899458    620145046309  -0.65    940234842735    953152478655  -1.36   671076   670300   0.12    0    0    nan 
        coq-mathcomp-algebra   141.19   141.80  -0.43    391907398036    394352645030  -0.62    511022313578    517032374556  -1.16   553768   555924  -0.39    0    0    nan 
              coq-coquelicot    67.88    68.15  -0.40    186171258839    186487683300  -0.17    239302534720    239584458807  -0.12   557724   555768   0.35    0    0    nan 
  coq-performance-tests-lite  1587.32  1593.19  -0.37   4429866384679   4444056370147  -0.32   7337207889235   7388785453636  -0.70  2079240  2079192   0.00    0    0    nan 
 coq-rewriter-perf-SuperFast   742.82   745.40  -0.35   2067245384297   2075306446583  -0.39   3223135158043   3244037899887  -0.64  1100520  1124648  -2.15    0    0    nan 
            coq-fiat-parsers   588.25   589.84  -0.27   1646148948365   1647848750131  -0.10   2527762809766   2531906608025  -0.16  3475356  3076100  12.98    0    0    nan 
      coq-mathcomp-odd-order  1051.01  1053.80  -0.26   2926245914258   2933215490107  -0.24   4667180596701   4705943498464  -0.82   909916   939348  -3.13    0    0    nan 
      coq-mathcomp-ssreflect    53.54    53.68  -0.26    146533221564    146896512150  -0.25    189997853839    191540624183  -0.81   525316   528540  -0.61    0    0    nan 
               coq-fourcolor  2547.34  2553.26  -0.23   7098451695852   7107430612720  -0.13  12239599957784  12246450101392  -0.06   731000   730856   0.02    0    0    nan 
              coq-verdi-raft  1108.86  1110.91  -0.18   3089348025905   3093799038279  -0.14   4351798554753   4371944847634  -0.46   904352   904848  -0.05    0    0    nan 
                 coq-unimath  4260.95  4263.12  -0.05  11860650771111  11863685471816  -0.03  22742027211982  22822876486310  -0.35  3283452  3263600   0.61    0    0    nan 
                    coq-hott   339.86   339.90  -0.01    938747711396    937919084198   0.09   1396035586516   1400391410942  -0.31   569780   569784  -0.00    0    0    nan 
               coq-perennial  6765.41  6763.51   0.03  18844982842084  18838943264936   0.03  28785325646104  28844403360143  -0.20  3081460  3117316  -1.15    0    0    nan 
             coq-lambda-rust  1264.88  1264.48   0.03   3519857507396   3519255728476   0.02   5066199413769   5077756649036  -0.23  1097072  1096728   0.03    0    0    nan 
                coq-bedrock2   310.21   309.97   0.08    858940576729    858409412729   0.06   1508605871887   1510079442298  -0.10   798376   798212   0.02    0    0    nan 
             coq-fiat-crypto  4837.78  4832.97   0.10  13434547203042  13426161086174   0.06  23736616258203  23779678103611  -0.18  2225492  2225360   0.01    0    0    nan 
                    coq-corn  1476.28  1474.16   0.14   4108789010119   4107722475993   0.03   5904695634927   5919784774460  -0.25   813156   813008   0.02    0    0    nan 
       coq-engine-bench-lite   314.87   314.38   0.16    887083628541    884873332315   0.25   1650793125689   1660368256480  -0.58  3506084  3506276  -0.01    0    0    nan 
                   coq-color   486.00   485.18   0.17   1355188784122   1353434957857   0.13   1702536193982   1705911947638  -0.20  1161732  1160452   0.11    0    0    nan 
                coq-rewriter   670.57   669.33   0.19   1859534604168   1859481791014   0.00   2851621362163   2870171961713  -0.65  1071340  1071700  -0.03    0    0    nan 
                 coq-coqutil    58.81    58.66   0.26    162592385028    162855538010  -0.16    214581966090    214638864980  -0.03   600384   598668   0.29    0    0    nan 
            coq-math-classes   173.94   173.40   0.31    485740480675    485526463718   0.04    644167960687    645789519000  -0.25   481112   481160  -0.01    0    0    nan 
                 coq-bignums    56.38    56.19   0.34    155514216797    154552454543   0.62    208718956320    208761989979  -0.02   465176   465044   0.03    0    0    nan 
                  coq-stdlib   416.44   414.84   0.39   1164152224140   1160796564299   0.29   1480032365743   1483974160316  -0.27   597460   596684   0.13    0    0    nan 
                  coq-geocoq  1336.39  1330.44   0.45   3726130582829   3713034001390   0.35   5471347492331   5472315957636  -0.02  1067672   992500   7.57    0    0    nan 
                   coq-verdi    98.93    98.46   0.48    271963800664    270617597246   0.50    380040175061    381657581024  -0.42   547652   542496   0.95    0    0    nan 
                    coq-core   106.75   106.24   0.48    296350286791    295798232425   0.19    458351030332    458254565215   0.02   283888   283896  -0.00    0    0    nan 
                coq-coqprime   329.46   327.52   0.59    916001112465    910748773852   0.58   1596120525533   1596137340717  -0.00   913944   914608  -0.07    0    0    nan 
               coq-fiat-core   108.91   107.90   0.94    306703641622    305186161663   0.50    412906684406    412157101728   0.18   480212   479616   0.12    0    0    nan 
└─────────────────────────────┴─────────────────────────┴───────────────────────────────────────┴───────────────────────────────────────┴─────────────────────────┴─────────────────┘

Bench complete, failed to install packages:
coq-compcert
coq-flocq
coq-vst

view this post on Zulip Bench bot (Jun 18 2021 at 08:02):

Bench at https://gitlab.com/coq/coq/-/jobs/1344394255
Testing Use arguments renaming for variables in Typing
On packages coq-bignums coq-hott coq-performance-tests-lite coq-engine-bench-lite coq-mathcomp-ssreflect coq-mathcomp-fingroup coq-mathcomp-algebra coq-mathcomp-solvable coq-mathcomp-field coq-mathcomp-character coq-mathcomp-odd-order coq-math-classes coq-corn coq-flocq coq-compcert coq-geocoq coq-color coq-coqprime coq-coqutil coq-bedrock2 coq-rewriter coq-fiat-core coq-fiat-parsers coq-fiat-crypto coq-unimath coq-coquelicot coq-lambda-rust coq-verdi coq-verdi-raft coq-fourcolor coq-rewriter-perf-SuperFast coq-perennial coq-vst

┌─────────────────────────────┬─────────────────────────┬───────────────────────────────────────┬───────────────────────────────────────┬─────────────────────────┬─────────────────┐
                                   user time [s]                    CPU cycles                          CPU instructions              max resident mem [KB]     mem faults    
                                                                                                                                                                              
                package_name      NEW      OLD  PDIFF             NEW             OLD  PDIFF             NEW             OLD  PDIFF      NEW      OLD  PDIFF  NEW  OLD  PDIFF 
├─────────────────────────────┼─────────────────────────┼───────────────────────────────────────┼───────────────────────────────────────┼─────────────────────────┼─────────────────┤
                coq-coqprime   325.36   326.87  -0.46    904721257070    909433630316  -0.52   1596600060626   1596107706585   0.03   855868   914644  -6.43    0    0    nan 
               coq-fourcolor  2538.70  2546.87  -0.32   7079184097555   7099082147679  -0.28  12246604409764  12246802442990  -0.00   730812   731028  -0.03    0    0    nan 
                 coq-unimath  4270.58  4283.28  -0.30  11876951567247  11920791869571  -0.37  22829140530039  22809789373104   0.08  3264796  3263772   0.03    0    0    nan 
          coq-mathcomp-field   223.55   224.18  -0.28    622525651432    623676601394  -0.18    954226850470    953205563051   0.11   663464   670244  -1.01    0    0    nan 
      coq-mathcomp-odd-order  1059.43  1060.80  -0.13   2948065327680   2953661806154  -0.19   4711297191802   4706000173891   0.11   939692   939464   0.02    0    0    nan 
            coq-math-classes   174.98   175.18  -0.11    487576793748    487687683462  -0.02    646297268463    645820756329   0.07   481216   481112   0.02    0    0    nan 
               coq-fiat-core   108.64   108.73  -0.08    306919781274    305464985114   0.48    413609121502    412249999321   0.33   479364   479524  -0.03    0    0    nan 
                    coq-core   106.90   106.96  -0.06    296618844863    295866553568   0.25    458393947039    458111771790   0.06   319196   319192   0.00    0    0    nan 
            coq-fiat-parsers   588.64   588.83  -0.03   1647742650456   1645979547235   0.11   2533652849645   2531903031446   0.07  3076280  3076080   0.01    0    0    nan 
 coq-rewriter-perf-SuperFast   743.82   743.84  -0.00   2069141609757   2068898763763   0.01   3243564190245   3242027492999   0.05  1072096  1071840   0.02    0    0    nan 
             coq-lambda-rust  1268.22  1267.71   0.04   3529108680637   3528400698439   0.02   5083341261365   5083918320155  -0.01  1089328  1093788  -0.41    0    0    nan 
                   coq-color   484.78   484.28   0.10   1355367736470   1351622902382   0.28   1707663080091   1705987716993   0.10  1153688  1160532  -0.59    0    0    nan 
                coq-rewriter   671.39   670.68   0.11   1863517915705   1861427411268   0.11   2873448970738   2869814967882   0.13  1072152  1071792   0.03    0    0    nan 
                   coq-verdi    98.46    98.31   0.15    271879978491    271201447638   0.25    383148032304    381738111207   0.37   543856   542516   0.25    0    0    nan 
                    coq-corn  1477.82  1475.41   0.16   4115361990303   4107426284351   0.19   5921052689568   5919790037378   0.02   813256   813068   0.02    0    0    nan 
                 coq-bignums    56.02    55.92   0.18    154825734391    154635506803   0.12    208860226596    208758262377   0.05   465076   465204  -0.03    0    0    nan 
               coq-perennial  6860.79  6848.40   0.18  19105521669585  19073071675435   0.17  29195307968571  29198576914213  -0.01  3102596  3117136  -0.47    0    0    nan 
             coq-fiat-crypto  4842.95  4833.47   0.20  13450741369692  13429207605608   0.16  23795239222843  23781130478563   0.06  2215312  2231712  -0.73    0    0    nan 
       coq-engine-bench-lite   314.00   313.38   0.20    883760757591    881833450321   0.22   1658388566635   1650986081022   0.45  3506360  3505824   0.02    0    0    nan 
                  coq-geocoq  1335.41  1332.16   0.24   3723766981280   3716893928468   0.18   5479325591978   5472422579575   0.13   997392   992368   0.51    0    0    nan 
                  coq-stdlib   415.93   414.84   0.26   1164595938996   1159439979843   0.44   1485076726226   1483784692726   0.09   595624   596700  -0.18    0    0    nan 
              coq-verdi-raft  1111.66  1107.13   0.41   3096345341161   3083325426641   0.42   4380814048683   4371766197630   0.21   904080   905128  -0.12    0    0    nan 
  coq-performance-tests-lite  1596.37  1589.12   0.46   4452500377146   4435264148846   0.39   7395150106235   7390788499844   0.06  2079260  2079216   0.00    0    0    nan 
                coq-bedrock2   309.96   308.53   0.46    858445180726    855510169629   0.34   1509527478636   1510086078157  -0.04   770720   798384  -3.46    0    0    nan 
              coq-coquelicot    68.80    68.46   0.50    187749170293    186737713481   0.54    240532379333    239629157893   0.38   555820   555732   0.02    0    0    nan 
                    coq-hott   341.93   340.13   0.53    942357803240    938457247697   0.42   1402739430265   1400173558999   0.18   569764   569864  -0.02    0    0    nan 
       coq-mathcomp-solvable   172.18   171.27   0.53    479060161458    476668466155   0.50    681721390523    680217853122   0.22   693132   694028  -0.13    0    0    nan 
      coq-mathcomp-character   152.85   152.01   0.55    424655782375    423009745176   0.39    597606774044    595880749204   0.29   732140   723288   1.22    0    0    nan 
        coq-mathcomp-algebra   142.98   141.89   0.77    396779141006    394387131757   0.61    518209875050    517144884852   0.21   557024   555896   0.20    0    0    nan 
      coq-mathcomp-ssreflect    54.20    53.60   1.12    147927116730    147010127624   0.62    192011878746    191527289162   0.25   528172   528424  -0.05    0    0    nan 
                 coq-coqutil    58.96    58.26   1.20    163691928423    161775594511   1.18    215426158118    214644890937   0.36   600788   598760   0.34    0    0    nan 
       coq-mathcomp-fingroup    49.09    48.36   1.51    135636176628    134530700584   0.82    190082819205    189493859173   0.31   478512   479828  -0.27    0    0    nan 
└─────────────────────────────┴─────────────────────────┴───────────────────────────────────────┴───────────────────────────────────────┴─────────────────────────┴─────────────────┘

Bench complete, failed to install packages:
coq-compcert
coq-flocq
coq-vst

view this post on Zulip Bench bot (Jun 19 2021 at 02:40):

Bench at https://gitlab.com/coq/coq/-/jobs/1358460477
Testing Fast pretyping of application.
On packages coq-bignums coq-hott coq-performance-tests-lite coq-engine-bench-lite coq-mathcomp-ssreflect coq-mathcomp-fingroup coq-mathcomp-algebra coq-mathcomp-solvable coq-mathcomp-field coq-mathcomp-character coq-mathcomp-odd-order coq-math-classes coq-corn coq-flocq coq-compcert coq-geocoq coq-color coq-coqprime coq-coqutil coq-bedrock2 coq-rewriter coq-fiat-core coq-fiat-parsers coq-fiat-crypto coq-unimath coq-coquelicot coq-lambda-rust coq-verdi coq-verdi-raft coq-fourcolor coq-rewriter-perf-SuperFast coq-perennial coq-vst

┌─────────────────────────────┬─────────────────────────┬───────────────────────────────────────┬───────────────────────────────────────┬──────────────────────────┬─────────────────┐
                                   user time [s]                    CPU cycles                          CPU instructions              max resident mem [KB]      mem faults    
                                                                                                                                                                               
                package_name      NEW      OLD  PDIFF             NEW             OLD  PDIFF             NEW             OLD  PDIFF      NEW      OLD   PDIFF  NEW  OLD  PDIFF 
├─────────────────────────────┼─────────────────────────┼───────────────────────────────────────┼───────────────────────────────────────┼──────────────────────────┼─────────────────┤
 coq-rewriter-perf-SuperFast   738.45   743.65  -0.70   2054879703977   2069309872165  -0.70   3214913951684   3222660367462  -0.24  1071284  1108256   -3.34    0    0    nan 
       coq-mathcomp-solvable   168.97   169.52  -0.32    470465271676    471601408484  -0.24    664029824599    668389562322  -0.65   692824   696996   -0.60    0    0    nan 
       coq-engine-bench-lite   312.76   313.63  -0.28    881070898658    881932130530  -0.10   1646322570632   1650775383764  -0.27  3506096  3506160   -0.00    0    0    nan 
            coq-fiat-parsers   587.32   588.84  -0.26   1642873330988   1648176951749  -0.32   2523266300463   2527485520290  -0.17  3076220  3475216  -11.48    0    0    nan 
            coq-math-classes   174.03   174.45  -0.24    486266562443    486309556012  -0.01    642144152529    644335851996  -0.34   481140   481176   -0.01    0    0    nan 
  coq-performance-tests-lite  1586.00  1589.54  -0.22   4422863097848   4435600720748  -0.29   7333954016550   7337903323135  -0.05  2079296  2079296    0.00    0    0    nan 
      coq-mathcomp-character   149.59   149.90  -0.21    415423692375    416540809519  -0.27    582408345031    584894877971  -0.43   719012   730844   -1.62    0    0    nan 
                coq-rewriter   668.30   669.64  -0.20   1853887546038   1859472551177  -0.30   2847733411045   2849751061216  -0.07  1071408  1071424   -0.00    0    0    nan 
              coq-verdi-raft  1105.77  1107.75  -0.18   3081684790766   3084317770126  -0.09   4347529953114   4351110029603  -0.08   903288   904620   -0.15    0    0    nan 
             coq-fiat-crypto  4827.51  4835.43  -0.16  13408751408269  13428609941721  -0.15  23666591572739  23735652737750  -0.29  2225740  2220728    0.23    0    0    nan 
                    coq-corn  1472.44  1474.08  -0.11   4101707286358   4109060017010  -0.18   5888858266020   5904457994109  -0.26   790796   813192   -2.75    0    0    nan 
               coq-perennial  6838.80  6841.80  -0.04  19050038041184  19063807889140  -0.07  29135357495247  29185958466002  -0.17  3063512  3098468   -1.13    0    0    nan 
                  coq-geocoq  1337.81  1337.85  -0.00   3727753571343   3727335913805   0.01   5450163849149   5470743502065  -0.38   989672   991472   -0.18    0    0    nan 
                   coq-color   485.35   485.30   0.01   1354644725699   1355147902833  -0.04   1702064209042   1701917823870   0.01  1162332  1161964    0.03    0    0    nan 
                coq-bedrock2   309.67   309.58   0.03    858778809363    857864731018   0.11   1507256310106   1508052914413  -0.05   798204   757536    5.37    0    0    nan 
                  coq-stdlib   414.42   414.29   0.03   1159156691642   1161392881481  -0.19   1473576506560   1480412673872  -0.46   594976   597220   -0.38    0    0    nan 
             coq-lambda-rust  1264.79  1264.34   0.04   3520147537068   3519086723097   0.03   5060942974751   5068620647393  -0.15  1096548  1086580    0.92    0    0    nan 
       coq-mathcomp-fingroup    47.90    47.86   0.08    132521184266    132914152665  -0.30    185139568209    186127935470  -0.53   483756   481876    0.39    0    0    nan 
                 coq-bignums    56.14    56.09   0.09    154852535223    155244005231  -0.25    208450598555    208811566958  -0.17   464844   465076   -0.05    0    0    nan 
      coq-mathcomp-odd-order  1052.36  1050.81   0.15   2931192285884   2928660095854   0.09   4625125152624   4666986470494  -0.90   939652   909604    3.30    0    0    nan 
               coq-fourcolor  2548.04  2543.08   0.20   7092869938250   7079870487043   0.18  12238113938958  12239673834110  -0.01   730944   730960   -0.00    0    0    nan 
        coq-mathcomp-algebra   141.10   140.60   0.36    391764977978    390984171537   0.20    509193062427    511086393093  -0.37   555280   553892    0.25    0    0    nan 
                   coq-verdi    98.72    98.32   0.41    270429785372    269902248856   0.20    378332414648    379016984707  -0.18   544896   547572   -0.49    0    0    nan 
          coq-mathcomp-field   221.90   220.70   0.54    617661182581    615183311979   0.40    937711330100    940330382980  -0.28   670976   671296   -0.05    0    0    nan 
               coq-fiat-core   108.42   107.83   0.55    306023236554    305620649172   0.13    412535953618    411924641658   0.15   480684   480008    0.14    0    0    nan 
                    coq-hott   347.53   345.57   0.57    957400951483    955506887837   0.20   1418856497265   1423047098045  -0.29   568156   570044   -0.33    0    0    nan 
                 coq-unimath  4284.85  4260.26   0.58  11920452759061  11856390474959   0.54  22714316283199  22743386977983  -0.13  3276336  3278732   -0.07    0    0    nan 
              coq-coquelicot    68.47    68.06   0.60    187059694628    186476652426   0.31    238923656898    238669050265   0.11   557704   557812   -0.02    0    0    nan 
      coq-mathcomp-ssreflect    53.69    53.35   0.64    146465061726    146547075335  -0.06    189041806672    190077875275  -0.55   526304   525256    0.20    0    0    nan 
                 coq-coqutil    58.60    58.11   0.84    162803265269    162261907423   0.33    214421586952    214274107490   0.07   600240   600536   -0.05    0    0    nan 
                coq-coqprime   330.91   328.14   0.84    920007124070    912164750282   0.86   1595280137175   1595487821518  -0.01   915604   914956    0.07    0    0    nan 
                    coq-core   107.26   105.25   1.91    296436066369    295491971868   0.32    458340739898    458219876411   0.03   284652   284688   -0.01    0    0    nan 
└─────────────────────────────┴─────────────────────────┴───────────────────────────────────────┴───────────────────────────────────────┴──────────────────────────┴─────────────────┘

Bench complete, failed to install packages:
coq-compcert
coq-flocq
coq-vst

view this post on Zulip Bench bot (Jun 23 2021 at 12:47):

Bench at https://gitlab.com/coq/coq/-/jobs/1370458391
Testing Fast pretyping of application.
On packages coq-bignums coq-hott coq-performance-tests-lite coq-engine-bench-lite coq-mathcomp-ssreflect coq-mathcomp-fingroup coq-mathcomp-algebra coq-mathcomp-solvable coq-mathcomp-field coq-mathcomp-character coq-mathcomp-odd-order coq-math-classes coq-corn coq-flocq coq-compcert coq-geocoq coq-color coq-coqprime coq-coqutil coq-bedrock2 coq-rewriter coq-fiat-core coq-fiat-parsers coq-fiat-crypto coq-unimath coq-coquelicot coq-lambda-rust coq-verdi coq-verdi-raft coq-fourcolor coq-rewriter-perf-SuperFast coq-perennial coq-vst

┌─────────────────────────────┬─────────────────────────┬───────────────────────────────────────┬───────────────────────────────────────┬─────────────────────────┬─────────────────┐
                                   user time [s]                    CPU cycles                          CPU instructions              max resident mem [KB]     mem faults    
                                                                                                                                                                              
                package_name      NEW      OLD  PDIFF             NEW             OLD  PDIFF             NEW             OLD  PDIFF      NEW      OLD  PDIFF  NEW  OLD  PDIFF 
├─────────────────────────────┼─────────────────────────┼───────────────────────────────────────┼───────────────────────────────────────┼─────────────────────────┼─────────────────┤
       coq-mathcomp-fingroup    47.76    48.08  -0.67    132690226020    133079438197  -0.29    185161653933    186116039748  -0.51   480752   481960  -0.25    0    0    nan 
                  coq-geocoq  1331.11  1337.76  -0.50   3712202617819   3725531163483  -0.36   5448832884181   5469168746628  -0.37  1067620   985232   8.36    0    0    nan 
                coq-bedrock2   308.42   309.94  -0.49    853738093503    859471431775  -0.67   1507404517616   1508666672758  -0.08   757640   798296  -5.09    0    0    nan 
                 coq-unimath  4253.06  4268.97  -0.37  11833399845233  11872094404493  -0.33  22713020003313  22734161194104  -0.09  3280792  2879608  13.93    0    0    nan 
                 coq-bignums    56.01    56.21  -0.36    154832455431    154919903328  -0.06    208466414733    208776097831  -0.15   465832   466248  -0.09    0    0    nan 
       coq-engine-bench-lite   313.03   314.00  -0.31    880737319046    883447949908  -0.31   1641740765047   1653605994833  -0.72  3506504  3506312   0.01    0    0    nan 
              coq-verdi-raft  1104.77  1107.64  -0.26   3078634667275   3083480968105  -0.16   4346867783067   4351918787630  -0.12   901712   902728  -0.11    0    0    nan 
      coq-mathcomp-character   149.69   150.04  -0.23    416071834119    416855820451  -0.19    582115837822    584768154937  -0.45   721400   716116   0.74    0    0    nan 
               coq-fiat-core   108.43   108.67  -0.22    306723752774    305316137131   0.46    413455932954    412552334663   0.22   480940   480420   0.11    0    0    nan 
                   coq-flocq   146.50   146.79  -0.20    406299137532    406553919338  -0.06    504347548188    504971002082  -0.12   808532   808416   0.01    0    0    nan 
                    coq-corn  1473.11  1475.28  -0.15   4103669797261   4105034252598  -0.03   5886362695539   5902035061219  -0.27   790692   812784  -2.72    0    0    nan 
 coq-rewriter-perf-SuperFast   737.01   738.01  -0.14   2051996810857   2055977863005  -0.19   3214210078291   3219255060650  -0.16  1071424  1071396   0.00    0    0    nan 
       coq-mathcomp-solvable   169.24   169.46  -0.13    470935053565    470952425792  -0.00    663981517927    668255519256  -0.64   696880   673072   3.54    0    0    nan 
            coq-fiat-parsers   587.47   587.66  -0.03   1644539470918   1646156149995  -0.10   2522742121365   2529405255519  -0.26  3076052  3076156  -0.00    0    0    nan 
          coq-mathcomp-field   221.50   221.53  -0.01    616141153006    616674082332  -0.09    937354427763    940299176374  -0.31   662332   669352  -1.05    0    0    nan 
  coq-performance-tests-lite  1585.80  1585.22   0.04   4423711554513   4425583144360  -0.04   7332663003392   7335256992867  -0.04  2079164  2079172  -0.00    0    0    nan 
                  coq-stdlib   414.38   414.16   0.05   1158287899695   1157408814096   0.08   1472938642880   1479736801613  -0.46   592588   595612  -0.51    0    0    nan 
               coq-fourcolor  2544.24  2541.76   0.10   7092471374265   7087609272345   0.07  12234803807377  12240788217000  -0.05   730960   730808   0.02    0    0    nan 
               coq-perennial  6841.71  6833.41   0.12  19054019411794  19032548965738   0.11  29075171543722  29141134641638  -0.23  3070172  3092056  -0.71    0    0    nan 
        coq-mathcomp-algebra   141.10   140.88   0.16    391542017842    391956298096  -0.11    508852947647    510936563253  -0.41   556392   553812   0.47    0    0    nan 
                    coq-hott   280.96   280.23   0.26    771834993293    771518376351   0.04   1195012624714   1199141744008  -0.34   570468   569192   0.22    0    0    nan 
                   coq-color   485.47   484.10   0.28   1354709772636   1350408626613   0.32   1702328850884   1701907631330   0.02  1151868  1117684   3.06    0    0    nan 
             coq-fiat-crypto  4830.56  4816.58   0.29  13416969739386  13376609803928   0.30  23654188394924  23727955016643  -0.31  2216020  2218788  -0.12    0    0    nan 
      coq-mathcomp-odd-order  1051.43  1047.56   0.37   2928519689686   2919255003432   0.32   4624230262418   4665210785720  -0.88   939476   939612  -0.01    0    0    nan 
                    coq-core   107.57   107.17   0.37    296477662857    295871521246   0.20    458442096939    458394941653   0.01   304260   304268  -0.00    0    0    nan 
            coq-math-classes   174.46   173.74   0.41    487090415564    485276678103   0.37    642046803732    644135946636  -0.32   481460   481364   0.02    0    0    nan 
                coq-rewriter   670.64   667.77   0.43   1861585090292   1854610984223   0.38   2847757939229   2850108085675  -0.08  1071740  1071764  -0.00    0    0    nan 
                   coq-verdi    98.69    98.25   0.45    270416465315    270098744364   0.12    378815453270    379208538965  -0.10   544428   544900  -0.09    0    0    nan 
              coq-coquelicot    69.04    68.68   0.52    187626975075    186713958511   0.49    239467027317    239017108259   0.19   558148   557612   0.10    0    0    nan 
             coq-lambda-rust  1268.38  1261.64   0.53   3528165860885   3510907754966   0.49   5059478868484   5064752218725  -0.10  1090704  1100896  -0.93    0    0    nan 
      coq-mathcomp-ssreflect    53.86    53.44   0.79    146591972476    146424057382   0.11    188987286977    190095977551  -0.58   525988   526252  -0.05    0    0    nan 
                 coq-coqutil    59.04    58.44   1.03    162920636724    162363823297   0.34    214769907337    214470673144   0.14   600428   600388   0.01    0    0    nan 
                coq-coqprime   331.30   325.97   1.64    920697739601    906638954233   1.55   1596091925174   1595566388574   0.03   916896   915676   0.13    0    0    nan 
└─────────────────────────────┴─────────────────────────┴───────────────────────────────────────┴───────────────────────────────────────┴─────────────────────────┴─────────────────┘

Bench complete, failed to install packages:
coq-compcert
coq-vst

view this post on Zulip Bench bot (Jun 24 2021 at 09:00):

Bench at https://gitlab.com/coq/coq/-/jobs/1373351655
Testing Fast pretyping of application.
On packages coq-bignums coq-hott coq-performance-tests-lite coq-engine-bench-lite coq-mathcomp-ssreflect coq-mathcomp-fingroup coq-mathcomp-algebra coq-mathcomp-solvable coq-mathcomp-field coq-mathcomp-character coq-mathcomp-odd-order coq-math-classes coq-corn coq-flocq coq-compcert coq-geocoq coq-color coq-coqprime coq-coqutil coq-bedrock2 coq-rewriter coq-fiat-core coq-fiat-parsers coq-fiat-crypto coq-unimath coq-coquelicot coq-lambda-rust coq-verdi coq-verdi-raft coq-fourcolor coq-rewriter-perf-SuperFast coq-perennial coq-vst

┌─────────────────────────────┬─────────────────────────┬───────────────────────────────────────┬───────────────────────────────────────┬─────────────────────────┬─────────────────┐
                                   user time [s]                    CPU cycles                          CPU instructions              max resident mem [KB]     mem faults    
                                                                                                                                                                              
                package_name      NEW      OLD  PDIFF             NEW             OLD  PDIFF             NEW             OLD  PDIFF      NEW      OLD  PDIFF  NEW  OLD  PDIFF 
├─────────────────────────────┼─────────────────────────┼───────────────────────────────────────┼───────────────────────────────────────┼─────────────────────────┼─────────────────┤
                 coq-bignums    55.58    56.59  -1.78    154523942934    155436522777  -0.59    208502598794    208871646511  -0.18   465936   466272  -0.07    0    0    nan 
                 coq-coqutil    58.34    58.92  -0.98    162046077303    163084389445  -0.64    214834856762    214536878841   0.14   600412   600412   0.00    0    0    nan 
       coq-engine-bench-lite   312.12   314.09  -0.63    878500156637    884066771024  -0.63   1639423882104   1653757488242  -0.87  3506364  3506124   0.01    0    0    nan 
        coq-mathcomp-algebra   140.26   141.14  -0.62    390206676766    392190962121  -0.51    508841400876    510989162481  -0.42   555816   554020   0.32    0    0    nan 
       coq-mathcomp-solvable   168.46   169.48  -0.60    469145363634    471578531603  -0.52    664127004285    668491306288  -0.65   697444   697004   0.06    0    0    nan 
      coq-mathcomp-ssreflect    53.57    53.88  -0.58    146080391975    146590437859  -0.35    189029928637    190156015183  -0.59   526512   525876   0.12    0    0    nan 
                  coq-geocoq  1326.36  1333.28  -0.52   3698552677863   3716306844348  -0.48   5449904551456   5469220056125  -0.35   989164   981088   0.82    0    0    nan 
          coq-mathcomp-field   220.73   221.84  -0.50    614960396592    616329145265  -0.22    937519264608    940612380948  -0.33   665168   669372  -0.63    0    0    nan 
      coq-mathcomp-odd-order  1043.00  1047.75  -0.45   2906410968909   2919855095877  -0.46   4624138427440   4665137069777  -0.88   927976   939676  -1.25    0    0    nan 
 coq-rewriter-perf-SuperFast   736.19   739.36  -0.43   2050716316335   2057543458094  -0.33   3218102948052   3219776450427  -0.05  1125160  1071540   5.00    0    0    nan 
              coq-verdi-raft  1103.99  1108.60  -0.42   3074784565491   3087268069277  -0.40   4347010741116   4350321345001  -0.08   901512   902748  -0.14    0    0    nan 
                    coq-corn  1468.36  1474.30  -0.40   4089699041436   4104101737493  -0.35   5886612097365   5902053889742  -0.26   791152   812688  -2.65    0    0    nan 
      coq-mathcomp-character   149.22   149.72  -0.33    414985734450    416742652608  -0.42    582271761224    584782478026  -0.43   732132   720800   1.57    0    0    nan 
               coq-perennial  6809.65  6827.56  -0.26  18967331215131  19018385930285  -0.27  29068251942318  29140588344812  -0.25  3071412  3078612  -0.23    0    0    nan 
       coq-mathcomp-fingroup    47.89    48.00  -0.23    132570364162    132948037410  -0.28    185143732203    186195404631  -0.56   480312   481976  -0.35    0    0    nan 
                    coq-hott   279.86   280.44  -0.21    770447762280    771051372989  -0.08   1195260292940   1199192192996  -0.33   570672   569376   0.23    0    0    nan 
                coq-rewriter   667.24   668.50  -0.19   1853941647655   1856427217933  -0.13   2848416687099   2850103793342  -0.06  1071540  1071548  -0.00    0    0    nan 
             coq-lambda-rust  1261.82  1263.68  -0.15   3510457265844   3517672050608  -0.21   5059368842941   5064697676057  -0.11  1077260  1101084  -2.16    0    0    nan 
            coq-fiat-parsers   587.78   588.52  -0.13   1644049764338   1647801754266  -0.23   2523009799167   2529383949146  -0.25  3076300  3076108   0.01    0    0    nan 
                  coq-stdlib   412.86   413.35  -0.12   1156214726602   1157346214557  -0.10   1473009644065   1479778495376  -0.46   592612   595580  -0.50    0    0    nan 
             coq-fiat-crypto  4816.32  4821.42  -0.11  13376281478104  13386890592691  -0.08  23673816805535  23727169915001  -0.22  2216584  2227096  -0.47    0    0    nan 
            coq-math-classes   173.72   173.86  -0.08    484982881090    485299810147  -0.07    642118483581    644195302173  -0.32   481440   481208   0.05    0    0    nan 
                coq-bedrock2   309.83   309.90  -0.02    858453744755    859672036815  -0.14   1508901639572   1510065927477  -0.08   798404   798360   0.01    0    0    nan 
                   coq-flocq   146.31   146.34  -0.02    405865066673    405775481558   0.02    504336960488    505013520679  -0.13   808376   808512  -0.02    0    0    nan 
  coq-performance-tests-lite  1587.85  1585.91   0.12   4428945057722   4424455265989   0.10   7332592009940   7335745330441  -0.04  2079316  2079312   0.00    0    0    nan 
                coq-coqprime   327.08   326.56   0.16    907772946456    907280885452   0.05   1596392560697   1595622834091   0.05   916460   915748   0.08    0    0    nan 
                 coq-unimath  4276.70  4269.28   0.17  11900641056636  11876932600143   0.20  22749688637674  22781386151569  -0.14  3265352  3264940   0.01    0    0    nan 
               coq-fourcolor  2547.55  2539.42   0.32   7100580385585   7076230377614   0.34  12235704542048  12240633688377  -0.04   730916   730844   0.01    0    0    nan 
                   coq-color   484.92   482.76   0.45   1352971039677   1348575572011   0.33   1702434379866   1701917180435   0.03  1151836  1152984  -0.10    0    0    nan 
                   coq-verdi    98.49    98.00   0.50    270032755960    269752114373   0.10    378884400732    379290467218  -0.11   544380   544904  -0.10    0    0    nan 
               coq-fiat-core   108.67   107.88   0.73    306089142104    305211118386   0.29    413502185858    412632069493   0.21   480928   480448   0.10    0    0    nan 
              coq-coquelicot    68.60    67.85   1.11    186873486205    186420362524   0.24    239515195369    239109975844   0.17   558388   557648   0.13    0    0    nan 
                    coq-core   107.57   106.08   1.40    296418309573    296192371741   0.08    458430457723    458446135729  -0.00   285204   285244  -0.01    0    0    nan 
└─────────────────────────────┴─────────────────────────┴───────────────────────────────────────┴───────────────────────────────────────┴─────────────────────────┴─────────────────┘

Bench complete, failed to install packages:
coq-compcert
coq-vst

view this post on Zulip Bench bot (Jun 25 2021 at 03:38):

Bench at https://gitlab.com/coq/coq/-/jobs/1373823779
Testing Slightly saner definition of Unification.subst_defined_metas_evars.
On packages coq-bignums coq-hott coq-performance-tests-lite coq-engine-bench-lite coq-mathcomp-ssreflect coq-mathcomp-fingroup coq-mathcomp-algebra coq-mathcomp-solvable coq-mathcomp-field coq-mathcomp-character coq-mathcomp-odd-order coq-math-classes coq-corn coq-flocq coq-compcert coq-geocoq coq-color coq-coqprime coq-coqutil coq-bedrock2 coq-rewriter coq-fiat-core coq-fiat-parsers coq-fiat-crypto coq-unimath coq-coquelicot coq-lambda-rust coq-verdi coq-verdi-raft coq-fourcolor coq-rewriter-perf-SuperFast coq-perennial coq-vst

┌─────────────────────────────┬─────────────────────────┬───────────────────────────────────────┬───────────────────────────────────────┬─────────────────────────┬─────────────────┐
                                   user time [s]                    CPU cycles                          CPU instructions              max resident mem [KB]     mem faults    
                                                                                                                                                                              
                package_name      NEW      OLD  PDIFF             NEW             OLD  PDIFF             NEW             OLD  PDIFF      NEW      OLD  PDIFF  NEW  OLD  PDIFF 
├─────────────────────────────┼─────────────────────────┼───────────────────────────────────────┼───────────────────────────────────────┼─────────────────────────┼─────────────────┤
                coq-bedrock2   308.82   310.75  -0.62    857042888255    860332103852  -0.38   1504603425518   1503750910920   0.06   798264   798300  -0.00    0    0    nan 
                 coq-coqutil    58.46    58.74  -0.48    162834033439    163393332474  -0.34    214478817615    213917709367   0.26   600828   600896  -0.01    0    0    nan 
                   coq-flocq   146.40   146.85  -0.31    406520867889    407240727437  -0.18    504682460465    504669764187   0.00   808452   808344   0.01    0    0    nan 
                   coq-verdi    97.67    97.93  -0.27    269670036538    269224356494   0.17    379770609105    378756614292   0.27   544008   544160  -0.03    0    0    nan 
                  coq-geocoq  1329.17  1332.20  -0.23   3708043058112   3710399251854  -0.06   5469104167438   5468720713910   0.01   986864   987816  -0.10    0    0    nan 
                    coq-hott   279.00   279.50  -0.18    767054147066    767882556315  -0.11   1187278193633   1187272013491   0.00   570240   570200   0.01    0    0    nan 
       coq-mathcomp-solvable   169.20   169.44  -0.14    470749571660    471202994589  -0.10    668212102386    668235862655  -0.00   673020   673096  -0.01    0    0    nan 
                 coq-unimath  4266.86  4272.86  -0.14  11869557566099  11887296126120  -0.15  22677270476762  22692510664156  -0.07  3262972  3282940  -0.61    0    0    nan 
             coq-lambda-rust  1258.59  1260.13  -0.12   3503254826652   3506522108770  -0.09   5061028035439   5060231438669   0.02  1073864  1073956  -0.01    0    0    nan 
            coq-math-classes   173.62   173.70  -0.05    484299876319    485290877369  -0.20    643924737351    643924138010   0.00   481392   481100   0.06    0    0    nan 
             coq-fiat-crypto  4803.83  4804.88  -0.02  13343041686424  13346985358381  -0.03  23587801289030  23586532986540   0.01  2217388  2218284  -0.04    0    0    nan 
  coq-performance-tests-lite  1554.40  1554.24   0.01   4341038605197   4336668178363   0.10   7127895870362   7127762438279   0.00  2079260  2079272  -0.00    0    0    nan 
              coq-verdi-raft  1102.98  1102.57   0.04   3071207290399   3071671279187  -0.02   4324397032619   4323606321628   0.02   902328   902724  -0.04    0    0    nan 
 coq-rewriter-perf-SuperFast   738.84   738.34   0.07   2057357217903   2054241446287   0.15   3213405908872   3213470147399  -0.00  1071944  1071812   0.01    0    0    nan 
            coq-fiat-parsers   583.06   582.62   0.08   1628789811495   1629984414742  -0.07   2496299670854   2495661083866   0.03  3475448  3475464  -0.00    0    0    nan 
               coq-perennial  6822.68  6815.13   0.11  19001050669503  18983535708171   0.09  29104419578690  29073423693058   0.11  3075940  3077132  -0.04    0    0    nan 
      coq-mathcomp-ssreflect    53.63    53.57   0.11    146432846365    146933348625  -0.34    190002320165    190029411684  -0.01   526204   525836   0.07    0    0    nan 
          coq-mathcomp-field   221.25   221.00   0.11    616059536537    615861598701   0.03    940240819570    940313388608  -0.01   669700   669832  -0.02    0    0    nan 
                    coq-corn  1472.04  1470.31   0.12   4098093171928   4097213176744   0.02   5897235063182   5897502113297  -0.00   812776   812636   0.02    0    0    nan 
                coq-coqprime   329.25   328.84   0.12    914714146592    914599775143   0.01   1595383711626   1595306877961   0.00   918220   918520  -0.03    0    0    nan 
               coq-fourcolor  2551.76  2548.30   0.14   7114186642088   7103804201904   0.15  12239881228116  12240901359332  -0.01   730808   731056  -0.03    0    0    nan 
      coq-mathcomp-odd-order  1053.23  1051.72   0.14   2931357130660   2930121587597   0.04   4665162191229   4664988316498   0.00   939656   939680  -0.00    0    0    nan 
       coq-engine-bench-lite   313.32   312.83   0.16    882151862534    879834226632   0.26   1642120941689   1641038825745   0.07  3506328  3506196   0.00    0    0    nan 
                    coq-core   107.11   106.93   0.17    296405474232    296062882380   0.12    458385180428    458621295433  -0.05   320244   320240   0.00    0    0    nan 
      coq-mathcomp-character   149.87   149.60   0.18    416429562319    415610695271   0.20    584689369174    584740793507  -0.01   730892   716268   2.04    0    0    nan 
                  coq-stdlib   413.80   412.97   0.20   1157037296306   1154820980054   0.19   1474272780137   1474508969522  -0.02   596020   595872   0.02    0    0    nan 
                   coq-color   482.92   481.94   0.20   1350122706244   1346944339462   0.24   1699939240897   1698807626003   0.07  1153000  1100116   4.81    0    0    nan 
                coq-rewriter   667.93   666.34   0.24   1853884600837   1849145455195   0.26   2845806261833   2843565821787   0.08  1071940  1072048  -0.01    0    0    nan 
       coq-mathcomp-fingroup    48.06    47.92   0.29    132820919470    132776464404   0.03    186051803743    186064537080  -0.01   482120   481956   0.03    0    0    nan 
               coq-fiat-core   107.87   107.49   0.35    306116405868    305100456514   0.33    413792323141    412362562077   0.35   480608   480600   0.00    0    0    nan 
        coq-mathcomp-algebra   141.08   140.50   0.41    391864740427    390914627980   0.24    510852651525    510863511665  -0.00   553800   553896  -0.02    0    0    nan 
                 coq-bignums    55.85    55.59   0.47    153773689240    153519567311   0.17    206233386509    206221719440   0.01   464068   464252  -0.04    0    0    nan 
              coq-coquelicot    68.43    68.03   0.59    186804065267    186029641899   0.42    239887680849    238936171779   0.40   557632   557624   0.00    0    0    nan 
└─────────────────────────────┴─────────────────────────┴───────────────────────────────────────┴───────────────────────────────────────┴─────────────────────────┴─────────────────┘

Bench complete, failed to install packages:
coq-compcert
coq-vst

view this post on Zulip Bench bot (Jun 25 2021 at 22:15):

Bench at https://gitlab.com/coq/coq/-/jobs/1377490779
Testing Fast meta check subst defined
On packages coq-bignums coq-hott coq-performance-tests-lite coq-engine-bench-lite coq-mathcomp-ssreflect coq-mathcomp-fingroup coq-mathcomp-algebra coq-mathcomp-solvable coq-mathcomp-field coq-mathcomp-character coq-mathcomp-odd-order coq-math-classes coq-corn coq-flocq coq-compcert coq-geocoq coq-color coq-coqprime coq-coqutil coq-bedrock2 coq-rewriter coq-fiat-core coq-fiat-parsers coq-fiat-crypto coq-unimath coq-coquelicot coq-lambda-rust coq-verdi coq-verdi-raft coq-fourcolor coq-rewriter-perf-SuperFast coq-perennial coq-vst

┌─────────────────────────────┬─────────────────────────┬───────────────────────────────────────┬───────────────────────────────────────┬─────────────────────────┬─────────────────┐
                                   user time [s]                    CPU cycles                          CPU instructions              max resident mem [KB]     mem faults    
                                                                                                                                                                              
                package_name      NEW      OLD  PDIFF             NEW             OLD  PDIFF             NEW             OLD  PDIFF      NEW      OLD  PDIFF  NEW  OLD  PDIFF 
├─────────────────────────────┼─────────────────────────┼───────────────────────────────────────┼───────────────────────────────────────┼─────────────────────────┼─────────────────┤
  coq-performance-tests-lite  1514.13  1553.77  -2.55   4226512930620   4334875430615  -2.50   6887516176041   7126784954280  -3.36  2079152  2079292  -0.01    0    0    nan 
                  coq-stdlib   407.30   412.12  -1.17   1137564931174   1153841356623  -1.41   1416555398271   1474356827882  -3.92   590080   595872  -0.97    0    0    nan 
              coq-verdi-raft  1095.84  1101.74  -0.54   3050931005311   3065313867351  -0.47   4275046133646   4324182120280  -1.14   904376   902864   0.17    0    0    nan 
                  coq-geocoq  1323.06  1329.26  -0.47   3686965052779   3705269085275  -0.49   5395952050798   5468681077464  -1.33   995696   987492   0.83    0    0    nan 
                    coq-corn  1466.91  1473.43  -0.44   4084008870226   4099219971551  -0.37   5843925213832   5897472035090  -0.91   812844   812608   0.03    0    0    nan 
                coq-bedrock2   308.23   309.54  -0.42    854289927606    858170379579  -0.45   1496118531153   1503807645033  -0.51   798344   798360  -0.00    0    0    nan 
                    coq-core   106.59   107.01  -0.39    296456158053    295978986751   0.16    458409665436    458290834498   0.03   303796   303856  -0.02    0    0    nan 
                 coq-unimath  4262.05  4272.66  -0.25  11855906556301  11889328401774  -0.28  22667988162572  22680431460351  -0.05  3262976  3283400  -0.62    0    0    nan 
 coq-rewriter-perf-SuperFast   737.18   738.54  -0.18   2052702737281   2054118254992  -0.07   3207046126387   3213516615611  -0.20  1072052  1071948   0.01    0    0    nan 
                   coq-flocq   146.40   146.41  -0.01    406789153854    406251932937   0.13    504625133216    504801640446  -0.03   808412   808436  -0.00    0    0    nan 
       coq-mathcomp-fingroup    48.03    48.03   0.00    132921522741    132798798363   0.09    186061287915    186142028145  -0.04   481680   482040  -0.07    0    0    nan 
                   coq-verdi    98.04    98.02   0.02    270399744210    269523196400   0.33    379218747226    378858375844   0.10   542028   544252  -0.41    0    0    nan 
            coq-fiat-parsers   583.29   583.14   0.03   1628227808880   1630530829915  -0.14   2489436628766   2496033371141  -0.26  3475216  3475360  -0.00    0    0    nan 
                 coq-bignums    56.01    55.97   0.07    153849491955    153665121213   0.12    206253928177    206342745231  -0.04   463732   464180  -0.10    0    0    nan 
               coq-fourcolor  2551.67  2549.61   0.08   7111682109424   7106968385467   0.07  12238786222169  12240734575857  -0.02   730940   730944  -0.00    0    0    nan 
             coq-fiat-crypto  4813.57  4807.24   0.13  13372059067781  13350873366344   0.16  23517547083744  23585976586714  -0.29  2222268  2220468   0.08    0    0    nan 
                    coq-hott   278.89   278.48   0.15    766711325671    766877216035  -0.02   1185002920662   1187380829691  -0.20   570256   570044   0.04    0    0    nan 
                   coq-color   482.56   481.76   0.17   1347049354722   1345499166346   0.12   1691452991984   1699039653018  -0.45  1151476  1101088   4.58    0    0    nan 
       coq-mathcomp-solvable   169.52   169.17   0.21    471544024480    470894649023   0.14    668109426988    668280977009  -0.03   673004   689964  -2.46    0    0    nan 
               coq-perennial  6827.91  6811.24   0.24  19019121648889  18966317558161   0.28  28994795550093  29087334101876  -0.32  3115688  3077232   1.25    0    0    nan 
               coq-fiat-core   108.19   107.90   0.27    306057762080    305618972062   0.14    413253650365    412447534744   0.20   481124   480556   0.12    0    0    nan 
        coq-mathcomp-algebra   140.79   140.40   0.28    391887041944    390736381704   0.29    510703841957    510904949443  -0.04   553908   553812   0.02    0    0    nan 
             coq-lambda-rust  1262.98  1258.33   0.37   3514663453780   3502525470319   0.35   5053998172522   5063324068926  -0.18  1106596  1077148   2.73    0    0    nan 
      coq-mathcomp-character   150.18   149.62   0.37    417059026273    416057759938   0.24    584784965084    584862266765  -0.01   730896   730816   0.01    0    0    nan 
      coq-mathcomp-odd-order  1058.04  1053.25   0.45   2947343026331   2931037629069   0.56   4662949865538   4665027120230  -0.04   939588   939616  -0.00    0    0    nan 
          coq-mathcomp-field   222.13   221.04   0.49    618410521189    615517274572   0.47    939799464609    940304361602  -0.05   668096   670024  -0.29    0    0    nan 
            coq-math-classes   174.61   173.53   0.62    487496090009    484248984875   0.67    642684091989    643999798255  -0.20   481376   481428  -0.01    0    0    nan 
       coq-engine-bench-lite   314.16   312.16   0.64    883752939821    878832732966   0.56   1641594558935   1638637831471   0.18  3506320  3506180   0.00    0    0    nan 
                coq-rewriter   670.30   665.78   0.68   1859346919237   1847789197743   0.63   2841180681061   2843525237409  -0.08  1072240  1071996   0.02    0    0    nan 
      coq-mathcomp-ssreflect    53.87    53.48   0.73    146866823286    146572169833   0.20    190037140643    190138679274  -0.05   525412   526272  -0.16    0    0    nan 
                coq-coqprime   331.78   329.19   0.79    920730332695    914995800559   0.63   1595421120073   1594853452085   0.04   921288   918516   0.30    0    0    nan 
                 coq-coqutil    58.88    58.14   1.27    162744718123    161526190071   0.75    214484051366    214024193929   0.21   600732   600740  -0.00    0    0    nan 
              coq-coquelicot    69.19    67.94   1.84    187520480160    185872507856   0.89    239898651401    238997523882   0.38   558280   557720   0.10    0    0    nan 
└─────────────────────────────┴─────────────────────────┴───────────────────────────────────────┴───────────────────────────────────────┴─────────────────────────┴─────────────────┘

Bench complete, failed to install packages:
coq-compcert
coq-vst

view this post on Zulip Bench bot (Jun 28 2021 at 08:07):

Bench at https://gitlab.com/coq/coq/-/jobs/1381540510
Testing Clenv compact defs
On packages coq-coqprime

┌──────────────┬───────────────────────┬─────────────────────────────────────┬─────────────────────────────────────┬───────────────────────┬─────────────────┐
                   user time [s]                  CPU cycles                        CPU instructions            max resident mem [KB]    mem faults    
                                                                                                                                                       
 package_name     NEW     OLD  PDIFF            NEW            OLD  PDIFF            NEW            OLD  PDIFF     NEW     OLD  PDIFF  NEW  OLD  PDIFF 
├──────────────┼───────────────────────┼─────────────────────────────────────┼─────────────────────────────────────┼───────────────────────┼─────────────────┤
 coq-coqprime  326.87  347.48  -5.93   908943690362   965668933675  -5.87  1587529395017  1588128764554  -0.04  905412  937516  -3.42    0    0    nan 
   coq-stdlib  413.02  413.62  -0.15  1155595286279  1157648317479  -0.18  1473283284831  1474456469526  -0.08  598024  595900   0.36    0    0    nan 
     coq-core  107.75  107.31   0.41   297096260950   295851577573   0.42   458628879047   458390423206   0.05  320816  320908  -0.03    0    0    nan 
└──────────────┴───────────────────────┴─────────────────────────────────────┴─────────────────────────────────────┴───────────────────────┴─────────────────┘

Bench complete: all packages successfully installed.

view this post on Zulip Bench bot (Jun 29 2021 at 10:28):

Bench at https://gitlab.com/coq/coq/-/jobs/1385217599
Testing Put Permutation-related Proper instances at default priority.
On packages coq-bignums coq-hott coq-performance-tests-lite coq-engine-bench-lite coq-mathcomp-ssreflect coq-mathcomp-fingroup coq-mathcomp-algebra coq-mathcomp-solvable coq-mathcomp-field coq-mathcomp-character coq-mathcomp-odd-order coq-math-classes coq-corn coq-flocq coq-compcert coq-geocoq coq-color coq-coqprime coq-coqutil coq-bedrock2 coq-rewriter coq-fiat-core coq-fiat-parsers coq-fiat-crypto coq-unimath coq-coquelicot coq-lambda-rust coq-verdi coq-verdi-raft coq-fourcolor coq-rewriter-perf-SuperFast coq-perennial coq-vst

┌─────────────────────────────┬─────────────────────────┬───────────────────────────────────────┬───────────────────────────────────────┬─────────────────────────┬─────────────────┐
                                   user time [s]                    CPU cycles                          CPU instructions              max resident mem [KB]     mem faults    
                                                                                                                                                                              
                package_name      NEW      OLD  PDIFF             NEW             OLD  PDIFF             NEW             OLD  PDIFF      NEW      OLD  PDIFF  NEW  OLD  PDIFF 
├─────────────────────────────┼─────────────────────────┼───────────────────────────────────────┼───────────────────────────────────────┼─────────────────────────┼─────────────────┤
        coq-mathcomp-algebra   140.94   141.68  -0.52    392239917267    393015974759  -0.20    511022835602    510954912888   0.01   554044   553888   0.03    0    0    nan 
  coq-performance-tests-lite  1551.45  1557.70  -0.40   4332630213034   4349810465686  -0.39   7128465143259   7127491806675   0.01  2079328  2079308   0.00    0    0    nan 
       coq-mathcomp-fingroup    48.15    48.34  -0.39    133373649234    133320336117   0.04    186295199764    186204403584   0.05   481976   482140  -0.03    0    0    nan 
      coq-mathcomp-ssreflect    53.74    53.90  -0.30    146817446003    146774256163   0.03    190182275428    190195514149  -0.01   526484   526340   0.03    0    0    nan 
             coq-lambda-rust  1264.33  1267.83  -0.28   3520615572792   3525061467512  -0.13   5074819874269   5070724072526   0.08  1096900  1097176  -0.03    0    0    nan 
          coq-mathcomp-field   222.36   222.71  -0.16    619181970168    619085598799   0.02    940093203469    940160919531  -0.01   668912   669032  -0.02    0    0    nan 
            coq-math-classes   174.15   174.40  -0.14    485569330598    486161339444  -0.12    644035970251    644058560738  -0.00   481180   481216  -0.01    0    0    nan 
 coq-rewriter-perf-SuperFast   736.19   736.92  -0.10   2050127610383   2052889424012  -0.13   3213490140086   3213144406644   0.01  1071772  1071876  -0.01    0    0    nan 
              coq-verdi-raft  1103.59  1104.66  -0.10   3074191696758   3075908129772  -0.06   4324217038436   4323314260005   0.02   902824   902924  -0.01    0    0    nan 
               coq-perennial  6827.90  6833.49  -0.08  19014520014315  19034167412217  -0.10  29076332425956  29108517064510  -0.11  3090156  3083744   0.21    0    0    nan 
                   coq-color   483.63   484.00  -0.08   1349904348669   1349280347437   0.05   1699938525429   1698671688454   0.07  1153636  1153096   0.05    0    0    nan 
                  coq-geocoq  1338.62  1339.22  -0.04   3734181575228   3733588712156   0.02   5469080630582   5468095829876   0.02   983232   983208   0.00    0    0    nan 
       coq-engine-bench-lite   312.36   312.46  -0.03    878535956791    880325270497  -0.20   1638103272001   1640233814117  -0.13  3506172  3506172   0.00    0    0    nan 
                coq-bedrock2   311.47   311.45   0.01    863466761284    861750558339   0.20   1506056371704   1505270054343   0.05   770936   770904   0.00    0    0    nan 
      coq-mathcomp-odd-order  1055.92  1055.16   0.07   2939487247644   2939954893227  -0.02   4665738825147   4665765833271  -0.00   937184   904084   3.66    0    0    nan 
             coq-fiat-crypto  4811.45  4807.75   0.08  13363684780579  13358119129984   0.04  23580205310055  23581364300475  -0.00  2222216  2220976   0.06    0    0    nan 
               coq-fourcolor  2552.45  2550.33   0.08   7116217107425   7111183636680   0.07  12238355624896  12239334618618  -0.01   730996   731044  -0.01    0    0    nan 
            coq-fiat-parsers   582.90   582.37   0.09   1629672699739   1629880592876  -0.01   2496502486638   2495925911528   0.02  3475488  3475228   0.01    0    0    nan 
                 coq-unimath  4264.62  4260.49   0.10  11867773151466  11858126136582   0.08  22673272276722  22682841952324  -0.04  3262980  3283732  -0.63    0    0    nan 
                   coq-flocq   146.62   146.47   0.10    407196163729    407100306206   0.02    504461522074    504481426499  -0.00   808248   808192   0.01    0    0    nan 
       coq-mathcomp-solvable   170.06   169.82   0.14    472860766842    472849287046   0.00    668244423688    668243790946   0.00   695164   673100   3.28    0    0    nan 
                coq-coqprime   328.79   328.25   0.16    912988350314    912193798471   0.09   1595681779818   1594856157124   0.05   920168   919580   0.06    0    0    nan 
                  coq-stdlib   414.64   413.95   0.17   1159135951778   1157614954000   0.13   1474138004791   1474297716252  -0.01   594776   594736   0.01    0    0    nan 
      coq-mathcomp-character   150.44   150.17   0.18    417833740890    417660331084   0.04    584828154493    584847235642  -0.00   720076   719740   0.05    0    0    nan 
                 coq-coqutil    59.16    58.90   0.44    163496087273    163059291639   0.27    214626322176    214095656974   0.25   602368   602324   0.01    0    0    nan 
                    coq-corn  1474.42  1467.54   0.47   4102483814176   4095019684891   0.18   5898293017766   5896198611784   0.04   813112   812792   0.04    0    0    nan 
                    coq-hott   280.84   279.42   0.51    770910833390    770191522736   0.09   1191651103858   1191541122388   0.01   569552   569620  -0.01    0    0    nan 
                coq-rewriter   671.40   667.78   0.54   1862854346695   1853886314641   0.48   2845911868453   2843710472706   0.08  1071940  1071976  -0.00    0    0    nan 
               coq-fiat-core   108.80   107.82   0.91    306015715224    304984887983   0.34    413832141355    412397963779   0.35   480968   480944   0.00    0    0    nan 
                   coq-verdi    99.42    98.42   1.02    273319878028    270473642581   1.05    379911286846    378835443319   0.28   543868   544060  -0.04    0    0    nan 
                 coq-bignums    55.90    55.30   1.08    153987715226    153372622287   0.40    206382243015    206405184548  -0.01   464348   464244   0.02    0    0    nan 
                    coq-core   107.15   105.91   1.17    296291937132    295799807704   0.17    458037038455    458119879183  -0.02   286044   286028   0.01    0    0    nan 
              coq-coquelicot    69.10    68.29   1.19    187771735232    186473222356   0.70    240000393046    239020192823   0.41   558356   557688   0.12    0    0    nan 
└─────────────────────────────┴─────────────────────────┴───────────────────────────────────────┴───────────────────────────────────────┴─────────────────────────┴─────────────────┘

Bench complete, failed to install packages:
coq-compcert
coq-vst

view this post on Zulip Bench bot (Jun 30 2021 at 13:54):

Bench at https://gitlab.com/coq/coq/-/jobs/1389239420
Testing Recompute relevance in intro tactic
On packages coq-bignums coq-hott coq-performance-tests-lite coq-engine-bench-lite coq-mathcomp-ssreflect coq-mathcomp-fingroup coq-mathcomp-algebra coq-mathcomp-solvable coq-mathcomp-field coq-mathcomp-character coq-mathcomp-odd-order coq-math-classes coq-corn coq-flocq coq-compcert coq-geocoq coq-color coq-coqprime coq-coqutil coq-bedrock2 coq-rewriter coq-fiat-core coq-fiat-parsers coq-fiat-crypto coq-unimath coq-coquelicot coq-lambda-rust coq-verdi coq-verdi-raft coq-fourcolor coq-rewriter-perf-SuperFast coq-perennial coq-vst

┌─────────────────────────────┬─────────────────────────┬───────────────────────────────────────┬───────────────────────────────────────┬─────────────────────────┬─────────────────┐
                                   user time [s]                    CPU cycles                          CPU instructions              max resident mem [KB]     mem faults    
                                                                                                                                                                              
                package_name      NEW      OLD  PDIFF             NEW             OLD  PDIFF             NEW             OLD  PDIFF      NEW      OLD  PDIFF  NEW  OLD  PDIFF 
├─────────────────────────────┼─────────────────────────┼───────────────────────────────────────┼───────────────────────────────────────┼─────────────────────────┼─────────────────┤
               coq-fourcolor  2535.56  2550.56  -0.59   7066030128909   7110523555621  -0.63  12242330663480  12240616372323   0.01   731932   732152  -0.03    0    0    nan 
               coq-perennial  6811.95  6836.75  -0.36  18974470230149  19042902511680  -0.36  29083462815994  29105780866230  -0.08  3080512  3085532  -0.16    0    0    nan 
                  coq-geocoq  1331.79  1334.92  -0.23   3712680526884   3718190186982  -0.15   5470081763343   5467523726718   0.05   988736   986304   0.25    0    0    nan 
          coq-mathcomp-field   220.80   221.27  -0.21    615374363152    615666923710  -0.05    940372172781    940327698355   0.00   670296   667220   0.46    0    0    nan 
                   coq-flocq   146.95   147.24  -0.20    407317054625    407822008036  -0.12    505105629632    504613296751   0.10   810664   810520   0.02    0    0    nan 
                    coq-corn  1471.60  1473.49  -0.13   4093412371363   4098331840872  -0.12   5897099360203   5895678084394   0.02   813088   813008   0.01    0    0    nan 
                coq-coqprime   326.96   327.21  -0.08    906924465176    907885471652  -0.11   1595858060782   1594926057716   0.06   914300   919976  -0.62    0    0    nan 
            coq-fiat-parsers   583.11   583.55  -0.08   1630640149997   1631786096706  -0.07   2497276418389   2495786140533   0.06  3485384  3485316   0.00    0    0    nan 
            coq-math-classes   173.99   174.12  -0.07    485248317829    486592231039  -0.28    644126613568    644067668296   0.01   481448   481256   0.04    0    0    nan 
                 coq-coqutil    58.60    58.64  -0.07    163003763954    162362567070   0.39    214767633754    214186301854   0.27   601400   600676   0.12    0    0    nan 
 coq-rewriter-perf-SuperFast   736.09   736.55  -0.06   2047990390650   2049660863228  -0.08   3214222839228   3213855196540   0.01  1073892  1074128  -0.02    0    0    nan 
             coq-fiat-crypto  4805.60  4807.96  -0.05  13349571211722  13347430602329   0.02  23602782658777  23579659649379   0.10  2234996  2237048  -0.09    0    0    nan 
       coq-mathcomp-fingroup    47.88    47.90  -0.04    132744767662    132705419941   0.03    186217345687    186198288628   0.01   481520   482452  -0.19    0    0    nan 
      coq-mathcomp-character   149.31   149.33  -0.01    415302840060    415626258425  -0.08    584880628223    584878448976   0.00   719764   731964  -1.67    0    0    nan 
                coq-rewriter   667.55   667.55   0.00   1852970179212   1852746703681   0.01   2847842767250   2843211885737   0.16  1073908  1074288  -0.04    0    0    nan 
        coq-mathcomp-algebra   140.89   140.87   0.01    391386837526    391411421380  -0.01    510983342168    510889590465   0.02   554308   554108   0.04    0    0    nan 
  coq-performance-tests-lite  1553.22  1552.80   0.03   4333627902645   4335054288763  -0.03   7130632932371   7126213625068   0.06  2084988  2085040  -0.00    0    0    nan 
              coq-coquelicot    68.78    68.76   0.03    187120963562    187012192059   0.06    240224625371    239107946126   0.47   557544   557664  -0.02    0    0    nan 
                 coq-unimath  4260.97  4258.70   0.05  11858995858229  11848455426364   0.09  22692887711742  22677276758701   0.07  3285296  3284076   0.04    0    0    nan 
             coq-lambda-rust  1262.83  1262.12   0.06   3511957114978   3512871624104  -0.03   5074181043244   5066235449448   0.16  1099332  1099944  -0.06    0    0    nan 
                   coq-color   484.15   483.86   0.06   1351025458916   1350298660182   0.05   1700719490833   1698474333176   0.13  1098816  1154072  -4.79    0    0    nan 
       coq-engine-bench-lite   312.75   312.44   0.10    880304107975    878753650880   0.18   1639189523881   1640640066041  -0.09  3505888  3505956  -0.00    0    0    nan 
                coq-bedrock2   311.31   310.93   0.12    862313477836    861772789637   0.06   1506581465571   1507161380150  -0.04   800016   799992   0.00    0    0    nan 
               coq-fiat-core   108.52   108.36   0.15    306493665433    305879467165   0.20    414142935714    412498771239   0.40   480308   480916  -0.13    0    0    nan 
       coq-mathcomp-solvable   169.32   169.06   0.15    470699084635    470548511513   0.03    668349525387    668309468107   0.01   696152   696008   0.02    0    0    nan 
                    coq-hott   280.00   279.55   0.16    769116410179    768345225229   0.10   1191527003454   1191288255076   0.02   569660   569768  -0.02    0    0    nan 
              coq-verdi-raft  1098.92  1096.94   0.18   3060085663449   3055444718039   0.15   4328292720995   4324039417874   0.10   902736   902880  -0.02    0    0    nan 
      coq-mathcomp-odd-order  1048.29  1046.38   0.18   2919050844125   2916634929426   0.08   4665339051076   4665141274125   0.00   901860   904828  -0.33    0    0    nan 
                  coq-stdlib   414.27   413.20   0.26   1156830967661   1156768876899   0.01   1474785581191   1474124675433   0.04   600780   594704   1.02    0    0    nan 
                   coq-verdi    98.48    98.19   0.30    270587666777    269897731644   0.26    380332622031    378977745428   0.36   545856   544076   0.33    0    0    nan 
                 coq-bignums    55.59    55.31   0.51    153833468432    153426099324   0.27    206565073397    206460997587   0.05   464180   464140   0.01    0    0    nan 
      coq-mathcomp-ssreflect    54.06    53.59   0.88    146973466601    146344920255   0.43    190083928382    190018352635   0.03   525508   525840  -0.06    0    0    nan 
                    coq-core   107.58   105.79   1.69    296418515895    295977242735   0.15    458325609435    458442278600  -0.03   286080   286056   0.01    0    0    nan 
└─────────────────────────────┴─────────────────────────┴───────────────────────────────────────┴───────────────────────────────────────┴─────────────────────────┴─────────────────┘

Bench complete, failed to install packages:
coq-compcert
coq-vst

view this post on Zulip Bench bot (Jul 06 2021 at 13:43):

Bench at https://gitlab.com/coq/coq/-/jobs/1402628659
Testing [lia] Add Strategy to speed-up conversion
On packages coq-bignums coq-hott coq-performance-tests-lite coq-engine-bench-lite coq-mathcomp-ssreflect coq-mathcomp-fingroup coq-mathcomp-algebra coq-mathcomp-solvable coq-mathcomp-field coq-mathcomp-character coq-mathcomp-odd-order coq-math-classes coq-corn coq-flocq coq-compcert coq-geocoq coq-color coq-coqprime coq-coqutil coq-bedrock2 coq-rewriter coq-fiat-core coq-fiat-parsers coq-fiat-crypto coq-unimath coq-coquelicot coq-lambda-rust coq-verdi coq-verdi-raft coq-fourcolor coq-rewriter-perf-SuperFast coq-perennial coq-vst

┌────────────────────────────┬─────────────────────────┬─────────────────────────────────────┬─────────────────────────────────────┬─────────────────────────┬─────────────────┐
                                  user time [s]                   CPU cycles                        CPU instructions             max resident mem [KB]     mem faults    
                                                                                                                                                                         
               package_name      NEW      OLD  PDIFF            NEW            OLD  PDIFF            NEW            OLD  PDIFF      NEW      OLD  PDIFF  NEW  OLD  PDIFF 
├────────────────────────────┼─────────────────────────┼─────────────────────────────────────┼─────────────────────────────────────┼─────────────────────────┼─────────────────┤
               coq-bedrock2   308.34   310.20  -0.60   855576712890   859419220878  -0.45  1506782086771  1507541091066  -0.05   769560   771340  -0.23    0    0    nan 
              coq-fiat-core   107.95   108.29  -0.31   306242784375   305529163902   0.23   414216319833   412722840355   0.36   480788   481156  -0.08    0    0    nan 
                  coq-flocq   146.15   146.54  -0.27   405759420671   406139656690  -0.09   504111285315   504780780625  -0.13   809956   810484  -0.07    0    0    nan 
     coq-mathcomp-character   149.42   149.78  -0.24   415452269469   415766044725  -0.08   585121716210   585119831667   0.00   720344   731964  -1.59    0    0    nan 
      coq-mathcomp-solvable   168.73   169.07  -0.20   470021634619   470576465971  -0.12   668581661856   668616791459  -0.01   673936   673816   0.02    0    0    nan 
                 coq-stdlib   413.14   413.76  -0.15  1155312239085  1157459095183  -0.19  1473816625778  1474128707730  -0.02   594844   594756   0.01    0    0    nan 
 coq-performance-tests-lite  1555.98  1558.04  -0.13  4341919144399  4346400868322  -0.10  7129489216785  7125628030921   0.05  2084816  2084900  -0.00    0    0    nan 
       coq-mathcomp-algebra   140.70   140.82  -0.09   391591163278   391127872846   0.12   511199782024   511187091860   0.00   554132   554096   0.01    0    0    nan 
                 coq-geocoq  1330.37  1331.21  -0.06  3708189079038  3710789046802  -0.07  5470097737138  5468088426407   0.04   987260   980928   0.65    0    0    nan 
           coq-fiat-parsers   582.49   582.71  -0.04  1630900862945  1629315658488   0.10  2496767104825  2496050186477   0.03  3485588  3485500   0.00    0    0    nan 
           coq-math-classes   174.29   174.31  -0.01   486719285087   486677837313   0.01   644318424176   644273210528   0.01   481568   481276   0.06    0    0    nan 
     coq-mathcomp-odd-order  1048.50  1048.38   0.01  2920107524104  2920889423477  -0.03  4665141461592  4665191559188  -0.00   904152   904148   0.00    0    0    nan 
               coq-rewriter   667.07   666.91   0.02  1851237326396  1849612186774   0.09  2845937741250  2843620610820   0.08  1074332  1074288   0.00    0    0    nan 
         coq-mathcomp-field   220.76   220.66   0.05   614613605189   614516665432   0.02   940571275345   940647547529  -0.01   667540   667232   0.05    0    0    nan 
                coq-bignums    55.34    55.30   0.07   153417602895   153263893085   0.10   206598238358   206719994830  -0.06   463896   464112  -0.05    0    0    nan 
                   coq-corn  1472.63  1470.72   0.13  4101611976132  4093924438219   0.19  5902929061566  5896000720017   0.12   813036   812944   0.01    0    0    nan 
                   coq-hott   280.05   279.59   0.16   770232378635   769416855570   0.11  1191584346282  1191511855438   0.01   569660   569580   0.01    0    0    nan 
      coq-engine-bench-lite   312.26   311.33   0.30   878301363228   876258920561   0.23  1640429802585  1639658265268   0.05  3506052  3506212  -0.00    0    0    nan 
      coq-mathcomp-fingroup    47.86    47.66   0.42   133012555292   132711767588   0.23   186466865727   186483463539  -0.01   482372   482088   0.06    0    0    nan 
                coq-coqutil    58.79    58.53   0.44   163171960937   162204255323   0.60   214802436949   214436847784   0.17   599580   600620  -0.17    0    0    nan 
                  coq-color   483.95   481.55   0.50  1351293344432  1346260368996   0.37  1700228265292  1698721335382   0.09  1156440  1155324   0.10    0    0    nan 
     coq-mathcomp-ssreflect    53.70    53.38   0.60   146703194900   146288732756   0.28   190298658664   190274630748   0.01   525916   525976  -0.01    0    0    nan 
                   coq-core   107.23   106.25   0.92   296883375741   295706582306   0.40   458547376811   458412152419   0.03   288996   289084  -0.03    0    0    nan 
               coq-coqprime   333.47   325.76   2.37   925721644973   904396786885   2.36  1595936421683  1595170684251   0.05   920608   919204   0.15    0    0    nan 
└────────────────────────────┴─────────────────────────┴─────────────────────────────────────┴─────────────────────────────────────┴─────────────────────────┴─────────────────┘

Benching continues...

view this post on Zulip Bench bot (Jul 06 2021 at 23:19):

Bench at https://gitlab.com/coq/coq/-/jobs/1404094588
Testing [lia] Add Strategy to speed-up conversion
On packages coq-bignums coq-hott coq-performance-tests-lite coq-engine-bench-lite coq-mathcomp-ssreflect coq-mathcomp-fingroup coq-mathcomp-algebra coq-mathcomp-solvable coq-mathcomp-field coq-mathcomp-character coq-mathcomp-odd-order coq-math-classes coq-corn coq-flocq coq-compcert coq-geocoq coq-color coq-coqprime coq-coqutil coq-bedrock2 coq-rewriter coq-fiat-core coq-fiat-parsers coq-fiat-crypto coq-unimath coq-coquelicot coq-lambda-rust coq-verdi coq-verdi-raft coq-fourcolor coq-rewriter-perf-SuperFast coq-perennial coq-vst

┌─────────────────────────────┬─────────────────────────┬───────────────────────────────────────┬───────────────────────────────────────┬─────────────────────────┬─────────────────┐
                                   user time [s]                    CPU cycles                          CPU instructions              max resident mem [KB]     mem faults    
                                                                                                                                                                              
                package_name      NEW      OLD  PDIFF             NEW             OLD  PDIFF             NEW             OLD  PDIFF      NEW      OLD  PDIFF  NEW  OLD  PDIFF 
├─────────────────────────────┼─────────────────────────┼───────────────────────────────────────┼───────────────────────────────────────┼─────────────────────────┼─────────────────┤
                  coq-stdlib   412.74   414.62  -0.45   1155258166616   1159201093096  -0.34   1473631123419   1474261785528  -0.04   594772   594732   0.01    0    0    nan 
                 coq-bignums    55.52    55.74  -0.39    153641435643    153952388131  -0.20    206509023844    206732660553  -0.11   464372   464056   0.07    0    0    nan 
       coq-mathcomp-fingroup    47.84    47.95  -0.23    133086068875    132686148173   0.30    186450228379    186460994425  -0.01   482432   481756   0.14    0    0    nan 
               coq-fourcolor  2542.97  2546.78  -0.15   7089740541853   7098108240397  -0.12  12242560263661  12240948157741   0.01   732148   731904   0.03    0    0    nan 
                coq-coqprime   325.77   326.18  -0.13    904883032607    905847185372  -0.11   1595910201284   1595200069285   0.04   919636   919452   0.02    0    0    nan 
  coq-performance-tests-lite  1554.53  1555.65  -0.07   4337486548020   4339864862296  -0.05   7125536143273   7127231296559  -0.02  2085048  2085016   0.00    0    0    nan 
                coq-bedrock2   309.74   309.86  -0.04    858956202346    858645486989   0.04   1506953492041   1505921682964   0.07   799836   771352   3.69    0    0    nan 
        coq-mathcomp-algebra   141.05   141.07  -0.01    391777247855    391293561658   0.12    511135531050    511150034022  -0.00   554288   554132   0.03    0    0    nan 
 coq-rewriter-perf-SuperFast   737.86   737.94  -0.01   2054240691526   2053382655277   0.04   3213630561819   3214010250395  -0.01  1074044  1074092  -0.00    0    0    nan 
                    coq-corn  1471.96  1471.88   0.01   4097017288539   4095441761709   0.04   5896386047437   5896043354595   0.01   813140   812996   0.02    0    0    nan 
      coq-mathcomp-odd-order  1048.68  1048.55   0.01   2922456456666   2921017282359   0.05   4665029641490   4665472184931  -0.01   958644   904576   5.98    0    0    nan 
              coq-verdi-raft  1099.26  1099.10   0.01   3061857227946   3058954672425   0.09   4325348764137   4324553038361   0.02   902604   902860  -0.03    0    0    nan 
      coq-mathcomp-character   149.55   149.50   0.03    415855820914    415538108265   0.08    585134145915    585137191546  -0.00   731860   731860   0.00    0    0    nan 
            coq-fiat-parsers   583.48   583.24   0.04   1631816856728   1632095079448  -0.02   2496745277971   2496485572040   0.01  3485460  3485580  -0.00    0    0    nan 
                 coq-unimath  4292.12  4289.92   0.05  11944101493846  11939158234706   0.04  22925609591814  22910674544674   0.07  3277808  3266924   0.33    0    0    nan 
             coq-lambda-rust  1260.86  1260.20   0.05   3507854495466   3505591195826   0.06   5063194755298   5064649892305  -0.03  1075540  1099888  -2.21    0    0    nan 
                  coq-geocoq  1331.63  1330.88   0.06   3709604590573   3709919355354  -0.01   5469006076667   5468116670865   0.02   986648   980868   0.59    0    0    nan 
             coq-fiat-crypto  4820.97  4815.85   0.11  13388259387217  13373653950072   0.11  23609771170800  23624925969093  -0.06  2216712  2225988  -0.42    0    0    nan 
      coq-mathcomp-ssreflect    53.84    53.75   0.17    146622634083    146853652012  -0.16    190342331557    190302079058   0.02   525748   525936  -0.04    0    0    nan 
          coq-mathcomp-field   220.83   220.40   0.20    614883464023    614471484335   0.07    940624956711    940588897208   0.00   667748   667604   0.02    0    0    nan 
       coq-engine-bench-lite   312.45   311.83   0.20    879374127652    878431195788   0.11   1652031216077   1641733525304   0.63  3506464  3505996   0.01    0    0    nan 
       coq-mathcomp-solvable   169.24   168.87   0.22    470540601337    469891289545   0.14    668642761956    668584878953   0.01   673888   695568  -3.12    0    0    nan 
               coq-perennial  6812.46  6796.79   0.23  18974362892834  18933022957144   0.22  29096549601329  29095507809156   0.00  3079612  3124368  -1.43    0    0    nan 
                coq-rewriter   668.00   666.15   0.28   1854260647361   1848860769305   0.29   2845620099244   2843766956911   0.07  1074288  1074288   0.00    0    0    nan 
                   coq-flocq   146.80   146.39   0.28    406913810501    405878248590   0.26    504145952538    504825108805  -0.13   810444   810592  -0.02    0    0    nan 
                   coq-color   484.60   483.10   0.31   1350737805126   1347917526329   0.21   1699918374463   1698708388145   0.07  1154384  1154264   0.01    0    0    nan 
               coq-fiat-core   109.12   108.61   0.47    307209355438    306150126199   0.35    414176357555    412742536504   0.35   480824   480992  -0.03    0    0    nan 
            coq-math-classes   174.52   173.70   0.47    486978855550    485651098172   0.27    644287527428    644274358152   0.00   481344   481328   0.00    0    0    nan 
                 coq-coqutil    58.68    58.39   0.50    162618159077    162411513809   0.13    214831202358    214448954430   0.18   599448   600780  -0.22    0    0    nan 
                   coq-verdi    98.40    97.90   0.51    270108697559    269122641326   0.37    380264188714    379232383780   0.27   544116   544052   0.01    0    0    nan 
                    coq-hott   280.28   278.77   0.54    772048886512    769751373696   0.30   1193574181829   1193581648160  -0.00   569424   569460  -0.01    0    0    nan 
                    coq-core   107.13   106.30   0.78    296438561009    296092422573   0.12    458703091100    458821985941  -0.03   289112   289024   0.03    0    0    nan 
              coq-coquelicot    68.85    67.66   1.76    187672360440    186317661498   0.73    240315691599    239437953909   0.37   557700   557660   0.01    0    0    nan 
└─────────────────────────────┴─────────────────────────┴───────────────────────────────────────┴───────────────────────────────────────┴─────────────────────────┴─────────────────┘

Bench complete, failed to install packages:
coq-compcert
coq-vst

view this post on Zulip Bench bot (Jul 07 2021 at 17:56):

Bench at https://gitlab.com/coq/coq/-/jobs/1405739802
Testing [Pretyping] Trigger CS search during pretyping of lambdas and applications
On packages coq-bignums coq-hott coq-performance-tests-lite coq-engine-bench-lite coq-mathcomp-ssreflect coq-mathcomp-fingroup coq-mathcomp-algebra coq-mathcomp-solvable coq-mathcomp-field coq-mathcomp-character coq-mathcomp-odd-order coq-math-classes coq-corn coq-flocq coq-compcert coq-geocoq coq-color coq-coqprime coq-coqutil coq-bedrock2 coq-rewriter coq-fiat-core coq-fiat-parsers coq-fiat-crypto coq-unimath coq-coquelicot coq-lambda-rust coq-verdi coq-verdi-raft coq-fourcolor coq-rewriter-perf-SuperFast coq-perennial coq-vst

┌─────────────────────────────┬─────────────────────────┬───────────────────────────────────────┬───────────────────────────────────────┬─────────────────────────┬─────────────────┐
                                   user time [s]                    CPU cycles                          CPU instructions              max resident mem [KB]     mem faults    
                                                                                                                                                                              
                package_name      NEW      OLD  PDIFF             NEW             OLD  PDIFF             NEW             OLD  PDIFF      NEW      OLD  PDIFF  NEW  OLD  PDIFF 
├─────────────────────────────┼─────────────────────────┼───────────────────────────────────────┼───────────────────────────────────────┼─────────────────────────┼─────────────────┤
       coq-mathcomp-fingroup    48.04    48.23  -0.39    133497721310    133431164240   0.05    186693960436    186690779470   0.00   483040   482920   0.02    0    0    nan 
               coq-fiat-core   107.74   108.06  -0.30    305443817548    305399707961   0.01    411836949525    411807639855   0.01   480560   480644  -0.02    0    0    nan 
            coq-math-classes   174.12   174.60  -0.27    485627121549    485983628204  -0.07    643276668161    643270692403   0.00   481276   481248   0.01    0    0    nan 
                coq-coqprime   330.58   331.48  -0.27    917833135910    919411894700  -0.17   1594747863219   1595068443776  -0.02   917212   917248  -0.00    0    0    nan 
                coq-rewriter   669.15   669.98  -0.12   1856335364534   1860527885351  -0.23   2842346450731   2842496344468  -0.01  1074236  1074452  -0.02    0    0    nan 
            coq-fiat-parsers   582.21   582.42  -0.04   1630606886166   1629647238565   0.06   2493274054110   2492881804685   0.02  3485496  3485476   0.00    0    0    nan 
                coq-bedrock2   312.10   312.14  -0.01    865474291146    865483373731  -0.00   1506725270573   1506692189846   0.00   799936   771140   3.73    0    0    nan 
      coq-mathcomp-ssreflect    54.08    54.08   0.00    147343948825    147128160773   0.15    191076965130    191087115331  -0.01   525412   525404   0.00    0    0    nan 
                 coq-coqutil    59.00    59.00   0.00    163372936615    163956951804  -0.36    214321611822    214290982086   0.01   599336   599444  -0.02    0    0    nan 
               coq-fourcolor  2550.32  2549.47   0.03   7108433234974   7106936529618   0.02  12242972630462  12242755650851   0.00   796468   796468   0.00    0    0    nan 
              coq-verdi-raft  1101.64  1101.17   0.04   3067315138363   3065800863530   0.05   4308518563468   4308564913534  -0.00   904004   903904   0.01    0    0    nan 
          coq-mathcomp-field   221.77   221.66   0.05    618032035939    617088472197   0.15    940581801473    940696472455  -0.01   669104   668488   0.09    0    0    nan 
                   coq-verdi    98.40    98.34   0.06    271044897163    270946818563   0.04    378734406425    378763287880  -0.01   542332   542112   0.04    0    0    nan 
       coq-engine-bench-lite   313.12   312.92   0.06    881107294390    880151827959   0.11   1642695590480   1642460921297   0.01  3506272  3506368  -0.00    0    0    nan 
                 coq-unimath  4311.50  4308.73   0.06  12000047052983  11987181162197   0.11  22895851029848  22893068876038   0.01  3711048  3711300  -0.01    0    0    nan 
                 coq-bignums    55.63    55.59   0.07    154280811977    153676983691   0.39    206755246691    206726751233   0.01   463172   463096   0.02    0    0    nan 
 coq-rewriter-perf-SuperFast   738.96   738.34   0.08   2056968885850   2054177210800   0.14   3212157001701   3211497988790   0.02  1074080  1074148  -0.01    0    0    nan 
       coq-mathcomp-solvable   170.27   170.00   0.16    473246124272    472195175170   0.22    669478852705    669587359982  -0.02   679592   695952  -2.35    0    0    nan 
             coq-fiat-crypto  4831.21  4823.46   0.16  13420878375772  13399865800834   0.16  23631936360323  23623150991948   0.04  2220360  2226652  -0.28    0    0    nan 
             coq-lambda-rust  1269.30  1267.16   0.17   3532519914543   3524838810778   0.22   5066105093300   5067394885749  -0.03  1099360  1099480  -0.01    0    0    nan 
      coq-mathcomp-character   150.48   150.18   0.20    417921553142    417091911196   0.20    585390285584    585406235439  -0.00   721272   731800  -1.44    0    0    nan 
                  coq-stdlib   414.71   413.86   0.21   1159048262462   1157154711311   0.16   1473210978191   1473279722305  -0.00   600700   600608   0.02    0    0    nan 
  coq-performance-tests-lite  1560.46  1556.49   0.26   4350008924745   4342468917356   0.17   7127303297112   7125418329046   0.03  2085064  2084880   0.01    0    0    nan 
        coq-mathcomp-algebra   141.17   140.74   0.31    392797963715    391753379869   0.27    511315004692    511329269515  -0.00   553972   554068  -0.02    0    0    nan 
      coq-mathcomp-odd-order  1059.41  1056.12   0.31   2950709320773   2940296475181   0.35   4664922672478   4664608266142   0.01   903828   958664  -5.72    0    0    nan 
               coq-perennial  6852.55  6830.51   0.32  19090715558410  19027679192568   0.33  29045097661735  29059558129383  -0.05  3091600  3115644  -0.77    0    0    nan 
                    coq-core   107.16   106.81   0.33    296914560086    296631667442   0.10    458894567692    458937057991  -0.01   309836   309832   0.00    0    0    nan 
                    coq-corn  1472.58  1467.59   0.34   4099260562261   4092359759714   0.17   5883815226881   5884214216252  -0.01   799432   799616  -0.02    0    0    nan 
                  coq-geocoq  1332.68  1327.91   0.36   3713218377761   3703819717345   0.25   5437155017101   5437612458031  -0.01   987384   987180   0.02    0    0    nan 
                   coq-color   484.88   483.01   0.39   1349762260052   1347483322901   0.17   1696168837727   1696063168203   0.01  1151328  1103528   4.33    0    0    nan 
                    coq-hott   281.55   280.10   0.52    776157481466    774021526768   0.28   1193082984022   1193071219892   0.00   569532   569700  -0.03    0    0    nan 
└─────────────────────────────┴─────────────────────────┴───────────────────────────────────────┴───────────────────────────────────────┴─────────────────────────┴─────────────────┘

Bench complete, failed to install packages:
coq-compcert
coq-coquelicot
coq-flocq
coq-vst

view this post on Zulip Bench bot (Jul 08 2021 at 12:31):

Bench at https://gitlab.com/coq/coq/-/jobs/1403279334
Testing Check that convertible occurrences of a term are of the same type
On packages coq-bignums coq-hott coq-performance-tests-lite coq-engine-bench-lite coq-mathcomp-ssreflect coq-mathcomp-fingroup coq-mathcomp-algebra coq-mathcomp-solvable coq-mathcomp-field coq-mathcomp-character coq-mathcomp-odd-order coq-math-classes coq-corn coq-flocq coq-compcert coq-geocoq coq-color coq-coqprime coq-coqutil coq-bedrock2 coq-rewriter coq-fiat-core coq-fiat-parsers coq-fiat-crypto coq-unimath coq-coquelicot coq-lambda-rust coq-verdi coq-verdi-raft coq-fourcolor coq-rewriter-perf-SuperFast coq-perennial coq-vst

┌─────────────────────────────┬─────────────────────────┬───────────────────────────────────────┬───────────────────────────────────────┬─────────────────────────┬─────────────────┐
                                   user time [s]                    CPU cycles                          CPU instructions              max resident mem [KB]     mem faults    
                                                                                                                                                                              
                package_name      NEW      OLD  PDIFF             NEW             OLD  PDIFF             NEW             OLD  PDIFF      NEW      OLD  PDIFF  NEW  OLD  PDIFF 
├─────────────────────────────┼─────────────────────────┼───────────────────────────────────────┼───────────────────────────────────────┼─────────────────────────┼─────────────────┤
      coq-mathcomp-ssreflect    53.60    53.84  -0.45    147246317651    146833811295   0.28    191104443431    191107186889  -0.00   526684   526904  -0.04    0    0    nan 
  coq-performance-tests-lite  1552.98  1556.74  -0.24   4332063942161   4343619013715  -0.27   7128998158961   7125905291726   0.04  2084952  2085020  -0.00    0    0    nan 
                   coq-color   483.62   484.30  -0.14   1349693110902   1349345257766   0.03   1700170043206   1699149033330   0.06  1153952  1155372  -0.12    0    0    nan 
            coq-fiat-parsers   581.81   582.58  -0.13   1628106231807   1629189839801  -0.07   2496860982434   2496298910614   0.02  3485396  3485500  -0.00    0    0    nan 
             coq-fiat-crypto  4806.54  4812.61  -0.13  13339558057268  13369022069336  -0.22  23621685942286  23627694618214  -0.03  2228032  2216212   0.53    0    0    nan 
                   coq-flocq   146.25   146.42  -0.12    406308086781    406140088747   0.04    504983502870    504932530428   0.01   810580   810580   0.00    0    0    nan 
                coq-rewriter   666.47   666.88  -0.06   1849309969901   1851011502443  -0.09   2846051343212   2843846008207   0.08  1074172  1074136   0.00    0    0    nan 
              coq-verdi-raft  1099.08  1099.64  -0.05   3060239638549   3062416547630  -0.07   4325345250986   4324526529098   0.02   902668   902956  -0.03    0    0    nan 
                  coq-stdlib   413.51   413.58  -0.02   1156913376958   1156432875433   0.04   1474404967837   1474472030562  -0.00   594744   594784  -0.01    0    0    nan 
                    coq-hott   281.42   281.46  -0.01    773698844318    771580760259   0.27   1193747954599   1193797842555  -0.00   569476   569480  -0.00    0    0    nan 
                    coq-corn  1471.01  1470.01   0.07   4096593757631   4094497897602   0.05   5896166580765   5896053715228   0.00   812840   812972  -0.02    0    0    nan 
 coq-rewriter-perf-SuperFast   736.41   735.75   0.09   2051654349275   2048907817316   0.13   3214182688274   3214185566215  -0.00  1073968  1073976  -0.00    0    0    nan 
            coq-math-classes   174.92   174.66   0.15    487487257689    486351848180   0.23    644403978049    644450121289  -0.01   481388   481364   0.00    0    0    nan 
               coq-fourcolor  2545.92  2541.54   0.17   7096921260234   7083337604167   0.19  12242384064442  12240854598222   0.01   731944   731904   0.01    0    0    nan 
      coq-mathcomp-character   150.04   149.69   0.23    417230327963    416228014796   0.24    585387454520    585360751928   0.00   732048   732036   0.00    0    0    nan 
             coq-lambda-rust  1263.17  1259.46   0.29   3514426451218   3503730558898   0.31   5062223020913   5064145437265  -0.04  1075604  1099828  -2.20    0    0    nan 
        coq-mathcomp-algebra   141.35   140.93   0.30    392947596090    391389846085   0.40    511412726380    511472022685  -0.01   553688   553548   0.03    0    0    nan 
               coq-perennial  6831.36  6810.27   0.31  19029953438691  18963806951060   0.35  29106617674073  29103223461355   0.01  3126764  3085680   1.33    0    0    nan 
                 coq-coqutil    58.88    58.68   0.34    163192676598    163180534427   0.01    215079997694    214583661920   0.23   601256   600740   0.09    0    0    nan 
                 coq-unimath  4302.69  4287.72   0.35  11971350389103  11931342502801   0.34  22915134816977  22900661674207   0.06  3266716  3266644   0.00    0    0    nan 
      coq-mathcomp-odd-order  1051.20  1047.50   0.35   2928161934000   2917812227151   0.35   4665473906905   4665504040731  -0.00   904684   904540   0.02    0    0    nan 
                 coq-bignums    55.63    55.41   0.40    153466140371    153541086364  -0.05    206871206544    206848119552   0.01   464324   464136   0.04    0    0    nan 
               coq-fiat-core   108.84   108.40   0.41    306946091661    305726873622   0.40    414315488368    412874005570   0.35   480852   480996  -0.03    0    0    nan 
       coq-mathcomp-solvable   169.80   169.00   0.47    472330720553    470636989529   0.36    669487046908    669504318974  -0.00   673960   673972  -0.00    0    0    nan 
                coq-bedrock2   310.98   309.25   0.56    862409698880    858082385999   0.50   1508399188747   1507628239570   0.05   799896   800036  -0.02    0    0    nan 
                   coq-verdi    98.11    97.56   0.56    270164100285    268878806855   0.48    380423334412    379381415051   0.27   544080   544116  -0.01    0    0    nan 
       coq-mathcomp-fingroup    48.32    48.04   0.58    133515678319    133031282067   0.36    186671489122    186723591251  -0.03   481000   481576  -0.12    0    0    nan 
          coq-mathcomp-field   222.21   220.91   0.59    617702031482    614739404834   0.48    940570049067    940600830928  -0.00   667484   667956  -0.07    0    0    nan 
                  coq-geocoq  1338.70  1330.62   0.61   3729778125647   3708473983071   0.57   5469465470858   5468329299130   0.02   983708   981424   0.23    0    0    nan 
       coq-engine-bench-lite   313.08   311.12   0.63    880749621163    876267142608   0.51   1640376559496   1641073195353  -0.04  3505896  3506096  -0.01    0    0    nan 
              coq-coquelicot    68.97    68.38   0.86    187534207151    186528365933   0.54    240466566836    239519795035   0.40   557616   557652  -0.01    0    0    nan 
                coq-coqprime   329.49   326.63   0.88    915295913313    906900776549   0.93   1596294271261   1595336976220   0.06   919816   919056   0.08    0    0    nan 
                    coq-core   107.49   106.01   1.40    296576494616    295971679037   0.20    458709823265    458645491969   0.01   290904   290860   0.02    0    0    nan 
└─────────────────────────────┴─────────────────────────┴───────────────────────────────────────┴───────────────────────────────────────┴─────────────────────────┴─────────────────┘

Bench complete, failed to install packages:
coq-compcert
coq-vst

view this post on Zulip Bench bot (Jul 09 2021 at 07:10):

Bench at https://gitlab.com/coq/coq/-/jobs/1409623941
Testing Fast pretyping of application.
On packages coq-bignums coq-hott coq-performance-tests-lite coq-engine-bench-lite coq-mathcomp-ssreflect coq-mathcomp-fingroup coq-mathcomp-algebra coq-mathcomp-solvable coq-mathcomp-field coq-mathcomp-character coq-mathcomp-odd-order coq-math-classes coq-corn coq-flocq coq-compcert coq-geocoq coq-color coq-coqprime coq-coqutil coq-bedrock2 coq-rewriter coq-fiat-core coq-fiat-parsers coq-fiat-crypto coq-unimath coq-coquelicot coq-lambda-rust coq-verdi coq-verdi-raft coq-fourcolor coq-rewriter-perf-SuperFast coq-perennial coq-vst

┌─────────────────────────────┬─────────────────────────┬───────────────────────────────────────┬───────────────────────────────────────┬─────────────────────────┬─────────────────┐
                                   user time [s]                    CPU cycles                          CPU instructions              max resident mem [KB]     mem faults    
                                                                                                                                                                              
                package_name      NEW      OLD  PDIFF             NEW             OLD  PDIFF             NEW             OLD  PDIFF      NEW      OLD  PDIFF  NEW  OLD  PDIFF 
├─────────────────────────────┼─────────────────────────┼───────────────────────────────────────┼───────────────────────────────────────┼─────────────────────────┼─────────────────┤
                 coq-bignums    56.13    56.65  -0.92    154830462776    156309290605  -0.95    209084476908    209439071811  -0.17   465984   466208  -0.05    0    0    nan 
       coq-engine-bench-lite   312.51   315.13  -0.83    879065322904    887278150524  -0.93   1644711630540   1655980301800  -0.68  3506320  3506288   0.00    0    0    nan 
      coq-mathcomp-ssreflect    53.49    53.90  -0.76    146436202692    147095887275  -0.45    190175153487    191206370317  -0.54   525640   525272   0.07    0    0    nan 
            coq-math-classes   173.76   174.80  -0.59    484247307024    486505182991  -0.46    642763603643    644789784172  -0.31   481340   481164   0.04    0    0    nan 
  coq-performance-tests-lite  1579.08  1588.04  -0.56   4405546367359   4430031834722  -0.55   7333330162627   7339062397560  -0.08  2079152  2079268  -0.01    0    0    nan 
        coq-mathcomp-algebra   140.44   141.23  -0.56    390930039150    392430036563  -0.38    509549999009    511629060343  -0.41   555864   554324   0.28    0    0    nan 
                coq-coqprime   325.24   326.96  -0.53    904090525825    907811128259  -0.41   1596553140973   1596184368835   0.02   917204   915536   0.18    0    0    nan 
                   coq-flocq   146.32   146.99  -0.46    405619870872    406870300686  -0.31    504986147651    505654222723  -0.13   808492   808428   0.01    0    0    nan 
                    coq-corn  1467.64  1473.94  -0.43   4087636957901   4101611654920  -0.34   5887185859169   5902533509987  -0.26   791056   812848  -2.68    0    0    nan 
      coq-mathcomp-odd-order  1043.72  1048.10  -0.42   2907825777165   2919659899019  -0.41   4624968250873   4665993518285  -0.88   939564   939660  -0.01    0    0    nan 
                  coq-stdlib   412.98   414.62  -0.40   1154615047433   1158297805683  -0.32   1473605732387   1480327773553  -0.45   592756   595632  -0.48    0    0    nan 
               coq-perennial  6799.88  6826.81  -0.39  18939922236642  19019760056086  -0.42  29090447482771  29145989621757  -0.19  3074524  3077592  -0.10    0    0    nan 
      coq-mathcomp-character   149.86   150.42  -0.37    416371321805    417100723394  -0.17    583247777302    585502877167  -0.39   730380   730896  -0.07    0    0    nan 
 coq-rewriter-perf-SuperFast   736.88   739.49  -0.35   2051874741497   2058789169118  -0.34   3214809860844   3220468289788  -0.18  1071388  1071480  -0.01    0    0    nan 
            coq-fiat-parsers   587.24   589.08  -0.31   1641166423032   1647451202082  -0.38   2523718601603   2530292043185  -0.26  3076064  3076172  -0.00    0    0    nan 
             coq-lambda-rust  1259.88  1263.24  -0.27   3504746748023   3514303679718  -0.27   5068290371138   5071676721204  -0.07  1076744  1075392   0.13    0    0    nan 
       coq-mathcomp-solvable   169.28   169.66  -0.22    470996563567    471892290942  -0.19    665431680357    669729675531  -0.64   695716   672972   3.38    0    0    nan 
                   coq-color   483.36   484.44  -0.22   1348881567098   1351290566072  -0.18   1703136574726   1702617037607   0.03  1153148  1134856   1.61    0    0    nan 
             coq-fiat-crypto  4815.35  4824.88  -0.20  13377191574399  13402891561254  -0.19  23702698131868  23760468144363  -0.24  2222932  2225440  -0.11    0    0    nan 
              coq-verdi-raft  1106.96  1108.95  -0.18   3082965331519   3087107055861  -0.13   4347880563818   4352501365815  -0.11   902404   902504  -0.01    0    0    nan 
               coq-fiat-core   108.17   108.26  -0.08    305804736237    305739929130   0.02    414164287983    413281052355   0.21   481068   480600   0.10    0    0    nan 
       coq-mathcomp-fingroup    48.01    48.04  -0.06    133136647315    133188234346  -0.04    185765777528    186762957487  -0.53   481364   482288  -0.19    0    0    nan 
                    coq-hott   282.58   282.74  -0.06    776347808911    777615573134  -0.16   1201618160767   1205672844778  -0.34   568460   569692  -0.22    0    0    nan 
                coq-rewriter   667.98   668.22  -0.04   1852111618298   1854677928680  -0.14   2848922586999   2851009767975  -0.07  1071780  1071656   0.01    0    0    nan 
               coq-fourcolor  2543.43  2544.03  -0.02   7091291205208   7092103049896  -0.01  12236935068204  12238611828015  -0.01   731004   730820   0.03    0    0    nan 
                 coq-coqutil    59.09    59.08   0.02    163199260129    163823899196  -0.38    215422218138    215132678334   0.13   600024   600264  -0.04    0    0    nan 
                  coq-geocoq  1334.35  1332.19   0.16   3717406578638   3715154563662   0.06   5451049229729   5469943799276  -0.35  1067708   980896   8.85    0    0    nan 
                   coq-verdi    98.33    98.17   0.16    269448701241    270307144840  -0.32    379549316321    379932458655  -0.10   544392   544888  -0.09    0    0    nan 
                coq-bedrock2   311.30   310.46   0.27    863336606476    860221902880   0.36   1511374204381   1512347737730  -0.06   798304   798296   0.00    0    0    nan 
          coq-mathcomp-field   222.39   221.74   0.29    619282092142    617268487607   0.33    938096515994    940914479175  -0.30   662628   669404  -1.01    0    0    nan 
              coq-coquelicot    68.60    68.39   0.31    186849614236    186741139501   0.06    240083063965    239622349451   0.19   557808   557608   0.04    0    0    nan 
                    coq-core   107.10   106.08   0.96    296811275570    296343846533   0.16    458969767556    458978131098  -0.00   290956   290928   0.01    0    0    nan 
                 coq-unimath  4370.73  4303.45   1.56  12157536863236  11977932678501   1.50  22982302463315  22998736980816  -0.07  3283376  3264940   0.56    0    0    nan 
└─────────────────────────────┴─────────────────────────┴───────────────────────────────────────┴───────────────────────────────────────┴─────────────────────────┴─────────────────┘

Bench complete, failed to install packages:
coq-compcert
coq-vst

view this post on Zulip Bench bot (Jul 13 2021 at 14:53):

Bench at https://gitlab.com/coq/coq/-/jobs/1420684244
Testing Cleanups and minor fix around evar normalization
On packages coq-bignums coq-hott coq-performance-tests-lite coq-engine-bench-lite coq-mathcomp-ssreflect coq-mathcomp-fingroup coq-mathcomp-algebra coq-mathcomp-solvable coq-mathcomp-field coq-mathcomp-character coq-mathcomp-odd-order coq-math-classes coq-corn coq-flocq coq-compcert coq-geocoq coq-color coq-coqprime coq-coqutil coq-bedrock2 coq-rewriter coq-fiat-core coq-fiat-parsers coq-fiat-crypto coq-unimath coq-coquelicot coq-lambda-rust coq-verdi coq-verdi-raft coq-fourcolor coq-rewriter-perf-SuperFast coq-perennial coq-vst

┌─────────────────────────────┬─────────────────────────┬───────────────────────────────────────┬───────────────────────────────────────┬──────────────────────────┬─────────────────┐
                                   user time [s]                    CPU cycles                          CPU instructions              max resident mem [KB]      mem faults    
                                                                                                                                                                               
                package_name      NEW      OLD  PDIFF             NEW             OLD  PDIFF             NEW             OLD  PDIFF      NEW      OLD   PDIFF  NEW  OLD  PDIFF 
├─────────────────────────────┼─────────────────────────┼───────────────────────────────────────┼───────────────────────────────────────┼──────────────────────────┼─────────────────┤
  coq-performance-tests-lite  1536.12  1556.47  -1.31   4288866596244   4339260445861  -1.16   7117132098155   7126282829056  -0.13  2085044  2084884    0.01    0    0    nan 
       coq-mathcomp-fingroup    47.60    48.21  -1.27    132432446660    133396116264  -0.72    186663355022    186741575455  -0.04   482496   482992   -0.10    0    0    nan 
            coq-math-classes   172.00   173.69  -0.97    479318300308    484830296843  -1.14    641521906835    643365654430  -0.29   481312   481260    0.01    0    0    nan 
                    coq-corn  1456.95  1470.81  -0.94   4055461632534   4093469553988  -0.93   5875863582621   5884241927726  -0.14   800848   799540    0.16    0    0    nan 
        coq-mathcomp-algebra   140.46   141.61  -0.81    390548736348    392300249042  -0.45    511161890744    511491044484  -0.06   554560   554156    0.07    0    0    nan 
                 coq-unimath  4264.11  4296.13  -0.75  11871993921296  11957193839746  -0.71  22887814344321  22887976050054  -0.00  3267400  3711120  -11.96    0    0    nan 
                    coq-hott   279.95   282.02  -0.73    770407983755    774202501516  -0.49   1192593868882   1193290061050  -0.06   570284   569596    0.12    0    0    nan 
             coq-fiat-crypto  4793.97  4829.09  -0.73  13315903518545  13410386521910  -0.70  23616818746069  23632329144464  -0.07  2231592  2231448    0.01    0    0    nan 
                coq-coqprime   327.45   329.74  -0.69    909665716764    915893053883  -0.68   1596160256267   1595210306261   0.06   917392   917424   -0.00    0    0    nan 
      coq-mathcomp-odd-order  1046.17  1051.51  -0.51   2913990188651   2926183654328  -0.42   4663330636514   4665121575499  -0.04   909064   903824    0.58    0    0    nan 
               coq-fourcolor  2538.73  2549.04  -0.40   7076795495408   7104199246879  -0.39  12242228254875  12241942001143   0.00   732152   732108    0.01    0    0    nan 
       coq-mathcomp-solvable   168.89   169.52  -0.37    469967736183    471600811956  -0.35    669247195967    669539853271  -0.04   673792   695380   -3.10    0    0    nan 
 coq-rewriter-perf-SuperFast   735.28   737.54  -0.31   2044662771185   2053425578297  -0.43   3211576598888   3212298896142  -0.02  1074096  1074228   -0.01    0    0    nan 
               coq-fiat-core   108.28   108.58  -0.28    305239219428    306601050313  -0.44    413832849934    412570851773   0.31   480432   480544   -0.02    0    0    nan 
                coq-bedrock2   309.95   310.80  -