OpenBench Testing Framework

Finished
random-fen-skipping
N=40000
Elo: 4.01 +- 3.15 [0.00, 5.00]
Games: 20350 W: 6152 L: 5917 D: 8281
Ptnml(0-2): 455, 2404, 4305, 2473, 538
net
net-max-eval
8.0+0.08
Elo: 2.60 +- 3.73 [-5.00, 0.00]
Games: 9492 W: 2431 L: 2360 D: 4701
Ptnml(0-2): 32, 1168, 2295, 1199, 52
net
net-max-eval
N=40000
Elo: -0.69 +- 5.93 [-5.00, 0.00]
Games: 5522 W: 1625 L: 1636 D: 2261
Ptnml(0-2): 130, 634, 1249, 613, 135
net
net-max-eval
N=40000
Elo: -0.61 +- 4.73 [-5.00, 0.00]
Games: 9090 W: 2650 L: 2666 D: 3774
Ptnml(0-2): 223, 1112, 1884, 1110, 216
net
net-max-eval
N=25000
Elo: -18.88 +- 10.45 [0.00, 5.00]
Games: 1916 W: 534 L: 638 D: 744
Ptnml(0-2): 61, 263, 392, 203, 39
net
dual-activation
40.0+0.40
Elo: 7.21 +- 4.45 [0.00, 5.00]
Games: 5980 W: 1481 L: 1357 D: 3142
Ptnml(0-2): 11, 663, 1515, 793, 8
dual-activation
N=25000
Elo: 8.35 +- 5.36 [0.00, 5.00]
Games: 7612 W: 2398 L: 2215 D: 2999
Ptnml(0-2): 194, 874, 1538, 955, 245
dual activation
multilayer-ranger
40.0+0.40
Elo: 65.09 +- 10.55 (95%) [N=1024]
Games: 1026 W: 346 L: 156 D: 524
Ptnml(0-2): 1, 48, 229, 230, 5
ml ranger
master
40.0+0.40
Elo: 62.96 +- 10.53 (95%) [N=1024]
Games: 1032 W: 348 L: 163 D: 521
Ptnml(0-2): 1, 49, 236, 224, 6
Improve nnue_index readability * Move Bitboard::flip_vertically to Square::mirror_vertically * Add mirror_horizontally_if
master
40.0+0.40
Elo: -2.14 +- 10.43 (95%) [N=1024]
Games: 810 W: 177 L: 182 D: 451
Ptnml(0-2): 1, 76, 255, 73, 0
Improve nnue_index readability * Move Bitboard::flip_vertically to Square::mirror_vertically * Add mirror_horizontally_if
master
8.0+0.08
Elo: 2.96 +- 5.84 (95%) [N=4096]
Games: 4104 W: 1070 L: 1035 D: 1999
Ptnml(0-2): 36, 467, 1001, 522, 26
previous (suspiciously high?) progtest to master
3A8E36707A31D685
8.0+0.08
Elo: 46.32 +- 5.95 (95%) [N=4096]
Games: 4112 W: 1303 L: 758 D: 2051
Ptnml(0-2): 20, 305, 896, 780, 55
v12 to previous (suspiciously high?) progtest
master
8.0+0.08
Elo: 43.10 +- 6.22 (95%) [N=4096]
Games: 4116 W: 1351 L: 843 D: 1922
Ptnml(0-2): 27, 323, 910, 711, 87
v12.0 to master progtest
multilayer-ranger *
40.0+0.40
Elo: 4.47 +- 3.26 [0.00, 5.00]
Games: 10794 W: 2735 L: 2596 D: 5463
Ptnml(0-2): 17, 1194, 2837, 1331, 18
ml ranger
history-with-capacity
2.0+0.02
Elo: 5.57 +- 9.15 [0.00, 5.00]
Games: 1310 W: 336 L: 315 D: 659
Ptnml(0-2): 5, 123, 379, 142, 6
master
40.0+0.40
Elo: 11.64 +- 11.59 (95%) [N=1024]
Games: 866 W: 223 L: 194 D: 449
Ptnml(0-2): 2, 87, 225, 118, 1
Fix neon non-dotprod SIMD fallback for dpbusd vmull_s8 takes signed integers, so we need to preserve i8s through the neon code and u8s through non-neon. I've introduced UI8s for this case.
master
40.0+0.40
Elo: 58.80 +- 11.40 (95%) [N=1024]
Games: 1026 W: 360 L: 188 D: 478
Ptnml(0-2): 2, 64, 217, 220, 10
master
8.0+0.08
Elo: -3.31 +- 8.90 [-5.00, 0.00]
Games: 1576 W: 374 L: 389 D: 813
Ptnml(0-2): 12, 181, 407, 186, 2
master
40.0+0.40
Elo: 37.78 +- 15.02 (95%) [N=1024]
Games: 554 W: 174 L: 114 D: 266
Ptnml(0-2): 1, 43, 130, 101, 2
multilayer-ranger
N=25000
Elo: 8.60 +- 5.54 [0.00, 5.00]
Games: 6912 W: 2230 L: 2059 D: 2623
Ptnml(0-2): 174, 757, 1468, 838, 219
ml ranger
467F2C23BB07255C
8.0+0.08
Elo: -1.79 +- 6.71 [0.00, 5.00]
Games: 3106 W: 748 L: 764 D: 1594
Ptnml(0-2): 28, 382, 731, 402, 10
vectorsed-inference-int
40.0+0.40
Elo: 16.47 +- 7.08 [0.00, 5.00]
Games: 2322 W: 609 L: 499 D: 1214
Ptnml(0-2): 5, 217, 609, 323, 7
avx2 simd
master
40.0+0.40
Elo: 6.42 +- 11.05 (95%) [N=1024]
Games: 1028 W: 255 L: 236 D: 537
Ptnml(0-2): 1, 121, 255, 132, 5
master
40.0+0.40
Elo: 56.82 +- 10.93 (95%) [N=1024]
Games: 1024 W: 339 L: 173 D: 512
Ptnml(0-2): 0, 63, 227, 215, 7
continuous-best-move-tm
40.0+0.40
Elo: -4.62 +- 6.52 [-5.00, 0.00]
Games: 2556 W: 556 L: 590 D: 1410
Ptnml(0-2): 8, 292, 704, 274, 0
continuous best move tm