OpenBench Testing Framework

Finished
master
40.0+0.40
Elo: 62.96 +- 10.53 (95%) [N=1024]
Games: 1032 W: 348 L: 163 D: 521
Ptnml(0-2): 1, 49, 236, 224, 6
Improve nnue_index readability * Move Bitboard::flip_vertically to Square::mirror_vertically * Add mirror_horizontally_if
master
8.0+0.08
Elo: 2.96 +- 5.84 (95%) [N=4096]
Games: 4104 W: 1070 L: 1035 D: 1999
Ptnml(0-2): 36, 467, 1001, 522, 26
previous (suspiciously high?) progtest to master
3A8E36707A31D685
8.0+0.08
Elo: 46.32 +- 5.95 (95%) [N=4096]
Games: 4112 W: 1303 L: 758 D: 2051
Ptnml(0-2): 20, 305, 896, 780, 55
v12 to previous (suspiciously high?) progtest
master
8.0+0.08
Elo: 43.10 +- 6.22 (95%) [N=4096]
Games: 4116 W: 1351 L: 843 D: 1922
Ptnml(0-2): 27, 323, 910, 711, 87
v12.0 to master progtest
multilayer-ranger *
40.0+0.40
Elo: 4.47 +- 3.26 [0.00, 5.00]
Games: 10794 W: 2735 L: 2596 D: 5463
Ptnml(0-2): 17, 1194, 2837, 1331, 18
ml ranger
master
40.0+0.40
Elo: 58.80 +- 11.40 (95%) [N=1024]
Games: 1026 W: 360 L: 188 D: 478
Ptnml(0-2): 2, 64, 217, 220, 10
multilayer-ranger
N=25000
Elo: 8.60 +- 5.54 [0.00, 5.00]
Games: 6912 W: 2230 L: 2059 D: 2623
Ptnml(0-2): 174, 757, 1468, 838, 219
ml ranger
vectorsed-inference-int
40.0+0.40
Elo: 16.47 +- 7.08 [0.00, 5.00]
Games: 2322 W: 609 L: 499 D: 1214
Ptnml(0-2): 5, 217, 609, 323, 7
avx2 simd
master
40.0+0.40
Elo: 6.42 +- 11.05 (95%) [N=1024]
Games: 1028 W: 255 L: 236 D: 537
Ptnml(0-2): 1, 121, 255, 132, 5
master
40.0+0.40
Elo: 56.82 +- 10.93 (95%) [N=1024]
Games: 1024 W: 339 L: 173 D: 512
Ptnml(0-2): 0, 63, 227, 215, 7
qsearch-lmp *
8.0+0.08
Elo: 4.79 +- 3.45 [0.00, 5.00]
Games: 10656 W: 2590 L: 2443 D: 5623
Ptnml(0-2): 37, 1227, 2664, 1352, 48
qsearch lmp
scalar-inference-int
N=25000
Elo: 25.09 +- 10.06 [0.00, 5.00]
Games: 2136 W: 738 L: 584 D: 814
Ptnml(0-2): 47, 207, 434, 305, 75
scalar inference impl
scalar-inference-int
N=25000
Elo: 18.46 +- 8.57 [0.00, 5.00]
Games: 2770 W: 901 L: 754 D: 1115
Ptnml(0-2): 53, 288, 591, 365, 88
scalar inference impl
scalar-inference-int
N=25000
Elo: 16.53 +- 8.16 [0.00, 5.00]
Games: 3408 W: 1163 L: 1001 D: 1244
Ptnml(0-2): 101, 322, 723, 430, 128
scalar inference impl
multilayer-shift-unshift
N=25000
Elo: 20.07 +- 8.75 [0.00, 5.00]
Games: 2894 W: 999 L: 832 D: 1063
Ptnml(0-2): 92, 243, 609, 412, 91
shift and unshift
multilayer
N=25000
Elo: 18.41 +- 8.62 [0.00, 5.00]
Games: 3060 W: 1016 L: 854 D: 1190
Ptnml(0-2): 95, 285, 613, 437, 100
scalar inference impl
multilayer
N=25000
Elo: 24.28 +- 10.29 [0.00, 5.00]
Games: 2250 W: 752 L: 595 D: 903
Ptnml(0-2): 54, 235, 440, 292, 104
scalar inference impl
no-overflow
4.0+0.04
Elo: 4.92 +- 4.30 [-5.00, 0.00]
Games: 5582 W: 1372 L: 1293 D: 2917
Ptnml(0-2): 30, 468, 1711, 557, 25
Stop overflowing the depth calculation in tt::should_overwrite
thread-voting
N=20000
Elo: 32.17 +- 10.85 [0.00, 5.00]
Games: 1462 W: 478 L: 343 D: 641
Ptnml(0-2): 19, 119, 334, 226, 33
Add thread voting After finishing search, have each thread vote for its own best move. Then select the best result. Based on the Beserk impl which also seems to be used in Stockfish, Stormphrax, etc. vote
thread-voting
N=40000
Elo: 33.58 +- 10.85 [0.00, 5.00]
Games: 1318 W: 403 L: 276 D: 639
Ptnml(0-2): 12, 102, 317, 203, 25
thread-voting
N=20000
Elo: 44.05 +- 13.26 [0.00, 5.00]
Games: 1134 W: 378 L: 235 D: 521
Ptnml(0-2): 16, 92, 231, 189, 39
thread-voting
N=40000
Elo: 13.48 +- 6.73 [0.00, 5.00]
Games: 3482 W: 977 L: 842 D: 1663
Ptnml(0-2): 34, 374, 807, 475, 51
thread-voting
N=20000
Elo: 29.95 +- 10.40 [0.00, 5.00]
Games: 1628 W: 516 L: 376 D: 736
Ptnml(0-2): 19, 152, 348, 260, 35
c236c7fe
4.0+0.04
Elo: 0.80 +- 2.64 [-5.00, 0.00]
Games: 17442 W: 4197 L: 4157 D: 9088
Ptnml(0-2): 83, 1935, 4650, 1965, 88
quick non-reg of time control changes for single thread
thread-time-management
5.0+0.05
Elo: 5.69 +- 4.73 [-5.00, 0.00]
Games: 4946 W: 1131 L: 1050 D: 2765
Ptnml(0-2): 3, 534, 1322, 607, 7
thread time management