OpenBench Testing Framework

Finished
thread-voting-prep
8.0+0.08
Elo: 0.47 +- 13.10 [-5.00, 0.00]
Games: 736 W: 177 L: 176 D: 383
Ptnml(0-2): 1, 92, 184, 87, 4
thread voting prep
hl-1536
8.0+0.08
Elo: -8.75 +- 6.71 [0.00, 5.00]
Games: 2938 W: 673 L: 747 D: 1518
Ptnml(0-2): 14, 399, 718, 323, 15
Increase HL to 1536
hl-1536
N=25000
Elo: 10.08 +- 5.94 [0.00, 5.00]
Games: 5962 W: 1863 L: 1690 D: 2409
Ptnml(0-2): 145, 650, 1253, 753, 180
Increase HL to 1536
direct-check-futility-pruning
8.0+0.08
Elo: -5.77 +- 5.55 [0.00, 5.00]
Games: 4036 W: 896 L: 963 D: 2177
Ptnml(0-2): 19, 506, 1027, 455, 11
Use Game::is_direct_check in futility pruning
thread-voting-prep
8.0+0.08
Elo: 0.00 +- 0.00 [-5.00, 0.00]
Games: 0 W: 0 L: 0 D: 0
Ptnml(0-2): 0, 0, 0, 0, 0
thread voting prep
additional-thread-to-collect-results
8.0+0.08
Elo: 1.51 +- 12.61 [-5.00, 0.00]
Games: 688 W: 164 L: 161 D: 363
Ptnml(0-2): 0, 79, 183, 82, 0
additional thread to collect results should enable thread voting for example
additional-thread-to-collect-results *
8.0+0.08
Elo: -182.53 +- 53.49 [-5.00, 0.00]
Games: 110 W: 14 L: 67 D: 29
Ptnml(0-2): 15, 25, 13, 2, 0
additional thread to collect results should enable thread voting for example
score-quiet-moves-that-give-check-higher-for-picking
8.0+0.08
Elo: 4.97 +- 3.54 [0.00, 5.00]
Games: 9920 W: 2343 L: 2201 D: 5376
Ptnml(0-2): 27, 1147, 2473, 1283, 30
Score quiet moves that give check higher for picking
multicut
8.0+0.08
Elo: 6.97 +- 4.40 [0.00, 5.00]
Games: 6380 W: 1517 L: 1389 D: 3474
Ptnml(0-2): 21, 706, 1604, 842, 17
multicut
8ib-net
40.0+0.40
Elo: 2.95 +- 2.37 [0.00, 5.00]
Games: 20588 W: 4826 L: 4651 D: 11111
Ptnml(0-2): 35, 2338, 5372, 2515, 34
8ib net
track-ttpv
4.0+0.04
Elo: -3.39 +- 4.87 [-5.00, 0.00]
Games: 4000 W: 934 L: 973 D: 2093
Ptnml(0-2): 17, 365, 1271, 334, 13
Track tt_pv
8ib-net
8.0+0.08
Elo: 2.48 +- 2.01 [0.00, 5.00]
Games: 33638 W: 8237 L: 7997 D: 17404
Ptnml(0-2): 200, 4000, 8164, 4270, 185
8ib net
8ib-net
N=25000
Elo: -1.64 +- 4.24 [0.00, 5.00]
Games: 11038 W: 3227 L: 3279 D: 4532
Ptnml(0-2): 272, 1310, 2397, 1278, 262
8ib net
simd-neon
4.0+0.04
Elo: 1.15 +- 2.97 [-5.00, 0.00]
Games: 10846 W: 2617 L: 2581 D: 5648
Ptnml(0-2): 41, 941, 3419, 985, 37
Add SIMD impl for Neon
8ib-net
40.0+0.40
Elo: 0.00 +- 0.00 [0.00, 5.00]
Games: 0 W: 0 L: 0 D: 0
Ptnml(0-2): 0, 0, 0, 0, 0
8ib net
8ib-net
N=10000
Elo: -3.20 +- 5.41 [0.00, 5.00]
Games: 8586 W: 2690 L: 2769 D: 3127
Ptnml(0-2): 351, 974, 1709, 921, 338
8ib net
update-network-scale-after-18
8.0+0.08
Elo: 0.73 +- 5.09 [-5.00, 0.00]
Games: 4778 W: 1097 L: 1087 D: 2594
Ptnml(0-2): 22, 552, 1224, 576, 15
update network scale after 18
simd-neon
8.0+0.08
Elo: -8.55 +- 5.53 [-5.00, 0.00]
Games: 3740 W: 798 L: 890 D: 2052
Ptnml(0-2): 17, 444, 1036, 360, 13
Add SIMD impl for Neon
500sb
40.0+0.40
Elo: 14.19 +- 6.56 [0.00, 5.00]
Games: 2720 W: 695 L: 584 D: 1441
Ptnml(0-2): 4, 269, 708, 370, 9
500sb
8.0+0.08
Elo: 12.24 +- 6.31 [0.00, 5.00]
Games: 3606 W: 938 L: 811 D: 1857
Ptnml(0-2): 23, 398, 841, 511, 30
withmetal
8.0+0.08
Elo: 1.14 +- 5.74 [-5.00, 0.00]
Games: 3978 W: 943 L: 930 D: 2105
Ptnml(0-2): 18, 478, 989, 481, 23
1.96
8.0+0.08
Elo: 4.49 +- 4.85 [-5.00, 0.00]
Games: 4488 W: 1054 L: 996 D: 2438
Ptnml(0-2): 10, 437, 1296, 487, 14
1.96
always-capture-a-backtrace
8.0+0.08
Elo: -1.13 +- 2.50 [-5.00, 0.00]
Games: 16560 W: 3804 L: 3858 D: 8898
Ptnml(0-2): 35, 1723, 4828, 1649, 45
simd-rewrite
8.0+0.08
Elo: -0.24 +- 1.72 [-5.00, 0.00]
Games: 35464 W: 8143 L: 8167 D: 19154
Ptnml(0-2): 87, 3669, 10249, 3635, 92
simd-rewrite-avx2
8.0+0.08
Elo: 2.11 +- 3.24 [-5.00, 0.00]
Games: 10388 W: 2439 L: 2376 D: 5573
Ptnml(0-2): 31, 1065, 2936, 1134, 28