OpenBench Testing Framework

Finished
split-quiet-tactical-lmrs *
8.0+0.08
Elo: -3.53 +- 7.03 [0.00, 5.00]
Games: 2758 W: 625 L: 653 D: 1480
Ptnml(0-2): 17, 359, 647, 347, 9
Split quiet & tactical LMRs
incorporate-history-into-lmr
8.0+0.08
Elo: -1.15 +- 3.19 [0.00, 5.00]
Games: 11496 W: 2676 L: 2714 D: 6106
Ptnml(0-2): 30, 1340, 3053, 1288, 37
Incorporate history into lmr
don-t-re-search-at-same-depth-in-lmr
8.0+0.08
Elo: -0.36 +- 2.51 [-5.00, 0.00]
Games: 19546 W: 4542 L: 4562 D: 10442
Ptnml(0-2): 56, 2367, 4955, 2331, 64
Don't re-search at same depth in LMR If reduction > 0 but we clamped our depth to 1, the old condition still meant we re-searched at exactly the same depth. We only want to re-search if we are actually going to search deeper.
more-typical-lmr
8.0+0.08
Elo: 2.29 +- 3.43 [-5.00, 0.00]
Games: 10172 W: 2439 L: 2372 D: 5361
Ptnml(0-2): 24, 1179, 2620, 1232, 31
More typical LMR Test avoiding saturing behaviour in depth reduction
4-ply-conthist
8.0+0.08
Elo: 2.16 +- 1.73 [0.00, 5.00]
Games: 40426 W: 9565 L: 9314 D: 21547
Ptnml(0-2): 95, 4719, 10359, 4920, 120
4-ply conthist
qsearch-see-pruning
8.0+0.08
Elo: 0.10 +- 2.23 [0.00, 5.00]
Games: 24186 W: 5606 L: 5599 D: 12981
Ptnml(0-2): 75, 2841, 6252, 2852, 73
qsearch see pruning
do-lmr-later-in-root
8.0+0.08
Elo: 0.50 +- 1.83 [0.00, 5.00]
Games: 36496 W: 8460 L: 8407 D: 19629
Ptnml(0-2): 103, 4362, 9269, 4407, 107
do lmr later in root
use-tt-eval-in-rfp
8.0+0.08
Elo: 4.11 +- 3.09 [0.00, 5.00]
Games: 12680 W: 3082 L: 2932 D: 6666
Ptnml(0-2): 41, 1414, 3285, 1554, 46
use tt eval in rfp
rounded-lmr-division
20.0+0.20
Elo: -21.95 +- 9.87 [0.00, 5.00]
Games: 1236 W: 249 L: 327 D: 660
Ptnml(0-2): 5, 186, 310, 116, 1
rounded lmr division
1-ply-contcorrhist
8.0+0.08
Elo: 7.49 +- 4.64 [0.00, 5.00]
Games: 5938 W: 1443 L: 1315 D: 3180
Ptnml(0-2): 22, 660, 1484, 774, 29
1-ply contcorrhist
rounded-lmr-division
8.0+0.08
Elo: -12.67 +- 7.81 [0.00, 5.00]
Games: 2002 W: 414 L: 487 D: 1101
Ptnml(0-2): 6, 281, 496, 216, 2
rounded lmr division
do-lmr-later-in-root
N=200000
Elo: -0.00 +- 0.00 [0.00, 5.00]
Games: 316 W: 75 L: 75 D: 166
Ptnml(0-2): 0, 0, 158, 0, 0
do lmr later in root
do-lmr-later-in-root
N=10000
Elo: -0.00 +- 0.00 [0.00, 5.00]
Games: 4496 W: 1398 L: 1398 D: 1700
Ptnml(0-2): 0, 0, 2248, 0, 0
do lmr later in root
fail-firm-multicut
8.0+0.08
Elo: -0.65 +- 4.59 [0.00, 5.00]
Games: 5860 W: 1403 L: 1414 D: 3043
Ptnml(0-2): 19, 707, 1490, 694, 20
fail firm multicut
[Icarus] 6fe827a790934bb6585988293a22d29b47be81e1 *
40.0+0.40
Elo: -56.46 +- 15.42 (95%) [N=1024]
Games: 658 W: 126 L: 232 D: 300
Ptnml(0-2): 14, 127, 143, 41, 4
Update WDL model Based on ~30k games at 20+0.2s.
[Prune] 591318a3c85eb1d449b900701269391e1eeba67d
40.0+0.40
Elo: 72.11 +- 14.12 (95%) [N=1024]
Games: 606 W: 215 L: 91 D: 300
Ptnml(0-2): 0, 28, 129, 140, 6
Update WDL model Based on ~30k games at 20+0.2s.
[Icarus] 6fe827a790934bb6585988293a22d29b47be81e1
40.0+0.40
Elo: -15.80 +- 11.14 (95%) [N=1024]
Games: 1034 W: 242 L: 289 D: 503
Ptnml(0-2): 12, 131, 266, 108, 0
Update WDL model Based on ~30k games at 20+0.2s.
[Icarus] 6fe827a
20.0+0.20
Elo: -29.16 +- 10.24 (95%) [N=2048]
Games: 1290 W: 266 L: 374 D: 650
Ptnml(0-2): 12, 210, 298, 124, 1
Update WDL model Based on ~30k games at 20+0.2s.
master *
20.0+0.20
Elo: 150.14 +- 10.48 (95%) [N=2048]
Games: 2056 W: 1038 L: 201 D: 817
Ptnml(0-2): 4, 49, 281, 494, 200
Update Github Actions action versions
no-normalization
20.0+0.20
Elo: 0.14 +- 1.87 (95%) [N=30000]
Games: 30012 W: 7523 L: 7511 D: 14978
Ptnml(0-2): 37, 3227, 8465, 3241, 36
no normalization
master
8.0+0.08
Elo: 61.01 +- 6.04 (95%) [N=4096]
Games: 4096 W: 1424 L: 712 D: 1960
Ptnml(0-2): 14, 267, 834, 859, 74
Update Github Actions action versions
master
40.0+0.40
Elo: 76.38 +- 11.34 (95%) [N=1024]
Games: 1026 W: 358 L: 136 D: 532
Ptnml(0-2): 0, 51, 205, 241, 16
Update Github Actions action versions
upcoming-repetition-detection *
8.0+0.08
Elo: 0.60 +- 1.72 [0.00, 5.00]
Games: 41170 W: 9635 L: 9564 D: 21971
Ptnml(0-2): 131, 4846, 10555, 4927, 126
upcoming repetition detection
random-fen-skipping
40.0+0.40
Elo: -3.07 +- 4.27 [0.00, 5.00]
Games: 6444 W: 1476 L: 1533 D: 3435
Ptnml(0-2): 10, 807, 1644, 752, 9
net
random-fen-skipping
8.0+0.08
Elo: 0.30 +- 3.00 [0.00, 5.00]
Games: 14810 W: 3728 L: 3715 D: 7367
Ptnml(0-2): 87, 1784, 3639, 1819, 76
net