OpenBench Testing Framework

Finished
nnz
8.0+0.08
Elo: 12.06 +- 5.91 [0.00, 5.00]
Games: 3200 W: 826 L: 715 D: 1659
Ptnml(0-2): 5, 311, 858, 420, 6
introduce-in-singular-search
N=5000
Elo: -0.00 +- 0.00 [-5.00, 0.00]
Games: 14554 W: 4531 L: 4531 D: 5492
Ptnml(0-2): 0, 0, 7277, 0, 0
probcut
8.0+0.08
Elo: 3.62 +- 2.81 [0.00, 5.00]
Games: 15258 W: 3614 L: 3455 D: 8189
Ptnml(0-2): 35, 1753, 3906, 1888, 47
hindsight-reduction
8.0+0.08
Elo: 4.52 +- 3.31 [0.00, 5.00]
Games: 11072 W: 2617 L: 2473 D: 5982
Ptnml(0-2): 27, 1268, 2802, 1412, 27
hindsight-extension
8.0+0.08
Elo: 3.31 +- 2.61 [0.00, 5.00]
Games: 17626 W: 4225 L: 4057 D: 9344
Ptnml(0-2): 33, 2048, 4506, 2170, 56
1536-hl
N=40000
Elo: 24.45 +- 9.78 [0.00, 5.00]
Games: 1964 W: 624 L: 486 D: 854
Ptnml(0-2): 27, 192, 438, 266, 59
update-histories-in-singular-search
8.0+0.08
Elo: 0.88 +- 2.70 [-5.00, 0.00]
Games: 16578 W: 3937 L: 3895 D: 8746
Ptnml(0-2): 47, 1962, 4222, 2018, 40
qsearch-lmp
8.0+0.08
Elo: 3.51 +- 2.75 [0.00, 5.00]
Games: 16118 W: 3806 L: 3643 D: 8669
Ptnml(0-2): 48, 1850, 4095, 2023, 43
prefetch-on-aarch64
4.0+0.04
Elo: 13.79 +- 6.45 [0.00, 5.00]
Games: 2824 W: 737 L: 625 D: 1462
Ptnml(0-2): 10, 260, 764, 364, 14
prefetch on aarch64 still unstable, so yoinked from icarus
don-t-apply-tacthist-bonus-for-quiets
8.0+0.08
Elo: 5.86 +- 4.71 [-5.00, 0.00]
Games: 4746 W: 1175 L: 1095 D: 2476
Ptnml(0-2): 12, 449, 1373, 525, 14
don't apply tacthist bonus for quiets
higher-bonus-for-eval-below-alpha
8.0+0.08
Elo: 2.66 +- 2.14 [0.00, 5.00]
Games: 26514 W: 6297 L: 6094 D: 14123
Ptnml(0-2): 75, 3097, 6696, 3328, 61
higher bonus for eval below alpha
lmr-tactials-less-quiets-more
8.0+0.08
Elo: 7.42 +- 4.53 [0.00, 5.00]
Games: 5902 W: 1493 L: 1367 D: 3042
Ptnml(0-2): 16, 636, 1529, 746, 24
LMR: tactials less, quiets more
more-typical-lmr
8.0+0.08
Elo: 2.29 +- 3.43 [-5.00, 0.00]
Games: 10172 W: 2439 L: 2372 D: 5361
Ptnml(0-2): 24, 1179, 2620, 1232, 31
More typical LMR Test avoiding saturing behaviour in depth reduction
4-ply-conthist
8.0+0.08
Elo: 2.16 +- 1.73 [0.00, 5.00]
Games: 40426 W: 9565 L: 9314 D: 21547
Ptnml(0-2): 95, 4719, 10359, 4920, 120
4-ply conthist
use-tt-eval-in-rfp
8.0+0.08
Elo: 4.11 +- 3.09 [0.00, 5.00]
Games: 12680 W: 3082 L: 2932 D: 6666
Ptnml(0-2): 41, 1414, 3285, 1554, 46
use tt eval in rfp
1-ply-contcorrhist
8.0+0.08
Elo: 7.49 +- 4.64 [0.00, 5.00]
Games: 5938 W: 1443 L: 1315 D: 3180
Ptnml(0-2): 22, 660, 1484, 774, 29
1-ply contcorrhist
master *
20.0+0.20
Elo: 150.14 +- 10.48 (95%) [N=2048]
Games: 2056 W: 1038 L: 201 D: 817
Ptnml(0-2): 4, 49, 281, 494, 200
Update Github Actions action versions
no-normalization
20.0+0.20
Elo: 0.14 +- 1.87 (95%) [N=30000]
Games: 30012 W: 7523 L: 7511 D: 14978
Ptnml(0-2): 37, 3227, 8465, 3241, 36
no normalization
master
8.0+0.08
Elo: 61.01 +- 6.04 (95%) [N=4096]
Games: 4096 W: 1424 L: 712 D: 1960
Ptnml(0-2): 14, 267, 834, 859, 74
Update Github Actions action versions
master
40.0+0.40
Elo: 76.38 +- 11.34 (95%) [N=1024]
Games: 1026 W: 358 L: 136 D: 532
Ptnml(0-2): 0, 51, 205, 241, 16
Update Github Actions action versions
random-fen-skipping
N=40000
Elo: 4.01 +- 3.15 [0.00, 5.00]
Games: 20350 W: 6152 L: 5917 D: 8281
Ptnml(0-2): 455, 2404, 4305, 2473, 538
net
net-max-eval
8.0+0.08
Elo: 2.60 +- 3.73 [-5.00, 0.00]
Games: 9492 W: 2431 L: 2360 D: 4701
Ptnml(0-2): 32, 1168, 2295, 1199, 52
net
dual-activation
40.0+0.40
Elo: 7.21 +- 4.45 [0.00, 5.00]
Games: 5980 W: 1481 L: 1357 D: 3142
Ptnml(0-2): 11, 663, 1515, 793, 8
dual-activation
N=25000
Elo: 8.35 +- 5.36 [0.00, 5.00]
Games: 7612 W: 2398 L: 2215 D: 2999
Ptnml(0-2): 194, 874, 1538, 955, 245
dual activation
multilayer-ranger
40.0+0.40
Elo: 65.09 +- 10.55 (95%) [N=1024]
Games: 1026 W: 346 L: 156 D: 524
Ptnml(0-2): 1, 48, 229, 230, 5
ml ranger