OpenBench Testing Framework

Finished
datagen
N=5000
Generated 5132/1000000000 Games
Elo: 1.96 +- 7.69 (95%) [N=1000000000]
Games: 5132 W: 1691 L: 1662 D: 1779
reduce-quiets-with-good-history-less
8.0+0.08
Elo: 0.34 +- 1.78 [0.00, 5.00]
Games: 31226 W: 7255 L: 7224 D: 16747
Ptnml(0-2): 63, 3065, 9340, 3068, 77
reduce quiets with good history less
prefetch-on-aarch64
4.0+0.04
Elo: 13.79 +- 6.45 [0.00, 5.00]
Games: 2824 W: 737 L: 625 D: 1462
Ptnml(0-2): 10, 260, 764, 364, 14
prefetch on aarch64 still unstable, so yoinked from icarus
spsa-history-params
8.0+0.08
Elo: -0.21 +- 3.73 [0.00, 5.00]
Games: 8432 W: 1921 L: 1926 D: 4585
Ptnml(0-2): 20, 988, 2208, 977, 23
spsa history params
history-prune-only-skip-one
8.0+0.08
Elo: -5.29 +- 5.35 [0.00, 5.00]
Games: 4266 W: 934 L: 999 D: 2333
Ptnml(0-2): 10, 550, 1081, 479, 13
history prune only skip one
spsa-bonuses-and-maluses
8.0+0.08
Tuning 18 Parameters
204/25000 Iterations
3264/400000 Games Played
don-t-apply-tacthist-bonus-for-quiets
8.0+0.08
Elo: 5.86 +- 4.71 [-5.00, 0.00]
Games: 4746 W: 1175 L: 1095 D: 2476
Ptnml(0-2): 12, 449, 1373, 525, 14
don't apply tacthist bonus for quiets
account-for-tt-entry-in-nmp-condition
8.0+0.08
Elo: -0.07 +- 2.41 [0.00, 5.00]
Games: 20842 W: 4745 L: 4749 D: 11348
Ptnml(0-2): 45, 2529, 5298, 2483, 66
account for tt-entry in nmp condition
higher-bonus-for-eval-below-alpha
8.0+0.08
Elo: 2.66 +- 2.14 [0.00, 5.00]
Games: 26514 W: 6297 L: 6094 D: 14123
Ptnml(0-2): 75, 3097, 6696, 3328, 61
higher bonus for eval below alpha
don-t-apply-tacthist-bonus-for-quiets
8.0+0.08
Elo: -0.40 +- 2.63 [0.00, 5.00]
Games: 16592 W: 3738 L: 3757 D: 9097
Ptnml(0-2): 38, 1911, 4422, 1882, 43
don't apply tacthist bonus for quiets
update-corr-divisor
8.0+0.08
Elo: -0.19 +- 7.92 [0.00, 5.00]
Games: 1844 W: 414 L: 415 D: 1015
Ptnml(0-2): 4, 212, 493, 207, 6
update corr divisor further
update-corr-divisor
8.0+0.08
Elo: -9.23 +- 10.20 [0.00, 5.00]
Games: 1242 W: 274 L: 307 D: 661
Ptnml(0-2): 5, 172, 297, 145, 2
update corr divisor
use-tt-score-in-qsearch
8.0+0.08
Elo: -0.44 +- 3.12 [0.00, 5.00]
Games: 12496 W: 2842 L: 2858 D: 6796
Ptnml(0-2): 35, 1495, 3211, 1465, 42
use tt score in qsearch
more-finetune-wdl
40.0+0.40
Elo: -1.26 +- 6.70 [0.00, 5.00]
Games: 2486 W: 576 L: 585 D: 1325
Ptnml(0-2): 4, 291, 658, 290, 0
.
use-clamp
N=5000
Elo: -0.23 +- 0.31 [-5.00, 0.00]
Games: 3074 W: 986 L: 988 D: 1100
Ptnml(0-2): 0, 2, 1535, 0, 0
use clamp
yoink-pvtable
4.0+0.04
Elo: -1.04 +- 2.52 [-5.00, 0.00]
Games: 15064 W: 3496 L: 3541 D: 8027
Ptnml(0-2): 52, 1376, 4715, 1343, 46
yoink pvtable removes one arg passed through search
more-finetune-wdl
N=50000
Elo: -8.70 +- 7.26 [0.00, 5.00]
Games: 3514 W: 963 L: 1051 D: 1500
Ptnml(0-2): 70, 482, 724, 428, 53
.
more-finetune-wdl
N=25000
Elo: -16.95 +- 10.17 [0.00, 5.00]
Games: 1928 W: 543 L: 637 D: 748
Ptnml(0-2): 63, 235, 437, 191, 38
.
simplify-killers *
8.0+0.08
Elo: -0.81 +- 2.01 [-5.00, 0.00]
Games: 29636 W: 6912 L: 6981 D: 15743
Ptnml(0-2): 100, 3506, 7640, 3507, 65
simplify killers
lmr-tactials-less-quiets-more
8.0+0.08
Elo: 34.00 +- 24.04 (95%) [N=4096]
Games: 246 W: 66 L: 42 D: 138
Ptnml(0-2): 0, 23, 56, 41, 3
LMR: tactials less, quiets more
lmr-tactials-less-quiets-more
8.0+0.08
Elo: 7.42 +- 4.53 [0.00, 5.00]
Games: 5902 W: 1493 L: 1367 D: 3042
Ptnml(0-2): 16, 636, 1529, 746, 24
LMR: tactials less, quiets more
split-quiet-tactical-lmrs
8.0+0.08
Elo: -1.75 +- 16.06 [-5.00, 0.00]
Games: 396 W: 92 L: 94 D: 210
Ptnml(0-2): 1, 38, 124, 32, 3
Split quiet & tactical LMRs
lmr-tactials-less-quiets-more *
8.0+0.08
Elo: 6.60 +- 28.79 [0.00, 5.00]
Games: 158 W: 43 L: 40 D: 75
Ptnml(0-2): 1, 14, 48, 13, 3
LMR: tactials less, quiets more
split-quiet-tactical-lmrs *
8.0+0.08
Elo: -9.60 +- 5.88 [-5.00, 0.00]
Games: 3404 W: 757 L: 851 D: 1796
Ptnml(0-2): 15, 425, 911, 341, 10
Split quiet & tactical LMRs
incorporate-history-in-lmp
8.0+0.08
Elo: 0.17 +- 2.92 [0.00, 5.00]
Games: 14530 W: 3397 L: 3390 D: 7743
Ptnml(0-2): 49, 1734, 3697, 1731, 54
Incorporate history in LMP