OpenBench Testing Framework

Finished
update-histories-in-singular-search
8.0+0.08
Elo: 0.88 +- 2.70 [-5.00, 0.00]
Games: 16578 W: 3937 L: 3895 D: 8746
Ptnml(0-2): 47, 1962, 4222, 2018, 40
don-t-apply-tacthist-bonus-for-quiet-moves
8.0+0.08
Elo: -0.23 +- 2.25 [-5.00, 0.00]
Games: 17976 W: 4108 L: 4120 D: 9748
Ptnml(0-2): 36, 1637, 5641, 1651, 23
qsearch-lmp
8.0+0.08
Elo: 3.51 +- 2.75 [0.00, 5.00]
Games: 16118 W: 3806 L: 3643 D: 8669
Ptnml(0-2): 48, 1850, 4095, 2023, 43
qsearch-lmp
8.0+0.08
Elo: 31.59 +- 18.04 (95%) [N=4096]
Games: 408 W: 112 L: 75 D: 221
Ptnml(0-2): 1, 34, 100, 65, 4
qsearch lmp
reduce-less-when-giving-check
8.0+0.08
Elo: -2.52 +- 4.56 [0.00, 5.00]
Games: 5932 W: 1355 L: 1398 D: 3179
Ptnml(0-2): 21, 727, 1511, 688, 19
reduce less when giving check
dodeeper-doshallower
8.0+0.08
Elo: -2.30 +- 3.88 [0.00, 5.00]
Games: 8020 W: 1847 L: 1900 D: 4273
Ptnml(0-2): 32, 955, 2077, 926, 20
dodeeper/doshallower
double-sbs-s1-net
40.0+0.40
Elo: -3.92 +- 6.91 [0.00, 5.00]
Games: 2304 W: 511 L: 537 D: 1256
Ptnml(0-2): 4, 274, 618, 256, 0
double sbs s1 net
update-conthist-after-lmr-research
8.0+0.08
Elo: -4.34 +- 4.94 [0.00, 5.00]
Games: 5038 W: 1133 L: 1196 D: 2709
Ptnml(0-2): 14, 639, 1280, 568, 18
update conthist after lmr research
include-pawns-in-mat-scaling
8.0+0.08
Elo: -4.62 +- 5.00 [0.00, 5.00]
Games: 4662 W: 1065 L: 1127 D: 2470
Ptnml(0-2): 5, 592, 1204, 520, 10
include pawns in mat scaling
update-conthist-with-shared-score
8.0+0.08
Elo: 6.31 +- 4.48 [0.00, 5.00]
Games: 6110 W: 1487 L: 1376 D: 3247
Ptnml(0-2): 15, 688, 1544, 787, 21
update conthist with shared score
double-sbs-s1-net
N=25000
Elo: 1.32 +- 2.57 [0.00, 5.00]
Games: 30208 W: 8811 L: 8696 D: 12701
Ptnml(0-2): 736, 3507, 6469, 3690, 702
double sbs s1 net
double-sbs-s1-net
N=25000
Elo: -8.45 +- 9.24 [0.00, 5.00]
Games: 2304 W: 630 L: 686 D: 988
Ptnml(0-2): 53, 313, 467, 275, 44
double sbs s1 net
remove-gravity-brackets
N=10000
Elo: -0.00 +- 0.00 [-5.00, 0.00]
Games: 618 W: 183 L: 183 D: 252
Ptnml(0-2): 0, 0, 309, 0, 0
remove gravity brackets
update-conthist-after-lmr-research *
8.0+0.08
Elo: -26.78 +- 47.91 [0.00, 5.00]
Games: 104 W: 25 L: 33 D: 46
Ptnml(0-2): 5, 14, 17, 16, 0
update conthist after lmr research
datagen
N=5000
Generated 31648/1000000000 Games
Elo: -0.23 +- 3.06 (95%) [N=1000000000]
Games: 31648 W: 10082 L: 10103 D: 11463
datagen
N=5000
Generated 5132/1000000000 Games
Elo: 1.96 +- 7.69 (95%) [N=1000000000]
Games: 5132 W: 1691 L: 1662 D: 1779
reduce-quiets-with-good-history-less
8.0+0.08
Elo: 0.34 +- 1.78 [0.00, 5.00]
Games: 31226 W: 7255 L: 7224 D: 16747
Ptnml(0-2): 63, 3065, 9340, 3068, 77
reduce quiets with good history less
prefetch-on-aarch64
4.0+0.04
Elo: 13.79 +- 6.45 [0.00, 5.00]
Games: 2824 W: 737 L: 625 D: 1462
Ptnml(0-2): 10, 260, 764, 364, 14
prefetch on aarch64 still unstable, so yoinked from icarus
spsa-history-params
8.0+0.08
Elo: -0.21 +- 3.73 [0.00, 5.00]
Games: 8432 W: 1921 L: 1926 D: 4585
Ptnml(0-2): 20, 988, 2208, 977, 23
spsa history params
history-prune-only-skip-one
8.0+0.08
Elo: -5.29 +- 5.35 [0.00, 5.00]
Games: 4266 W: 934 L: 999 D: 2333
Ptnml(0-2): 10, 550, 1081, 479, 13
history prune only skip one
spsa-bonuses-and-maluses
8.0+0.08
Tuning 18 Parameters
204/25000 Iterations
3264/400000 Games Played
don-t-apply-tacthist-bonus-for-quiets
8.0+0.08
Elo: 5.86 +- 4.71 [-5.00, 0.00]
Games: 4746 W: 1175 L: 1095 D: 2476
Ptnml(0-2): 12, 449, 1373, 525, 14
don't apply tacthist bonus for quiets
account-for-tt-entry-in-nmp-condition
8.0+0.08
Elo: -0.07 +- 2.41 [0.00, 5.00]
Games: 20842 W: 4745 L: 4749 D: 11348
Ptnml(0-2): 45, 2529, 5298, 2483, 66
account for tt-entry in nmp condition
higher-bonus-for-eval-below-alpha
8.0+0.08
Elo: 2.66 +- 2.14 [0.00, 5.00]
Games: 26514 W: 6297 L: 6094 D: 14123
Ptnml(0-2): 75, 3097, 6696, 3328, 61
higher bonus for eval below alpha
don-t-apply-tacthist-bonus-for-quiets
8.0+0.08
Elo: -0.40 +- 2.63 [0.00, 5.00]
Games: 16592 W: 3738 L: 3757 D: 9097
Ptnml(0-2): 38, 1911, 4422, 1882, 43
don't apply tacthist bonus for quiets