OpenBench Testing Framework

Finished
reintroduce-qsearch-lmp
8.0+0.08
Elo: -1.70 +- 3.60 [0.00, 5.00]
Games: 9610 W: 2243 L: 2290 D: 5077
Ptnml(0-2): 30, 1183, 2437, 1114, 41
Reintroduce qsearch lmp
qs-bad-tacticals-in-check *
8.0+0.08
Elo: 2.28 +- 3.69 [0.00, 5.00]
Games: 9298 W: 2227 L: 2166 D: 4905
Ptnml(0-2): 39, 1079, 2355, 1134, 42
search bad tacticals when in check in qsearch
master *
4.0+0.04
Elo: 2.92 +- 9.09 (95%) [N=40000]
Games: 1070 W: 274 L: 265 D: 531
Ptnml(0-2): 4, 81, 356, 90, 4
Revert "Add late move pruning to quiescence" This reverts commit bf4c5d4362044f474c54faadfaf63f6cf834e5e7. It appears that this introduced time losses.
simplify-tb-logic-in-search
N=5000
Elo: -0.00 +- 0.00 [0.00, 5.00]
Games: 3076 W: 1030 L: 1030 D: 1016
Ptnml(0-2): 0, 0, 1538, 0, 0
simplify tb logic in search cardinality logic is already in can_probe
qsearch-lmp *
8.0+0.08
Elo: 4.79 +- 3.45 [0.00, 5.00]
Games: 10656 W: 2590 L: 2443 D: 5623
Ptnml(0-2): 37, 1227, 2664, 1352, 48
qsearch lmp
scalar-inference-int
N=25000
Elo: 25.09 +- 10.06 [0.00, 5.00]
Games: 2136 W: 738 L: 584 D: 814
Ptnml(0-2): 47, 207, 434, 305, 75
scalar inference impl
scalar-inference-int
N=25000
Elo: 18.46 +- 8.57 [0.00, 5.00]
Games: 2770 W: 901 L: 754 D: 1115
Ptnml(0-2): 53, 288, 591, 365, 88
scalar inference impl
scalar-inference-int
N=25000
Elo: 16.53 +- 8.16 [0.00, 5.00]
Games: 3408 W: 1163 L: 1001 D: 1244
Ptnml(0-2): 101, 322, 723, 430, 128
scalar inference impl
qsearch-lmp *
8.0+0.08
Elo: -0.92 +- 3.15 [0.00, 5.00]
Games: 12878 W: 3017 L: 3051 D: 6810
Ptnml(0-2): 59, 1565, 3220, 1541, 54
qsearch lmp
fix-qsearch-evasions
8.0+0.08
Elo: 2.38 +- 2.42 [0.00, 5.00]
Games: 21432 W: 5144 L: 4997 D: 11291
Ptnml(0-2): 67, 2542, 5358, 2675, 74
alternate attempt
fix-qsearch-evasions
8.0+0.08
Elo: -2.51 +- 6.78 [0.00, 5.00]
Games: 2630 W: 603 L: 622 D: 1405
Ptnml(0-2): 12, 306, 696, 291, 10
fix qsearch evasions
continuous-best-move-tm
8.0+0.08
Elo: -1.60 +- 2.89 [-5.00, 0.00]
Games: 14298 W: 3347 L: 3413 D: 7538
Ptnml(0-2): 55, 1651, 3801, 1589, 53
continuous best move tm
prefer-storing-pv-entries-to-tt
5.0+0.05
Elo: 0.21 +- 2.80 [0.00, 5.00]
Games: 15120 W: 3466 L: 3457 D: 8197
Ptnml(0-2): 37, 1779, 3922, 1782, 40
prefer storing pv entries to TT
multilayer-shift-unshift
N=25000
Elo: -3.26 +- 2.96 [-5.00, 0.00]
Games: 22724 W: 6462 L: 6675 D: 9587
Ptnml(0-2): 550, 2825, 4773, 2716, 498
shift and unshift
multilayer-shift-unshift
N=25000
Elo: 20.07 +- 8.75 [0.00, 5.00]
Games: 2894 W: 999 L: 832 D: 1063
Ptnml(0-2): 92, 243, 609, 412, 91
shift and unshift
multilayer-scale-change
N=25000
Elo: -1.61 +- 9.99 [0.00, 5.00]
Games: 2164 W: 669 L: 679 D: 816
Ptnml(0-2): 66, 253, 444, 263, 56
scale change
multilayer
N=25000
Elo: 18.41 +- 8.62 [0.00, 5.00]
Games: 3060 W: 1016 L: 854 D: 1190
Ptnml(0-2): 95, 285, 613, 437, 100
scalar inference impl
multilayer
N=25000
Elo: 24.28 +- 10.29 [0.00, 5.00]
Games: 2250 W: 752 L: 595 D: 903
Ptnml(0-2): 54, 235, 440, 292, 104
scalar inference impl
is-tm-broken
8.0+0.08
Elo: -9.15 +- 8.57 [0.00, 5.00]
Games: 1520 W: 320 L: 360 D: 840
Ptnml(0-2): 2, 196, 403, 158, 1
is my time management broken?
prefer-storing-pv-entries-to-tt
8.0+0.08
Elo: 1.08 +- 8.02 [0.00, 5.00]
Games: 1932 W: 471 L: 465 D: 996
Ptnml(0-2): 4, 236, 483, 236, 7
prefer storing pv entries to TT
9312D5D9D6E5186D
40.0+0.40
Elo: 6.17 +- 4.46 [0.00, 5.00]
Games: 5798 W: 1361 L: 1258 D: 3179
Ptnml(0-2): 7, 640, 1503, 741, 8
Double check Ranger net at LTC
no-overflow
4.0+0.04
Elo: 4.92 +- 4.30 [-5.00, 0.00]
Games: 5582 W: 1372 L: 1293 D: 2917
Ptnml(0-2): 30, 468, 1711, 557, 25
Stop overflowing the depth calculation in tt::should_overwrite
traced-thread-voting
N=40000
Elo: 53.38 +- 30.17 [0.00, 5.00]
Games: 164 W: 50 L: 25 D: 89
Ptnml(0-2): 0, 11, 39, 28, 4
traced thread voting
thread-voting
N=20000
Elo: -10.49 +- 10.11 [0.00, 5.00]
Games: 1458 W: 352 L: 396 D: 710
Ptnml(0-2): 16, 197, 342, 163, 11
Add thread voting After finishing search, have each thread vote for its own best move. Then select the best result. Based on the Beserk impl which also seems to be used in Stockfish, Stormphrax, etc. vote
thread-voting
N=20000
Elo: 32.17 +- 10.85 [0.00, 5.00]
Games: 1462 W: 478 L: 343 D: 641
Ptnml(0-2): 19, 119, 334, 226, 33
Add thread voting After finishing search, have each thread vote for its own best move. Then select the best result. Based on the Beserk impl which also seems to be used in Stockfish, Stormphrax, etc. vote