OpenBench Testing Framework

Finished
with-20260923-data-net *
8.0+0.08
Elo: 19.91 +- 7.98 [0.00, 5.00]
Games: 2026 W: 516 L: 400 D: 1110
Ptnml(0-2): 8, 195, 491, 311, 8
with-20260923-data-net
N=30000
Elo: 10.71 +- 6.16 [0.00, 5.00]
Games: 4966 W: 1482 L: 1329 D: 2155
Ptnml(0-2): 96, 526, 1109, 633, 119
use-pattern-matching-instead-of-asserting-length-in-more-places
4.0+0.04
Elo: 24.86 +- 108.83 [-5.00, 0.00]
Games: 14 W: 3 L: 2 D: 9
Ptnml(0-2): 0, 1, 4, 2, 0
datagen
N=5000
Generated 10079688/30000000 Games
Elo: 0.06 +- 0.17 (95%) [N=30000000]
Games: 10079688 W: 3179559 L: 3177764 D: 3722365
don-t-prune-decisive-scores
8.0+0.08
Elo: -0.71 +- 1.81 [-5.00, 0.00]
Games: 33230 W: 7664 L: 7732 D: 17834
Ptnml(0-2): 85, 3615, 9275, 3563, 77
rerun
only-update-pv-in-pv-nodes
4.0+0.04
Elo: 0.94 +- 2.69 [-5.00, 0.00]
Games: 15968 W: 3783 L: 3740 D: 8445
Ptnml(0-2): 51, 1748, 4358, 1761, 66
50mr-scaling
8.0+0.08
Elo: -1.24 +- 2.09 [-5.00, 0.00]
Games: 27846 W: 6398 L: 6497 D: 14951
Ptnml(0-2): 76, 3395, 7068, 3320, 64
50mr-scaling
8.0+0.08
Elo: 9.60 +- 4.48 [0.00, 5.00]
Games: 2824 W: 961 L: 883 D: 980
Ptnml(0-2): 1, 132, 1067, 212, 0
1536-hl-sparse-net
20.0+0.20
Elo: -15.75 +- 13.26 [0.00, 5.00]
Games: 596 W: 127 L: 154 D: 315
Ptnml(0-2): 1, 78, 166, 53, 0
break-out-of-aspiration-for-decisive-scores *
4.0+0.04
Elo: 1.71 +- 3.00 [-5.00, 0.00]
Games: 11556 W: 2718 L: 2661 D: 6177
Ptnml(0-2): 41, 1100, 3444, 1147, 46
break-out-of-aspiration-for-decisive-scores *
4.0+0.04
Elo: 4.57 +- 13.18 [-5.00, 0.00]
Games: 532 W: 136 L: 129 D: 267
Ptnml(0-2): 0, 46, 170, 47, 3
parser-errors-for-uci-parser
4.0+0.04
Elo: 19.32 +- 78.11 [-5.00, 0.00]
Games: 18 W: 5 L: 4 D: 9
Ptnml(0-2): 0, 1, 6, 2, 0
1280-net
120.0+1.00
Elo: -2.48 +- 4.21 [0.00, 5.00]
Games: 6316 W: 1483 L: 1528 D: 3305
Ptnml(0-2): 3, 771, 1655, 726, 3
1280-net *
80.0+0.80
Elo: 0.86 +- 4.88 [0.00, 5.00]
Games: 4832 W: 1156 L: 1144 D: 2532
Ptnml(0-2): 9, 562, 1258, 582, 5
attempt-crash-fixes * *
4.0+0.04
Elo: 26.22 +- 10.02 [-5.00, 0.00]
Games: 1686 W: 489 L: 362 D: 835
Ptnml(0-2): 5, 192, 358, 247, 41
datagen *
N=5000
Generated 1106964/5000000 Games
Elo: 0.05 +- 0.51 (95%) [N=5000000]
Games: 1106964 W: 349609 L: 349457 D: 407898
attempt-crash-fixes *
N=5000
Elo: 18.49 +- 3.15 [0.00, 5.00]
Games: 3818 W: 1301 L: 1098 D: 1419
Ptnml(0-2): 0, 0, 1770, 75, 64
track-pv-in-qs
4.0+0.04
Elo: -0.14 +- 4.55 [-5.00, 0.00]
Games: 5054 W: 1216 L: 1218 D: 2620
Ptnml(0-2): 17, 506, 1480, 510, 14
1280-net
40.0+0.40
Elo: -3.98 +- 4.73 [0.00, 5.00]
Games: 4974 W: 1123 L: 1180 D: 2671
Ptnml(0-2): 10, 594, 1328, 553, 2
1536-hl-sparse-net
N=20000
Elo: 8.50 +- 5.39 [0.00, 5.00]
Games: 6830 W: 2015 L: 1848 D: 2967
Ptnml(0-2): 154, 741, 1479, 866, 175
1280-net
8.0+0.08
Elo: -9.23 +- 6.84 [0.00, 5.00]
Games: 2710 W: 605 L: 677 D: 1428
Ptnml(0-2): 15, 354, 682, 296, 8
1280-net
N=20000
Elo: 13.40 +- 7.11 [0.00, 5.00]
Games: 3840 W: 1199 L: 1051 D: 1590
Ptnml(0-2): 72, 406, 853, 480, 109
add-sparsity-term-back *
40.0+0.40
Elo: 0.79 +- 2.74 [-5.00, 0.00]
Games: 15482 W: 3739 L: 3704 D: 8039
Ptnml(0-2): 23, 1827, 4004, 1866, 21
datagen
N=5000
Generated 2408/1000000000 Games
Elo: -2.02 +- 10.91 (95%) [N=1000000000]
Games: 2408 W: 736 L: 750 D: 922
datagen
N=100
Generated 17922/1000000000 Games
Elo: -4.17 +- 4.72 (95%) [N=1000000000]
Games: 17922 W: 7603 L: 7818 D: 2501