OpenBench Testing Framework

Finished
master
8.0+0.08
Elo: 70.07 +- 8.59 (95%) [N=4096]
Games: 4096 W: 1859 L: 1044 D: 1193
Ptnml(0-2): 104, 280, 742, 541, 381
time/reduce-base-time
8.0+0.08
Elo: 9.27 +- 6.08 [0.00, 5.00]
Games: 7646 W: 2776 L: 2572 D: 2298
Ptnml(0-2): 362, 725, 1499, 821, 416
fix/allocate-tt-before-first-move
8.0+0.08
Elo: 10.45 +- 7.45 [-5.00, 0.00]
Games: 4090 W: 1501 L: 1378 D: 1211
Ptnml(0-2): 140, 342, 996, 389, 178
time/hard-and-soft-time
40.0+0.40
Elo: 43.22 +- 14.71 [0.00, 5.00]
Games: 1414 W: 561 L: 386 D: 467
Ptnml(0-2): 52, 116, 252, 179, 108
time/hard-and-soft-time
8.0+0.08
Elo: 27.49 +- 11.37 [0.00, 5.00]
Games: 2216 W: 859 L: 684 D: 673
Ptnml(0-2): 93, 185, 417, 280, 133
master
8.0+0.08
Elo: 23.11 +- 8.35 (95%) [N=4096]
Games: 4110 W: 1582 L: 1309 D: 1219
Ptnml(0-2): 163, 382, 791, 457, 262
master
8.0+0.08
Elo: 24.78 +- 10.86 [0.00, 5.00]
Games: 2514 W: 968 L: 789 D: 757
Ptnml(0-2): 104, 238, 453, 299, 163
44978775595882E6
8.0+0.08
Elo: 13.39 +- 7.33 [0.00, 5.00]
Games: 4362 W: 1573 L: 1405 D: 1384
Ptnml(0-2): 144, 388, 1003, 448, 198
master
60.0+0.60
Elo: 1.02 +- 15.89 (95%) [N=1024]
Games: 1024 W: 333 L: 330 D: 361
Ptnml(0-2): 43, 111, 200, 116, 42
master *
8.0+0.08
Elo: 6.61 +- 8.50 (95%) [N=4096]
Games: 4102 W: 1457 L: 1379 D: 1266
Ptnml(0-2): 202, 422, 763, 424, 240
refactor/store-pieces-and-color-bitboards
8.0+0.08
Elo: 24.18 +- 10.44 [0.00, 5.00]
Games: 2432 W: 907 L: 738 D: 787
Ptnml(0-2): 83, 220, 500, 271, 142
debug/no-rfp-or-tt-or-nmp
8.0+0.08
Elo: 290.90 +- 50.00 [0.00, 5.00]
Games: 358 W: 299 L: 54 D: 5
Ptnml(0-2): 1, 0, 52, 5, 121
debug/no-rfp-or-tt-or-nmp
8.0+0.08
Elo: 272.55 +- 49.50 [0.00, 5.00]
Games: 380 W: 312 L: 63 D: 5
Ptnml(0-2): 3, 3, 54, 2, 128
debug/no-rfp-or-tt-or-nmp
8.0+0.08
Elo: 269.67 +- 48.81 [0.00, 5.00]
Games: 392 W: 319 L: 64 D: 9
Ptnml(0-2): 4, 3, 54, 4, 131
debug/no-rfp-or-tt-or-nmp
8.0+0.08
Elo: 249.50 +- 45.81 [0.00, 5.00]
Games: 432 W: 343 L: 77 D: 12
Ptnml(0-2): 8, 4, 57, 8, 139
debug/no-rfp-or-tt-or-nmp
8.0+0.08
Elo: 261.42 +- 49.95 [0.00, 5.00]
Games: 388 W: 315 L: 68 D: 5
Ptnml(0-2): 7, 1, 53, 4, 129
debug/no-rfp-or-tt-or-nmp
8.0+0.08
Elo: 293.84 +- 55.74 [0.00, 5.00]
Games: 376 W: 316 L: 57 D: 3
Ptnml(0-2): 6, 0, 45, 3, 134
debug/no-rfp-or-tt-or-nmp
8.0+0.08
Elo: 31.76 +- 13.38 [0.00, 5.00]
Games: 2304 W: 1240 L: 1030 D: 34
Ptnml(0-2): 197, 18, 618, 16, 303
only-try-good-see-moves-in-quiescence
8.0+0.08
Elo: 7.85 +- 5.45 [0.00, 5.00]
Games: 9514 W: 3440 L: 3225 D: 2849
Ptnml(0-2): 424, 984, 1835, 981, 533
search/collect-pv-during-search *
40.0+0.40
Elo: 17.92 +- 9.63 [-4.00, 1.00]
Games: 2814 W: 1038 L: 893 D: 883
Ptnml(0-2): 96, 277, 574, 306, 154
search/collect-pv-during-search
8.0+0.08
Elo: 15.19 +- 8.13 [0.00, 5.00]
Games: 4142 W: 1547 L: 1366 D: 1229
Ptnml(0-2): 171, 388, 832, 449, 231
simplify-try_push_killer
8.0+0.08
Elo: 3.89 +- 4.98 [-5.00, 0.00]
Games: 9106 W: 3349 L: 3247 D: 2510
Ptnml(0-2): 337, 772, 2279, 782, 383
search/aspiration-windows
8.0+0.08
Elo: 5.05 +- 3.93 [0.00, 5.00]
Games: 16520 W: 6113 L: 5873 D: 4534
Ptnml(0-2): 727, 1452, 3727, 1562, 792
tt/fail-soft-cuts
8.0+0.08
Elo: 1.45 +- 3.75 [-5.00, 0.00]
Games: 16248 W: 5929 L: 5861 D: 4458
Ptnml(0-2): 643, 1370, 4049, 1400, 662
return-best-eval-in-quiescence *
8.0+0.08
Elo: 5.25 +- 4.04 [0.00, 5.00]
Games: 16142 W: 5970 L: 5726 D: 4446
Ptnml(0-2): 754, 1380, 3621, 1500, 816