CodeSOTAβOriginal site ↗
← OpenBookQA / sub-1B cohort

Completed / CodeSOTA execution on White

Inspect the measurement.

SlayerLab/Slayer139-1.01b · OpenBookQA · 25.0% accuracy

32-example subset · 32 scored examples. Sub-1B 32-example pilot; FP32, 1024-token input ceiling, mean answer-token log likelihood. Native masked-padding adapter uses unpadded row forwards. Compare only this cohort protocol.
Run ID / completed
1a93c5498bda553a7673f19c
17 Oct 2026, 02:46 UTC
Model revision
283ffb6d620be2d6ea1f2429d721962dc8e73633
Comparison scope
14346d6c23a8cd6b6720f20dbe91c6ebdbfbb7721023028eb9705c7ca8a51fa7
Evaluator SHA-256
5011da874931804d8f5159762d18d33b71feb02044d808b106cca5da28178509
Observed resources
2s elapsed · 0.62 GiB peak torch allocation
Dollar cost: not measured

Download evidence

Inspect individual examples

Read the recorded prediction, reference and outcome for each example.

Scored examples
32
Passed
8
Failed
24
Metric
accuracy

Examples are downloaded only when requested. Search covers all loaded records; 25 examples are displayed per page. Download all examples · JSONL

Example evidence has not been loaded.