Completed / CodeSOTA execution on White

Inspect the measurement.

SlayerLab/Slayer149-Balanced-ARC-E-ft-v2 · ARC-Challenge · 25.0% accuracy

32-example subset · 32 scored examples. Sub-1B 32-example pilot; FP32, 1024-token input ceiling, mean answer-token log likelihood. Native masked-padding adapter uses unpadded row forwards. Compare only this cohort protocol.

Run ID / completed

94a2a3354da20599aafb07f3
17 Oct 2026, 02:48 UTC

Model revision

7d11e8fd63764baf00c276f586b2aa776648ed33

Comparison scope

e14efec58a56b426d1075a48d781531cc86194c0ae545ccae25ab8c742c4cdfa

Evaluator SHA-256

5011da874931804d8f5159762d18d33b71feb02044d808b106cca5da28178509

Observed resources

2s elapsed · 0.74 GiB peak torch allocation
Dollar cost: not measured

Download evidence

result.json samples.jsonl environment.json evaluate.py manifest.json

Inspect individual examples

Read the recorded prediction, reference and outcome for each example.

Scored examples: 32
Passed: 8
Failed: 24
Metric: accuracy

Examples are downloaded only when requested. Search covers all loaded records; 25 examples are displayed per page. Download all examples · JSONL

Example evidence has not been loaded.