Completed / CodeSOTA execution on White

Inspect the measurement.

Qwen/Qwen2.5-0.5B · CommonsenseQA (validation) · 43.8% accuracy

32-example subset · 32 scored examples. Pilot subset, CodeSOTA batched-v2 execution. Separate scope from serial v1; unchanged prompt/tokenization/metric contracts.

Run ID / completed

34e846dc3d7bd71b87d6f19d
17 Oct 2026, 15:42 UTC

Model revision

060db6499f32faf8b98477b0a26969ef7d8b9987

Comparison scope

f0998ace0736b4da3a3e3949ec0597035cf98f4c1796febce8344e4f727cc90a

Evaluator SHA-256

bc899fb160f6881408863cd8bcdf96102dd6d8b10559a5f781a8cd816103da77

Observed resources

1s elapsed · 0.97 GiB peak torch allocation
Dollar cost: not measured

Download evidence

result.json samples.jsonl environment.json evaluate.py manifest.json

Inspect individual examples

Read the recorded prediction, reference and outcome for each example.

Scored examples: 32
Passed: 14
Failed: 18
Metric: accuracy

Examples are downloaded only when requested. Search covers all loaded records; 25 examples are displayed per page. Download all examples · JSONL

Example evidence has not been loaded.