Completed / CodeSOTA execution on White
Inspect the measurement.
NamanAgnih0tri/AlphaRoute-0.8B-v1.5 · ARC-Challenge / Qwen3.5 same-base cohort · 36.1% accuracy
Full benchmark split · 1172 scored examples. Full raw-accuracy text-only diagnostic for a same-base Qwen3.5 cohort. Stock trusted model classes, no chat or images; generic text scores do not validate specialist OCR/classification/retrieval uses. Unique total/text/vision parameters measured after loading; source-reported metrics are not imported.
Run ID / completed
3a8d7c60e2066a56464fef3a
17 Oct 2026, 04:43 UTC
17 Oct 2026, 04:43 UTC
Model revision
ef87d71f1105f47a15d0d290ee000bcfc0ed68c0Comparison scope
8877f1f73ee0a3c138937e07b7f6ca917f2c1d914d223e6a8ffa42b9ac8f0a47Evaluator SHA-256
bd025b3fd12a0b84102a8713ca2af2d08bf6f16178dcaac6fce4a1e720bf1f4cObserved resources
31s elapsed · 3.83 GiB peak torch allocation
Dollar cost: not measured
Dollar cost: not measured
Download evidence
Inspect individual examples
Read the recorded prediction, reference and outcome for each example.
- Scored examples
- 1,172
- Passed
- 423
- Failed
- 749
- Metric
- accuracy
Examples are downloaded only when requested. Search covers all loaded records; 25 examples are displayed per page. Download all examples · JSONL
Example evidence has not been loaded.