CodeSOTAβOriginal site ↗
← Qwen3.5 0.8B cohort / full ARC-Easy

Completed / CodeSOTA execution on White

Inspect the measurement.

ahmedeltawel/Qwen3.5-0.8B-hsb-dsb · ARC-Easy / Qwen3.5 same-base cohort · 63.6% accuracy

Full benchmark split · 2376 scored examples. Full raw-accuracy text-only diagnostic for a same-base Qwen3.5 cohort. Stock trusted model classes, no chat or images; generic text scores do not validate specialist OCR/classification/retrieval uses. Unique total/text/vision parameters measured after loading; source-reported metrics are not imported.
Run ID / completed
8400f70711b8e59ffcf9ecf7
17 Oct 2026, 03:53 UTC
Model revision
7e781a3e970474d3fcb215ec0d3c5832e1131b9f
Comparison scope
84fe51c6790b19376ad4a234c742b80e0f73e3eb0d6a7257d48e5315d6a7c078
Evaluator SHA-256
18c73508df97c7b2334e8d47512c9f06edeccf9d2119d42826f8648a7b114303
Observed resources
83s elapsed · 3.53 GiB peak torch allocation
Dollar cost: not measured

Download evidence

Inspect individual examples

Read the recorded prediction, reference and outcome for each example.

Scored examples
2,376
Passed
1,511
Failed
865
Metric
accuracy

Examples are downloaded only when requested. Search covers all loaded records; 25 examples are displayed per page. Download all examples · JSONL

Example evidence has not been loaded.