Completed / CodeSOTA execution on White
Inspect the measurement.
McGill-NLP/AfriqueQwen3.5-0.8B-50Langs · ARC-Easy / Qwen3.5 same-base cohort · 67.7% accuracy
Full benchmark split · 2376 scored examples. Full raw-accuracy text-only diagnostic for a same-base Qwen3.5 cohort. Stock trusted model classes, no chat or images; generic text scores do not validate specialist OCR/classification/retrieval uses. Unique total/text/vision parameters measured after loading; source-reported metrics are not imported.
Run ID / completed
5bbe24be9bf8dff49b0ed176
17 Oct 2026, 03:49 UTC
17 Oct 2026, 03:49 UTC
Model revision
f49099d79e51bbb783fae622877c4c3415142c82Comparison scope
84fe51c6790b19376ad4a234c742b80e0f73e3eb0d6a7257d48e5315d6a7c078Evaluator SHA-256
18c73508df97c7b2334e8d47512c9f06edeccf9d2119d42826f8648a7b114303Observed resources
119s elapsed · 3.90 GiB peak torch allocation
Dollar cost: not measured
Dollar cost: not measured
Download evidence
Inspect individual examples
Read the recorded prediction, reference and outcome for each example.
- Scored examples
- 2,376
- Passed
- 1,608
- Failed
- 768
- Metric
- accuracy
Examples are downloaded only when requested. Search covers all loaded records; 25 examples are displayed per page. Download all examples · JSONL
Example evidence has not been loaded.