Independent measured model card
mithulaartigala/reasoning-summarizer-qwen3.5-0.8b-preview
Hugging Face source ↗ · JSON for agents
752.4M unique parameters (558fc651bf01)
Every result links to its execution evidence. Compare scores only within matching protocols; no overall best-model claim. GPU-slot time includes evaluator setup and CPU work.
All current benchmark results
| Benchmark / coverage | Result | Version / protocol | GPU-slot time | Evidence |
|---|---|---|---|---|
| ARC-Challenge / Qwen3.5 same-base cohort full · 1,172 items | 34.90% accuracy · max | 558fc651bf01codesota-qwen35-arc-challenge-v1 | 33.2s | Inspect run · Manifest |
| ARC-Easy / Qwen3.5 same-base cohort full · 2,376 items | 66.92% accuracy · max | 558fc651bf01codesota-qwen35-arc-easy-v1 | 92.3s | Inspect run · Manifest |