Language / BoolQ
Reading comprehension
Passage + question → yes / no
Model size vs score
Green uses cohort medians, not a universal quality threshold. Frontier points have no measured alternative with both smaller model size and higher score. Lines connect observed points; they do not predict intermediate models. Uncertainty is not included in frontier membership.
2 compatible measurements. Parameter counts come from the architecture instantiated from each pinned model configuration; no weights are loaded for this count. Click a point to inspect its evidence.
Measured results
Pilot comparison · first 32 valid examples · accuracy higher is better. No global SOTA claim.
| System | Score | Samples | Elapsed¹ | Evidence |
|---|---|---|---|---|
| Qwen/Qwen2.5-0.5B 060db6499f32 | 68.8% | 32 | 1s | Inspect run → 17 Oct 2026, 00:49 UTC |
| Qwen/Qwen2.5-1.5B 8faed761d45a | 68.8% | 32 | 2s | Inspect run → 17 Oct 2026, 00:48 UTC |
¹ Evaluation elapsed time includes model loading after dataset selection. It is not serving latency or a fair speed comparison.
What this measures
35b264d03638db9f4ce671b711558bf7ff0f80d5Planned runs
0 qualified visits in 30 days · priority 0.0. Interest changes execution order, within the approved baseline list.
| System | Status |
|---|---|
| Qwen/Qwen2.5-1.5B | completed |
| Qwen/Qwen2.5-0.5B | completed |