Completed / CodeSOTA execution on White
Inspect the measurement.
Qwen/Qwen2.5-VL-3B-Instruct · OCRBench v1 / full serial reference · 81.3% accuracy
Full benchmark split · 1000 scored examples. All 1,000 OCRBench v1 questions. Upstream answer-containment scoring; response verbosity can game this metric. Separate visual-text QA protocol, not document parsing/layout or table reconstruction. Image/decoding budgets and model chat template are CodeSOTA-pinned, not a claim of vendor inference parity.
Run ID / completed
32dde2b675d08afa871097ec
18 Oct 2026, 18:32 UTC
18 Oct 2026, 18:32 UTC
Model revision
66285546d2b821cf421d4f5eb2576359d3770cd3Comparison scope
dcccfe2d1c65816985fdcc2bb76bfad20fcc76719fc61e7a4fd8a82df9ec1d29Evaluator SHA-256
50e622b9a313b1ee83d79c785095f871b4e136fedc03ef0a73e48ac22c46cce5Observed resources
680s elapsed · 10.03 GiB peak torch allocation
Dollar cost: not measured
Dollar cost: not measured
Download evidence
Inspect individual examples
Read the recorded prediction, reference and outcome for each example.
- Scored examples
- 1,000
- Passed
- 813
- Failed
- 187
- Metric
- accuracy
Examples are downloaded only when requested. Search covers all loaded records; 25 examples are displayed per page. Download all examples · JSONL
Example evidence has not been loaded.