CodeSOTAβOriginal site ↗
← All tasks

Documents / IAM lines

Handwriting recognition

Handwritten line image → text

Model size vs score

Model size versus cermicrosoft/trocr-small-handwritten: 61.60 million parameters; score 5.9%. All points use the same pinned protocol.00%1421%2842%4363%5784%71105%microsoft/trocr-small-handwritten · 61.60M parameters · 5.9%Model parameters (millions)cer · lower is better

1 compatible measurements. Parameter counts come from the architecture instantiated from each pinned model configuration; no weights are loaded for this count. Click a point to inspect its evidence.

Measured results

Pilot comparison · first 32 valid examples · cer lower is better. No global SOTA claim.

SystemScoreSamplesElapsed¹Evidence
microsoft/trocr-small-handwritten
b4648cfa1719
5.9%328sInspect run →
16 Oct 2026, 23:22 UTC

¹ Evaluation elapsed time includes model loading after dataset selection. It is not serving latency or a fair speed comparison.

What this measures

Benchmark origin
Dataset / split
Immutable dataset revision
fbdad97500ce54635c0d1ba306bf535cb40656cf
Upstream license metadata
mit · consult upstream terms
Protocol
codesota-pilot-v1 / ocr
Selection
First 32 valid examples in the pinned split order. SNLI rows without a valid label are excluded.
Configuration
Seed 42. Greedy generation for math and code. Mean answer-token log likelihood for text classification, completion and declarative multiple-choice recipes. No model judge.
Read scoring and comparison rules →

Planned runs

0 qualified visits in 30 days · priority 35.1. Interest changes execution order, within the approved baseline list.

SystemStatus
microsoft/trocr-small-handwrittencompleted