Documents / IAM lines / 256-line subset
Handwriting recognition / 256-line comparison
Handwritten line image → text
Model size vs score
Static, watermarked figures. SlayerLab models are red. The close-up expands the crowded small-model cluster without changing any coordinates.
Measured results
Pilot comparison · 256 examples · cer lower is better. No global SOTA claim.
| System | Score | Samples | Elapsed¹ | Evidence |
|---|---|---|---|---|
| microsoft/trocr-large-handwritten e68501f437cd | 4.0% | 256 | 83s | Inspect run → 17 Oct 2026, 03:34 UTC |
| microsoft/trocr-base-handwritten eaacaf452b06 | 4.9% | 256 | 39s | Inspect run → 17 Oct 2026, 03:32 UTC |
| microsoft/trocr-small-handwritten b4648cfa1719 | 6.2% | 256 | 11s | Inspect run → 17 Oct 2026, 03:18 UTC |
¹ Evaluation elapsed time includes model loading after dataset selection. It is not serving latency or a fair speed comparison.
What this measures
Benchmark origin
Dataset / split
Teklia/IAM-line / test
Immutable dataset revision
fbdad97500ce54635c0d1ba306bf535cb40656cfUpstream license metadata
mit · consult upstream terms
Protocol
codesota-ocr-lines-v1 / ocr
Selection
First 256 valid examples in the pinned split order. SNLI rows without a valid label are excluded.
Configuration
Seed 42. Greedy generation for math and code. Mean answer-token log likelihood for text classification, completion and declarative multiple-choice recipes. No model judge.
Planned runs
0 qualified visits in 30 days · priority 35.0. Interest changes execution order, within the approved baseline list.
| System | Status |
|---|---|
| microsoft/trocr-small-handwritten | completed |
| microsoft/trocr-base-handwritten | completed |
| microsoft/trocr-large-handwritten | completed |