CodeSOTAβOriginal site ↗
← Under 1B

Same-base cohort / top 20 by downloads

What does fine-tuning change?

Compare derivatives of Qwen3.5-0.8B-Base against the original checkpoint: gains, regressions and cost within the same benchmark protocol.

The top 20 download-ranked repositories are frozen with the original base as control. Results appear only after real evaluation. Qwen3.5 uses an isolated evaluator. Full ARC-Easy is the first common text-capability comparison. Models without a compatible language-model head require another protocol and stay visible here.
Selected finetunes
20
Measured text systems
15 / 15
Base ARC-Easy
70.54%
Processing / queued
0 / 0

Compare measured results →

Pinned snapshot 2026-10-17T03:33:12.159677+00:00. Hub tensor totals can include duplicated tied weights. Above-1B metadata is a review flag; eligibility requires unique loaded-model parameter counts. Names and base-model tags do not establish size.

Measured comparison plots

Original base model · all benchmark results →

ARC-Easy

Ranked accuracy
Ranked accuracy · Download PNG · Download SVG
Difference from the original base
Difference from the original base · Download PNG · Download SVG
Score versus reserved GPU time
Score versus reserved GPU time · Download PNG · Download SVG

ARC-Challenge

Ranked accuracy
Ranked accuracy · Download PNG · Download SVG
Difference from the original base
Difference from the original base · Download PNG · Download SVG
Score versus reserved GPU time
Score versus reserved GPU time · Download PNG · Download SVG

Comparison campaign · next stages

ARC-Easy is one diagnostic, not an overall winner. Follow-up tests use the same pinned systems and keep each protocol separate. Six selected repositories still require a different runtime or task protocol. Instruction following, coding, language coverage and specialist tasks remain unmeasured for this cohort.

ARC-Challenge · full 1,172-question test

15 / 15 completed · 0 running · 0 queued

SystemExecutionAccuracy
Mapika/decider-0.8bcompleted46.76%
Qwen/Qwen3.5-0.8B-Basecompleted38.48%
unsloth/Qwen3.5-0.8B-Basecompleted38.48%
NamanAgnih0tri/AlphaRoute-0.8B-v1.5completed36.09%
mithulaartigala/reasoning-summarizer-qwen3.5-0.8b-previewcompleted34.90%
McGill-NLP/AfriqueQwen3.5-0.8B-50Langscompleted34.22%
Qwen/Qwen3.5-0.8Bcompleted33.28%
sh0ck0r/Qwen3.5-0.8B-hereticcompleted32.85%
ahmedeltawel/Qwen3.5-0.8B-hsb-dsbcompleted32.59%
Kewk/Heretical-Qwen3.5-0.8Bcompleted32.25%
cooperdk/BooruNL-0.8Bcompleted31.74%
mghafiri/qwen3.5-0.8B-decision-modelcompleted30.29%
SeerRay-Lab/Xiaomi-OCR-0completed27.13%
OmniJev/PlayJev-0.8Bcompleted24.74%
nineninesix/qwen3_5-full-attn-only-14completed21.42%

Top 20 + original base control · ARC-Easy

21 of 21 selected systems displayed. Download ranks are frozen at selection time. Parameter totals are metadata, not loaded-model verification. Model-card claims remain separate from execution evidence.

Download rankModel / revisionDownloadsDeclared taskParameters / basisExecutionARC-EasyΔ base
BaseQwen/Qwen3.5-0.8B-Base
dc7cdfe2ee41
Controlbase control853.0M
Loaded unique parameter count
completed70.54%+0.00 pp
1Qwen/Qwen3.5-0.8B
2fc06364715b
Card: posttrained_general
2,953,503image-text-to-text853.0M
Loaded unique parameter count
completed65.87%-4.67 pp
2Mapika/decider-0.8b
a0a01d6f8135
Card: decision_specialist
15,776text-classification752.4M
Loaded unique parameter count
completed75.76%+5.22 pp
3iapp/OpenThai-SystemOne
dc67b0295ab7
Card: custom_decision_head
11,505zero-shot-classification752.7M
Below 1B in Hub metadata
different protocol required——
4SeerRay-Lab/Xiaomi-OCR-0
ff990be318c4
Card: ocr_specialist
6,327image-text-to-text853.0M
Loaded unique parameter count
completed56.52%-14.02 pp
5unsloth/Qwen3.5-0.8B-Base
44bc982576bf
Card: base_redistribution
5,550image-text-to-text853.0M
Loaded unique parameter count
completed70.50%-0.04 pp
6nineninesix/qwen3_5-full-attn-only-14
a26dff91d90e
Card: architecture_rebuild
3,633unspecified511.2M
Loaded unique parameter count
completed25.00%-45.54 pp
7OmniJev/PlayJev-0.8B
a7348002b1e1
Card: game_decision_specialist
1,322image-text-to-text853.0M
Loaded unique parameter count
completed27.57%-42.97 pp
8mlx-community/Qwen3.5-0.8B-bf16
3067585164db
Card: mlx_conversion
930image-text-to-text853.0M
Below 1B in Hub metadata
different protocol required——
9djinn-san/QSIV
ba99bd489cf6
Card: custom_decision_runtime
810unspecified752.4M
Below 1B in Hub metadata
different protocol required——
10FastFlowLM/Qwen3.5-0.8B-NPU2
04c06293f173
Card: npu_conversion
529image-text-to-textUnknown
Size requires verification
different protocol required——
11mithulaartigala/reasoning-summarizer-qwen3.5-0.8b-preview
558fc651bf01
Card: summarization_specialist
466text-generation752.4M
Loaded unique parameter count
completed66.92%-3.62 pp
12sh0ck0r/Qwen3.5-0.8B-heretic
fb35b60374fc
Card: abliterated_posttrained
386image-text-to-text853.0M
Loaded unique parameter count
completed65.19%-5.35 pp
13McGill-NLP/AfriqueQwen3.5-0.8B-50Langs
f49099d79e51
Card: multilingual_cpt
363text-generation853.0M
Loaded unique parameter count
completed67.68%-2.86 pp
14ahmedeltawel/Qwen3.5-0.8B-hsb-dsb
7e781a3e9704
Card: translation_specialist
270text-generation752.4M
Loaded unique parameter count
completed63.59%-6.94 pp
15kaptaan45/QaptaanLM-0.75B
d0055d68749d
Card: custom_code_cpt
224text-generation752.4M
Below 1B in Hub metadata
needs adapter——
16Kewk/Heretical-Qwen3.5-0.8B
c16807de35d1
Card: abliterated_posttrained
192image-text-to-text853.0M
Loaded unique parameter count
completed65.74%-4.80 pp
17cooperdk/BooruNL-0.8B
14dbcf2e009f
Card: tag_generation_specialist
188text-generation853.0M
Loaded unique parameter count
completed63.09%-7.45 pp
18Rebine/Etsu-Embedding-0.8B
81ec0e2a88d6
Card: embedding_specialist
174feature-extraction752.4M
Below 1B in Hub metadata
different protocol required——
19mghafiri/qwen3.5-0.8B-decision-model
4a9939034a27
Card: decision_specialist
169text-classification752.4M
Loaded unique parameter count
completed48.99%-21.55 pp
20NamanAgnih0tri/AlphaRoute-0.8B-v1.5
ef87d71f1105
Card: routing_json_specialist
154text-generation752.4M
Loaded unique parameter count
completed69.61%-0.93 pp

Rank measured results → · Cohort JSON → · Upstream catalogue ↗ · CodeSOTA ontology →

Protocols, tracks and ontology

One lineage, several tracks.

Text generation, OCR/vision and classification need separate task protocols. Format conversions and quantized copies should be grouped with their source checkpoint; changed architectures belong in a separate comparison. A declared base-model tag is evidence of lineage, not proof of identical architecture or training.

Compare gains, not just rank.

Report each benchmark score and its difference from the base control, paired uncertainty, regressions, throughput and GPU-slot time. With almost identical model sizes, score versus latency and per-task gain charts are more useful than a crowded parameter-size scatter plot. The first measurement is all 2,376 ARC-Easy test questions, raw summed answer likelihood, no chat template or images. This measures text capability of OCR/vision specialists, not their OCR quality. Charts will appear after compatible results exist.

Keep the evaluation controlled.

Pin model revisions and item IDs. Use a common completion protocol for base capability; evaluate chat-native behaviour separately with explicit templates, thinking settings and equal token budgets. Count reasoning tokens inside generation budgets. Full cheap tests can run directly; adaptive estimates for expensive tests need calibration and a distinct protocol, followed by fixed-set confirmation.

How it fits the ontology

A cohort groups pinned System versions by declared lineage. Tasks and Benchmarks define what is measured; Result links a System to a fixed Protocol. A card claim is reported evidence, not a CodeSOTA measurement.