CodeSOTAβOriginal site ↗
← Sentence similarity

Completed / CodeSOTA execution on White

Inspect the measurement.

sentence-transformers/all-MiniLM-L6-v2 · STS Benchmark · 0.924 spearman

32-example pilot. Pilot subset, custom CodeSOTA protocol. Not an official full-benchmark score.
Run ID / completed
f8dd3623ae6e8786284a6ca8
16 Oct 2026, 23:28 UTC
Model revision
1110a243fdf4706b3f48f1d95db1a4f5529b4d41
Comparison scope
5048133e477a3c13bf97c614b99b2d36a458391bb2a9480cd9b38189f2608b67
Evaluator SHA-256
a71a6c0fe0c3cc3f1694659595be1112cfc36eb190be5ff6e0a3380105415b3e
Observed resources
1s elapsed · 0.10 GiB peak torch allocation
Dollar cost: not measured

Download evidence

Example-level outputs

All 32 scored examples. Ground truth and model predictions are preserved in the downloadable JSONL.

{"id":"0","prediction":0.8052218556404114,"reference":0.5,"score":null}
{"id":"1","prediction":0.7886252403259277,"reference":0.72,"score":null}
{"id":"2","prediction":0.9464933276176453,"reference":1.0,"score":null}
{"id":"3","prediction":0.8820433020591736,"reference":0.84,"score":null}
{"id":"4","prediction":0.35561564564704895,"reference":0.3,"score":null}
{"id":"5","prediction":0.5016928315162659,"reference":0.36,"score":null}
{"id":"6","prediction":0.8074240684509277,"reference":0.7,"score":null}
{"id":"7","prediction":0.47569549083709717,"reference":0.44,"score":null}
{"id":"8","prediction":0.6181700825691223,"reference":0.44,"score":null}
{"id":"9","prediction":0.5095633268356323,"reference":0.34,"score":null}
{"id":"10","prediction":0.5095633268356323,"reference":0.34,"score":null}
{"id":"11","prediction":0.9795020818710327,"reference":1.0,"score":null}
{"id":"12","prediction":0.3421443998813629,"reference":0.12,"score":null}
{"id":"13","prediction":0.8238354921340942,"reference":0.88,"score":null}
{"id":"14","prediction":0.5629169940948486,"reference":0.4,"score":null}
{"id":"15","prediction":0.4957501292228699,"reference":0.36,"score":null}
{"id":"16","prediction":0.8535977602005005,"reference":0.88,"score":null}
{"id":"17","prediction":0.8011806011199951,"reference":0.72,"score":null}
{"id":"18","prediction":0.7305929660797119,"reference":0.72,"score":null}
{"id":"19","prediction":0.30283892154693604,"reference":0.24,"score":null}
{"id":"20","prediction":0.4801802635192871,"reference":0.48,"score":null}
{"id":"21","prediction":0.32566219568252563,"reference":0.04,"score":null}
{"id":"22","prediction":0.9563935995101929,"reference":0.84,"score":null}
{"id":"23","prediction":0.892871081829071,"reference":0.88,"score":null}
{"id":"24","prediction":0.5132962465286255,"reference":0.45,"score":null}
{"id":"25","prediction":0.7003101110458374,"reference":0.4,"score":null}
{"id":"26","prediction":0.14424359798431396,"reference":0.15,"score":null}
{"id":"27","prediction":0.767790675163269,"reference":0.44,"score":null}
{"id":"28","prediction":0.31624501943588257,"reference":0.16,"score":null}
{"id":"29","prediction":0.6633334159851074,"reference":0.44,"score":null}
{"id":"30","prediction":0.7729637026786804,"reference":0.64,"score":null}
{"id":"31","prediction":0.86524498462677,"reference":0.96,"score":null}