model detail

Where this model stands against the best model in each language at Q8_0, its speed on an AMD Ryzen 4750U laptop, and what the card says. Add a second model to compare them head to head.

model canary-1b
AMD 4750U GPU9.8×
AMD 4750U CPU6.5×
Q8_0 size1.08 GB
frontier · AMD 4750U GPU0 of 4

verdict: Never first, and outside the leader's 95% CI in all 4 languages. Weakest relative to the field in Spanish (2.3× the leader's error), German (2.0×), and French (1.9×). Faster than realtime on the AMD 4750U GPU (9.8×) and AMD 4750U CPU (6.5×).

license: CC-BY-NC-4.0 · card languages: 4 · translate

standing by language · 4 benchmarked

Each bar compares this model with the best other model in that language, on a log scale: left of center it is ahead, right of center behind, and the other model is named on the row. The two error rates use the legend colors: this model first, the other model second. Faded bars are ties, where the 95% confidence intervals overlap. Sorted strongest standing first. Hover a row for full details.

canary-1b error best other model error tie: the 95% CIs overlap

quantization · 4 usable languages at Q5_K_M

Q5_K_M is within noise on every one of 4 usable languages: 72% of the Q8_0 file for no measurable accuracy cost.

Q5_K_M file72% of Q8_00.78 GB against 1.08 GB
median error change+0.5%over 4 usable languages
measurably worse0 of 4above the Q8_0 95% confidence interval
worst usable languageGerman6.45 → 6.53 (+0.08 pts)
measurably worse than Q8_0: above its 95% confidence interval within noise typical noise of one measurement
per-language numbers (4)
German 6.455.83–7.08 6.53+0.08 +1.2%
English 4.444.00–4.89 4.48+0.04 +0.9%
French 7.446.79–8.13 7.44+0.00 +0.0%
Spanish 6.065.52–6.66 5.99−0.07 −1.2%

speed · all 73 models on the AMD 4750U GPU

× realtime, log scale. Left of the realtime marker, transcribing takes longer than the recording. Hover a dot for the model.

compare with

canary-180m-flashsame familycanary-1b-flashsame familycanary-1b-v2same familycanary-qwen-2.5bsame familyVoxtral-Small-24B-2507ahead of it in 4 of 4 shared languagesgranite-speech-4.1-2b-narclosest coverage, 4 languages in common