model detail

Where this model stands against the best model in each language at Q8_0, its speed on an AMD Ryzen 4750U laptop, and what the card says. Add a second model to compare them head to head.

model whisper-large-v3
AMD 4750U GPU2.0×
AMD 4750U CPU1.0×
Q8_0 size1.55 GB
frontier · AMD 4750U GPU40 of 83

verdict: Best in 36 of 83 languages, and tied with the leader in 17 more (overlapping 95% CIs). Weakest relative to the field in Maltese (4.0× the leader's error), Cantonese (CER) (3.6×), and Hindi (2.3×). Fast enough for realtime on the AMD 4750U GPU (2.0×), not on the AMD 4750U CPU (1.0×).

license: Apache-2.0 · card languages: 103 · translatelang detecttimestamps (segment)

standing by language · 83 benchmarked

Each bar compares this model with the best other model in that language, on a log scale: left of center it is ahead, right of center behind, and the other model is named on the row. The two error rates use the legend colors: this model first, the other model second. Faded bars are ties, where the 95% confidence intervals overlap. Sorted strongest standing first. Hover a row for full details.

whisper-large-v3 error best other model error tie: the 95% CIs overlap

quantization · 46 usable languages at Q5_K_M

Q5_K_M is within noise on every one of 46 usable languages: 70% of the Q8_0 file for no measurable accuracy cost.

Q5_K_M file70% of Q8_01.08 GB against 1.55 GB
median error change+0.6%over 46 usable languages
measurably worse0 of 46above the Q8_0 95% confidence interval
worst usable languageSwedish7.80 → 8.01 (+0.21 pts)
measurably worse than Q8_0: above its 95% confidence interval within noise typical noise of one measurement
per-language numbers (46 usable, 36 more at 30% or worse)
Swedish 7.807.22–8.37 8.01+0.21 +2.7%
Greek 11.5310.70–12.34 11.71+0.18 +1.6%
Finnish 7.737.12–8.32 7.85+0.12 +1.6%
German 4.133.74–4.51 4.19+0.06 +1.5%
Hungarian 13.4012.72–14.14 13.59+0.19 +1.4%
Azerbaijani 21.1020.13–22.06 21.38+0.28 +1.3%
Vietnamese 8.748.12–9.46 8.85+0.11 +1.3%
Thai (CER) 8.788.10–9.55 8.88+0.10 +1.1%
Arabic 14.9213.55–16.39 15.07+0.15 +1.0%
Indonesian 6.085.48–6.67 6.14+0.06 +1.0%
Ukrainian 6.285.74–6.83 6.34+0.06 +1.0%
Slovenian 19.1518.25–20.02 19.33+0.18 +0.9%
Latvian 19.2118.35–20.07 19.38+0.17 +0.9%
Hindi 17.0615.97–18.29 17.21+0.15 +0.9%
Macedonian 15.0914.29–15.89 15.21+0.12 +0.8%
Malay 7.597.04–8.19 7.65+0.06 +0.8%
English 4.033.59–4.46 4.06+0.03 +0.7%
Galician 13.2712.74–13.87 13.36+0.09 +0.7%
Romanian 9.208.56–9.85 9.26+0.06 +0.7%
Polish 4.694.15–5.26 4.72+0.03 +0.6%
Turkish 6.515.90–7.13 6.55+0.04 +0.6%
Czech 10.509.79–11.22 10.56+0.06 +0.6%
Danish 12.4811.78–13.16 12.55+0.07 +0.6%
Dutch 5.424.81–6.07 5.45+0.03 +0.6%
Croatian 10.9410.34–11.55 11.00+0.06 +0.5%
Bulgarian 12.8212.00–13.63 12.88+0.06 +0.5%
Spanish 2.702.41–3.01 2.71+0.01 +0.4%
Estonian 18.3017.41–19.25 18.31+0.01 +0.1%
Hebrew 26.7325.10–28.27 26.74+0.01 +0.0%
Cantonese (CER) 22.0620.16–24.13 22.06+0.00 +0.0%
Japanese (CER) 4.814.25–5.61 4.81+0.00 +0.0%
Urdu 21.7520.42–23.08 21.72−0.03 −0.1%
Lithuanian 24.5523.68–25.41 24.49−0.06 −0.2%
Bosnian 13.5012.80–14.17 13.46−0.04 −0.3%
Slovak 9.258.57–10.01 9.22−0.03 −0.3%
French 5.394.88–5.94 5.37−0.02 −0.4%
Tamil 20.0418.55–21.85 19.92−0.12 −0.6%
Filipino 11.8211.17–12.51 11.73−0.09 −0.8%
Portuguese 3.883.45–4.37 3.85−0.03 −0.8%
Norwegian Bokmal 8.197.34–9.09 8.12−0.07 −0.9%
Korean (CER) 4.893.93–5.90 4.84−0.05 −1.0%
Italian 2.542.16–2.98 2.51−0.03 −1.2%
Russian 4.964.51–5.41 4.90−0.06 −1.2%
Mandarin Chinese (CER) 7.987.12–8.82 7.84−0.14 −1.8%
Catalan 4.974.52–5.44 4.87−0.10 −2.0%
Serbian 28.4925.44–31.46 27.55−0.94 −3.3%

speed · all 73 models on the AMD 4750U GPU

× realtime, log scale. Left of the realtime marker, transcribing takes longer than the recording. Hover a dot for the model.

compare with

whisper-large-v3-turbosame familywhisper-basesame familywhisper-largesame familywhisper-large-v2same familycanary-1b-v2ahead of it in 13 of 25 shared languageswhisper-mediumclosest coverage, 82 languages in common