best model by language
Benchmarked on the FLEURS test split at Q8_0. Error is WER — lower is better. Speed is × realtime on Handy target hardware.
accuracy vs speed
Macedonian · 10 models
AMD Ryzen 4750U GPU (Vulkan)
pareto frontier (no model is both faster and more accurate) other models
highlighted rows are recommended picks or on pareto frontier
| | | | | | |
| 1 | whisper-large-v3 | 15.09 | 2.0× | 1.0× | 1.55 GB | Apache-2.0 |
| 2 | whisper-large-v3-turboaccurate pick | 17.85 | 3.1× | 1.4× | 0.83 GB | Apache-2.0 |
| 3 | Qwen3-ASR-1.7Boverall pickfast pick | 18.22 | 4.1× | 2.5× | 2.04 GB | Apache-2.0 |
| 4 | whisper-large-v2 | 18.76 | 2.0× | 1.0× | 1.55 GB | Apache-2.0 |
| 5 | whisper-large | 22.81 | 2.0× | 1.0× | 1.55 GB | Apache-2.0 |
| 6 | whisper-medium | 24.75 | 4.1× | 1.9× | 0.77 GB | Apache-2.0 |
| 7 | Qwen3-ASR-0.6B | 35.09 | 9.7× | 5.3× | 0.79 GB | Apache-2.0 |
| 8 | whisper-small | 41.53 | 11.7× | 5.9× | 0.25 GB | Apache-2.0 |
| 9 | whisper-base | 63.95 | 29.0× | 19.3× | 0.08 GB | Apache-2.0 |
| 10 | whisper-tiny | 78.61 | 43.1× | 39.8× | 0.04 GB | Apache-2.0 |