handy models

speech-to-text benchmarks for transcribe.cpp, the engine behind Handy

best model by language

Benchmarked on the FLEURS test split at Q8_0. Error is WER — lower is better. Speed is × realtime on Handy target hardware.

accuracy vs speed

German · 27 models

AMD Ryzen 4750U GPU (Vulkan)
pareto frontier (no model is both faster and more accurate) other models
highlighted rows are recommended picks or on pareto frontier
1 Voxtral-Small-24B-2507 3.29 — — 24.04 GB Apache-2.0
2 whisper-large-v3 4.13 2.0× 1.0× 1.55 GB Apache-2.0
3 Voxtral-Mini-4B-Realtime-2602 4.24 0.8× 0.6× 4.41 GB Apache-2.0
4 Qwen3-ASR-1.7Baccurate pick 4.25 4.1× 2.5× 2.04 GB Apache-2.0
5 canary-1b-v2!overall pickfast pick 4.46 14.1× 8.3× 1.07 GB CC-BY-4.0
6 whisper-large-v2 4.53 2.0× 1.0× 1.55 GB Apache-2.0
7 whisper-large-v3-turbo 4.54 3.1× 1.4× 0.83 GB Apache-2.0
8 parakeet-ultra 4.58 23.0× 13.3× 0.69 GB CC-BY-4.0
9 Voxtral-Mini-3B-2507 4.71 1.1× 0.6× 4.66 GB Apache-2.0
10 whisper-large 5.04 2.0× 1.0× 1.55 GB Apache-2.0
11 cohere-transcribe-03-2026! 5.06 8.1× 4.3× 2.25 GB Apache-2.0
12 parakeet-tdt-0.6b-v3 5.24 25.1× 13.7× 0.69 GB CC-BY-4.0
13 orukeet 5.64 25.1× 13.6× 0.69 GB CC-BY-SA-4.0
14 parakeet-primeline 5.98 25.0× 13.6× 0.69 GB CC-BY-4.0
15 granite-speech-4.1-2b-nar! 6.07 4.0× 2.1× 2.33 GB Apache-2.0
16 canary-1b-flash! 6.13 15.5× 8.8× 0.98 GB CC-BY-4.0
17 whisper-medium 6.23 4.1× 1.9× 0.77 GB Apache-2.0
18 granite-speech-4.1-2b! 6.25 4.6× 2.8× 2.38 GB Apache-2.0
19 canary-1b! 6.45 9.8× 6.5× 1.08 GB CC-BY-NC-4.0
20 Qwen3-ASR-0.6B 6.80 9.7× 5.3× 0.79 GB Apache-2.0
21 granite-4.0-1b-speech! 7.29 4.6× 2.8× 2.38 GB Apache-2.0
22 canary-180m-flash! 7.33 33.1× 21.7× 0.20 GB CC-BY-4.0
23 granite-speech-4.1-2b-plus! 8.06 4.6× 2.6× 2.18 GB Apache-2.0
24 whisper-small 9.86 11.7× 5.9× 0.25 GB Apache-2.0
25 nemotron-3.5-asr-streaming-0.6b 10.33 17.1× 10.6× 0.70 GB OpenMDW-1.1
26 whisper-base 19.69 29.0× 19.3× 0.08 GB Apache-2.0
27 whisper-tiny 31.56 43.1× 39.8× 0.04 GB Apache-2.0