Where do speech models get it wrong?

Below are 20 spoken Amharic sentences. Each row shows how many words each model got wrong on that sentence. Click any model badge to see the color-coded mistakes.

No machine-learning background needed — the detail page shows what the person actually said and what the model wrote down.

Dataset Signal conditions Overall scores Gender gap

Examples
Same sentences are used across every model and noise condition, so comparisons are fair.
Example 1 19 words · Speaker: Female
ሲ ሲ ቲ ሁለት ዜሮ ሁለት አምስት አንድ ሁለት አንድ ሰባት ሁለት አራት ሰባት ስምንት ዜሮ ሰባት ዘጠኝ አራት
Ethio-ASR Amharic (600M)11 errEthio-ASR Multi (300M)8 errEthio-ASR Multi (600M)8 errEthio-ASR Multi (94M)3 errMeta MMS-1B19 errOmniASR-CTC (1B)0 errOmniASR-CTC (300M)2 errOmniASR-CTC (3B)0 errOmniASR-LLM (1B)0 errOmniASR-LLM (300M)0 errOmniASR-LLM (3B)0 errOpenAI Whisper-small71 err
Open detailed comparison →
Example 2 22 words · Speaker: Male
ባህር ዳር ነው ያለሁት ኢንተርኔት ተቋርጦብኛል ብልሽት ማስመዝገብ ፈልጌ ነበር ስልኬ ዜሮ ዘጠኝ አንድ አንድ ስድስት ሰባት ዜሮ ሁለት ዘጠኝ አምስት ነው
Ethio-ASR Amharic (600M)4 errEthio-ASR Multi (300M)12 errEthio-ASR Multi (600M)6 errEthio-ASR Multi (94M)7 errMeta MMS-1B22 errOmniASR-CTC (1B)6 errOmniASR-CTC (300M)5 errOmniASR-CTC (3B)6 errOmniASR-LLM (1B)4 errOmniASR-LLM (300M)6 errOmniASR-LLM (3B)3 errOpenAI Whisper-small73 err
Open detailed comparison →
Example 3 7 words · Speaker: Female
በስልክ ደውየ ማግኘት የምችልበት የጥሪ ማእከል አለ
Ethio-ASR Amharic (600M)0 errEthio-ASR Multi (300M)1 errEthio-ASR Multi (600M)2 errEthio-ASR Multi (94M)2 errMeta MMS-1B7 errOmniASR-CTC (1B)5 errOmniASR-CTC (300M)2 errOmniASR-CTC (3B)1 errOmniASR-LLM (1B)7 errOmniASR-LLM (300M)1 errOmniASR-LLM (3B)1 errOpenAI Whisper-small17 err
Open detailed comparison →
Example 4 15 words · Speaker: Female
እሽ ግርማ አገልግሎቱን ለማቋረጥ ስቶፕ ቢ ብለው ወደ ስድስት መቶ አስራ አምስት አጭር ቁጥር ይላኩ
Ethio-ASR Amharic (600M)3 errEthio-ASR Multi (300M)8 errEthio-ASR Multi (600M)6 errEthio-ASR Multi (94M)4 errMeta MMS-1B15 errOmniASR-CTC (1B)4 errOmniASR-CTC (300M)5 errOmniASR-CTC (3B)2 errOmniASR-LLM (1B)4 errOmniASR-LLM (300M)4 errOmniASR-LLM (3B)1 errOpenAI Whisper-small32 err
Open detailed comparison →
Example 5 12 words · Speaker: Male
ቁጥሬ ዜሮ ዘጠኝ ሰላሳ አራት አራት አምስት ስድስት ሰባት ስምንት ዘጠኝ ነው
Ethio-ASR Amharic (600M)3 errEthio-ASR Multi (300M)2 errEthio-ASR Multi (600M)6 errEthio-ASR Multi (94M)4 errMeta MMS-1B12 errOmniASR-CTC (1B)0 errOmniASR-CTC (300M)0 errOmniASR-CTC (3B)0 errOmniASR-LLM (1B)1 errOmniASR-LLM (300M)0 errOmniASR-LLM (3B)0 errOpenAI Whisper-small19 err
Open detailed comparison →
Example 6 9 words · Speaker: Male
መቸ ነው የሚስተካከለው ስራ ስላለብኝ ቶሎ ቢሆንልኝ ጥሩ ነው
Ethio-ASR Amharic (600M)1 errEthio-ASR Multi (300M)4 errEthio-ASR Multi (600M)3 errEthio-ASR Multi (94M)4 errMeta MMS-1B9 errOmniASR-CTC (1B)2 errOmniASR-CTC (300M)7 errOmniASR-CTC (3B)0 errOmniASR-LLM (1B)7 errOmniASR-LLM (300M)6 errOmniASR-LLM (3B)2 errOpenAI Whisper-small19 err
Open detailed comparison →
Example 7 9 words · Speaker: Female
የኢንተርኔት ጥቅል ወይም ፓኬጅ መግዛት እችላለሁ ዋጋው ስንት ነው
Ethio-ASR Amharic (600M)1 errEthio-ASR Multi (300M)4 errEthio-ASR Multi (600M)2 errEthio-ASR Multi (94M)4 errMeta MMS-1B9 errOmniASR-CTC (1B)2 errOmniASR-CTC (300M)3 errOmniASR-CTC (3B)3 errOmniASR-LLM (1B)2 errOmniASR-LLM (300M)3 errOmniASR-LLM (3B)2 errOpenAI Whisper-small18 err
Open detailed comparison →
Example 8 9 words · Speaker: Female
በጣም ጥሩ ከፍተኛው የፍጥነት መጠን እስከ ስንት ነው የሚደርሰው
Ethio-ASR Amharic (600M)1 errEthio-ASR Multi (300M)2 errEthio-ASR Multi (600M)2 errEthio-ASR Multi (94M)4 errMeta MMS-1B9 errOmniASR-CTC (1B)3 errOmniASR-CTC (300M)4 errOmniASR-CTC (3B)3 errOmniASR-LLM (1B)3 errOmniASR-LLM (300M)5 errOmniASR-LLM (3B)5 errOpenAI Whisper-small18 err
Open detailed comparison →
Example 9 12 words · Speaker: Female
ቁጥሩ ዜሮ ዘጠኝ አንድ ሁለት አምስት ስድስት ሰባት ስምንት ዘጠኝ ዜሮ ነው
Ethio-ASR Amharic (600M)4 errEthio-ASR Multi (300M)8 errEthio-ASR Multi (600M)4 errEthio-ASR Multi (94M)8 errMeta MMS-1B12 errOmniASR-CTC (1B)1 errOmniASR-CTC (300M)3 errOmniASR-CTC (3B)1 errOmniASR-LLM (1B)1 errOmniASR-LLM (300M)1 errOmniASR-LLM (3B)1 errOpenAI Whisper-small19 err
Open detailed comparison →
Example 10 7 words · Speaker: Male
ስለ ጥቅሎቹ ዝርዝር መረጃ የት ነው የማገኘው
Ethio-ASR Amharic (600M)0 errEthio-ASR Multi (300M)4 errEthio-ASR Multi (600M)2 errEthio-ASR Multi (94M)2 errMeta MMS-1B7 errOmniASR-CTC (1B)1 errOmniASR-CTC (300M)1 errOmniASR-CTC (3B)3 errOmniASR-LLM (1B)3 errOmniASR-LLM (300M)3 errOmniASR-LLM (3B)3 errOpenAI Whisper-small13 err
Open detailed comparison →
Example 11 8 words · Speaker: Female
እሽ በጣም ከፍተኛው ፍጥነት እስከ ስንት ይደርሳል ዋጋውስ
Ethio-ASR Amharic (600M)0 errEthio-ASR Multi (300M)5 errEthio-ASR Multi (600M)2 errEthio-ASR Multi (94M)3 errMeta MMS-1B8 errOmniASR-CTC (1B)0 errOmniASR-CTC (300M)4 errOmniASR-CTC (3B)0 errOmniASR-LLM (1B)4 errOmniASR-LLM (300M)0 errOmniASR-LLM (3B)2 errOpenAI Whisper-small13 err
Open detailed comparison →
Example 12 10 words · Speaker: Female
አሁን ያለሁት አዳማ ነው ወደ ጅቡቲ ለስራ ልሄድ ስለሆነ ነው
Ethio-ASR Amharic (600M)2 errEthio-ASR Multi (300M)7 errEthio-ASR Multi (600M)5 errEthio-ASR Multi (94M)7 errMeta MMS-1B10 errOmniASR-CTC (1B)4 errOmniASR-CTC (300M)3 errOmniASR-CTC (3B)4 errOmniASR-LLM (1B)2 errOmniASR-LLM (300M)4 errOmniASR-LLM (3B)0 errOpenAI Whisper-small17 err
Open detailed comparison →
Example 13 13 words · Speaker: Female
ያኛው ስልክ ሌላ መሳሪያ ላይ ነው ያለው ከዚህኛው ቁጥር ላይ ሆኘ መጨረስ አልችልም
Ethio-ASR Amharic (600M)0 errEthio-ASR Multi (300M)6 errEthio-ASR Multi (600M)4 errEthio-ASR Multi (94M)5 errMeta MMS-1B13 errOmniASR-CTC (1B)4 errOmniASR-CTC (300M)5 errOmniASR-CTC (3B)2 errOmniASR-LLM (1B)4 errOmniASR-LLM (300M)1 errOmniASR-LLM (3B)2 errOpenAI Whisper-small18 err
Open detailed comparison →
Example 14 7 words · Speaker: Male
እሽ ቪድዮ ወይም መመሪያ አለ እንደት እንደምጠቀም
Ethio-ASR Amharic (600M)1 errEthio-ASR Multi (300M)3 errEthio-ASR Multi (600M)4 errEthio-ASR Multi (94M)4 errMeta MMS-1B7 errOmniASR-CTC (1B)0 errOmniASR-CTC (300M)3 errOmniASR-CTC (3B)0 errOmniASR-LLM (1B)2 errOmniASR-LLM (300M)2 errOmniASR-LLM (3B)2 errOpenAI Whisper-small12 err
Open detailed comparison →
Example 15 8 words · Speaker: Female
እሽ አሁን እንደት ነው የምጠቀመው አድስ ቁጥር አልደረሰኝም
Ethio-ASR Amharic (600M)0 errEthio-ASR Multi (300M)2 errEthio-ASR Multi (600M)1 errEthio-ASR Multi (94M)3 errMeta MMS-1B8 errOmniASR-CTC (1B)1 errOmniASR-CTC (300M)4 errOmniASR-CTC (3B)1 errOmniASR-LLM (1B)3 errOmniASR-LLM (300M)5 errOmniASR-LLM (3B)5 errOpenAI Whisper-small13 err
Open detailed comparison →
Example 16 11 words · Speaker: Male
ቁጥሩ ስድስት ሰባት ዘጠኝ ሶስት ሁለት ስድስት ሰባት ስድስት አራት ነው
Ethio-ASR Amharic (600M)5 errEthio-ASR Multi (300M)1 errEthio-ASR Multi (600M)3 errEthio-ASR Multi (94M)1 errMeta MMS-1B11 errOmniASR-CTC (1B)0 errOmniASR-CTC (300M)0 errOmniASR-CTC (3B)0 errOmniASR-LLM (1B)0 errOmniASR-LLM (300M)0 errOmniASR-LLM (3B)0 errOpenAI Whisper-small11 err
Open detailed comparison →
Example 17 16 words · Speaker: Male
በመተግበሪያው ውስጥ ሮሚንግ ሰርቪስ የሚል ሚኒ መተግበሪያ ያገኛሉ እዛ ውስጥ ገብተው አገልግሎቱን ማስጀመርም ሆነ ማቋረጥ ይችላሉ
Ethio-ASR Amharic (600M)2 errEthio-ASR Multi (300M)4 errEthio-ASR Multi (600M)4 errEthio-ASR Multi (94M)6 errMeta MMS-1B16 errOmniASR-CTC (1B)7 errOmniASR-CTC (300M)7 errOmniASR-CTC (3B)8 errOmniASR-LLM (1B)10 errOmniASR-LLM (300M)12 errOmniASR-LLM (3B)9 errOpenAI Whisper-small30 err
Open detailed comparison →
Example 18 12 words · Speaker: Female
ቁጥሬ ዜሮ ዘጠኝ አምስት አንድ አንድ ስምንት አምስት አንድ አራት አንድ ነው
Ethio-ASR Amharic (600M)6 errEthio-ASR Multi (300M)4 errEthio-ASR Multi (600M)5 errEthio-ASR Multi (94M)3 errMeta MMS-1B12 errOmniASR-CTC (1B)0 errOmniASR-CTC (300M)1 errOmniASR-CTC (3B)0 errOmniASR-LLM (1B)0 errOmniASR-LLM (300M)0 errOmniASR-LLM (3B)0 errOpenAI Whisper-small11 err
Open detailed comparison →
Example 19 13 words · Speaker: Male
ቁጥሩ ሰባት ሶስት አንድ ዜሮ አንድ ሁለት ሰባት ዘጠኝ አምስት ዜሮ አራት ነው
Ethio-ASR Amharic (600M)6 errEthio-ASR Multi (300M)3 errEthio-ASR Multi (600M)5 errEthio-ASR Multi (94M)1 errMeta MMS-1B13 errOmniASR-CTC (1B)0 errOmniASR-CTC (300M)0 errOmniASR-CTC (3B)0 errOmniASR-LLM (1B)0 errOmniASR-LLM (300M)0 errOmniASR-LLM (3B)0 errOpenAI Whisper-small13 err
Open detailed comparison →
Example 20 12 words · Speaker: Male
ቁጥሩ ዜሮ ዘጠኝ ሁለት ዜሮ አምስት ስድስት ሰባት ስምንት ዘጠኝ ዜሮ ነው
Ethio-ASR Amharic (600M)6 errEthio-ASR Multi (300M)7 errEthio-ASR Multi (600M)5 errEthio-ASR Multi (94M)4 errMeta MMS-1B12 errOmniASR-CTC (1B)0 errOmniASR-CTC (300M)0 errOmniASR-CTC (3B)0 errOmniASR-LLM (1B)0 errOmniASR-LLM (300M)0 errOmniASR-LLM (3B)0 errOpenAI Whisper-small9 err
Open detailed comparison →

Once inside an example page you can also switch audio quality (from studio → very noisy → phone call) to see how each model degrades.