← All examples

ModelEthio-ASR Amharic (600M)13Ethio-ASR Multi (300M)20Ethio-ASR Multi (600M)12Ethio-ASR Multi (94M)16Meta MMS-1B22OmniASR-CTC (1B)5OmniASR-CTC (300M)13OmniASR-CTC (3B)10OmniASR-LLM (1B)8OmniASR-LLM (300M)6OmniASR-LLM (3B)9OpenAI Whisper-small22
Audio qualityClean Studio5Ambient Room Noise6Harsh Environment6Distant / Low-Volume Mic5Wideband Phone (VoLTE)7Randomized Phone Channel6Narrowband 2G + Packet Loss12

What did the model get wrong?

Ethio-ASR Multi (600M) Narrowband 2G + Packet Loss   Example 2 of 20  ·  speaker: Male

🎧 Listen — Narrowband 2G + Packet Loss
Heavy background noise plus phone-call compression — worst-case stress test.
✅ What was actually said
ባህር ዳር ነው ያለሁት ኢንተርኔት ተቋርጦብኛል ብልሽት ማስመዝገብ ፈልጌ ነበር ስልኬ ዜሮ ዘጠኝ አንድ አንድ ስድስት ሰባት ዜሮ ሁለት ዘጠኝ አምስት ነው
🤖 What this model heard
amh ባር ዘርነ ያለውት ቴሌብር ተቆርጦብኛል ትልሹት ማት ነት ጸልቅ ይነጠር ስልኬ ዘጠኝ አንድ አንድ ስድስት ሰባት ዜሮ ሁለት ዘጠኝ አምስት ነው
Correct
Wrong (different word)
Missed (skipped)
Extra (added)
10
Correct
12
Wrong
0
Missed
0
Extra
45%
Words right
Out of 22 spoken words, this model got 10 right (45%). Errors: 12 words wrong.

Try switching Audio quality — see the same model degrade as the audio gets noisier.