← All examples

ModelEthio-ASR Amharic (600M)13Ethio-ASR Multi (300M)20Ethio-ASR Multi (600M)12Ethio-ASR Multi (94M)16Meta MMS-1B22OmniASR-CTC (1B)5OmniASR-CTC (300M)13OmniASR-CTC (3B)10OmniASR-LLM (1B)8OmniASR-LLM (300M)6OmniASR-LLM (3B)9OpenAI Whisper-small22
Audio qualityClean Studio4Ambient Room Noise4Harsh Environment4Distant / Low-Volume Mic4Wideband Phone (VoLTE)4Randomized Phone Channel4Narrowband 2G + Packet Loss8

What did the model get wrong?

OmniASR-LLM (1B) Narrowband 2G + Packet Loss   Example 2 of 20  ·  speaker: Male

🎧 Listen — Narrowband 2G + Packet Loss
Heavy background noise plus phone-call compression — worst-case stress test.
✅ What was actually said
ባህር ዳር ነው ያለሁት ኢንተርኔት ተቋርጦብኛል ብልሽት ማስመዝገብ ፈልጌ ነበር ስልኬ ዜሮ ዘጠኝ አንድ አንድ ስድስት ሰባት ዜሮ ሁለት ዘጠኝ አምስት ነው
🤖 What this model heard
ባህር ያለው ቴሌቪዥት ተቋርጦ ይገኛል ብልሽት ማትነስ ሊያስፈልጌ ነበር ስልኬይ ዜሮ ዘጠኝ አንድ አንድ ስድስት ሰባት ዜሮ ሁለት ዘጠኝ አምስት ነው
Correct
Wrong (different word)
Missed (skipped)
Extra (added)
14
Correct
7
Wrong
1
Missed
0
Extra
64%
Words right
Out of 22 spoken words, this model got 14 right (64%). Errors: 7 words wrong; 1 missed.

Try switching Audio quality — see the same model degrade as the audio gets noisier.