← All examples

ModelEthio-ASR Amharic (600M)7Ethio-ASR Multi (300M)17Ethio-ASR Multi (600M)6Ethio-ASR Multi (94M)10Meta MMS-1B22OmniASR-CTC (1B)6OmniASR-CTC (300M)5OmniASR-CTC (3B)5OmniASR-LLM (1B)4OmniASR-LLM (300M)5OmniASR-LLM (3B)4OpenAI Whisper-small22
Audio qualityClean Studio8Ambient Room Noise6Harsh Environment6Distant / Low-Volume Mic11Wideband Phone (VoLTE)5Randomized Phone Channel5Narrowband 2G + Packet Loss10

What did the model get wrong?

OmniASR-CTC (3B) Randomized Phone Channel   Example 2 of 20  ·  speaker: Male

🎧 Listen — Randomized Phone Channel
Phone-call audio with random extra distortions layered on top.
✅ What was actually said
ባህር ዳር ነው ያለሁት ኢንተርኔት ተቋርጦብኛል ብልሽት ማስመዝገብ ፈልጌ ነበር ስልኬ ዜሮ ዘጠኝ አንድ አንድ ስድስት ሰባት ዜሮ ሁለት ዘጠኝ አምስት ነው
🤖 What this model heard
በ አርዳር ነው ያለሁት ቴሌብር ተቋርጦ ብኛል ብልሽት ማስመዝገብ ፈልጌ ነበር ስልኬ ዜሮ ዘጠኝ አንድ አንድ ስድስት ሰባት ዜሮ ሁለት ዘጠኝ አምስት ነው
Correct
Wrong (different word)
Missed (skipped)
Extra (added)
18
Correct
4
Wrong
0
Missed
1
Extra
82%
Words right
Out of 22 spoken words, this model got 18 right (82%). Errors: 4 words wrong; 1 extra.

Try switching Audio quality — see the same model degrade as the audio gets noisier.