← All examples

ModelEthio-ASR Amharic (600M)6Ethio-ASR Multi (300M)13Ethio-ASR Multi (600M)7Ethio-ASR Multi (94M)9Meta MMS-1B22OmniASR-CTC (1B)6OmniASR-CTC (300M)5OmniASR-CTC (3B)5OmniASR-LLM (1B)4OmniASR-LLM (300M)6OmniASR-LLM (3B)4OpenAI Whisper-small20
Audio qualityClean Studio14Ambient Room Noise5Harsh Environment7Distant / Low-Volume Mic13Wideband Phone (VoLTE)5Randomized Phone Channel5Narrowband 2G + Packet Loss13

What did the model get wrong?

OmniASR-CTC (300M) Wideband Phone (VoLTE)   Example 2 of 20  ·  speaker: Male

🎧 Listen — Wideband Phone (VoLTE)
Compressed, narrow-band audio like a regular phone call.
✅ What was actually said
ባህር ዳር ነው ያለሁት ኢንተርኔት ተቋርጦብኛል ብልሽት ማስመዝገብ ፈልጌ ነበር ስልኬ ዜሮ ዘጠኝ አንድ አንድ ስድስት ሰባት ዜሮ ሁለት ዘጠኝ አምስት ነው
🤖 What this model heard
በ አርዳድ ነው ያለውት ቴሌብር ተቋርጦብኛል ብልሽት ማስመዝገብ አልቄ ነበር ስልኬ ዜሮ ዘጠኝ አንድ አንድ ስድስት ሰባት ዜሮ ሁለት ዘጠኝ አምስት ነው
Correct
Wrong (different word)
Missed (skipped)
Extra (added)
17
Correct
5
Wrong
0
Missed
0
Extra
77%
Words right
Out of 22 spoken words, this model got 17 right (77%). Errors: 5 words wrong.

Try switching Audio quality — see the same model degrade as the audio gets noisier.