← All examples

ModelEthio-ASR Amharic (600M)6Ethio-ASR Multi (300M)13Ethio-ASR Multi (600M)7Ethio-ASR Multi (94M)9Meta MMS-1B22OmniASR-CTC (1B)6OmniASR-CTC (300M)5OmniASR-CTC (3B)5OmniASR-LLM (1B)4OmniASR-LLM (300M)6OmniASR-LLM (3B)4OpenAI Whisper-small20
Audio qualityClean Studio4Ambient Room Noise4Harsh Environment4Distant / Low-Volume Mic4Wideband Phone (VoLTE)4Randomized Phone Channel4Narrowband 2G + Packet Loss8

What did the model get wrong?

OmniASR-LLM (1B) Wideband Phone (VoLTE)   Example 2 of 20  ·  speaker: Male

🎧 Listen — Wideband Phone (VoLTE)
Compressed, narrow-band audio like a regular phone call.
✅ What was actually said
ባህር ዳር ነው ያለሁት ኢንተርኔት ተቋርጦብኛል ብልሽት ማስመዝገብ ፈልጌ ነበር ስልኬ ዜሮ ዘጠኝ አንድ አንድ ስድስት ሰባት ዜሮ ሁለት ዘጠኝ አምስት ነው
🤖 What this model heard
ባህር ዳር ነው ያለውት ቴሌቭር ተቋርጦ ብኛል ብልሽት ማስመዝገብ ፈልጌ ነበር ስልኬ ዜሮ ዘጠኝ አንድ አንድ ስድስት ሰባት ዜሮ ሁለት ዘጠኝ አምስት ነው
Correct
Wrong (different word)
Missed (skipped)
Extra (added)
19
Correct
3
Wrong
0
Missed
1
Extra
86%
Words right
Out of 22 spoken words, this model got 19 right (86%). Errors: 3 words wrong; 1 extra.

Try switching Audio quality — see the same model degrade as the audio gets noisier.