← All examples

ModelEthio-ASR Amharic (600M)4Ethio-ASR Multi (300M)7Ethio-ASR Multi (600M)5Ethio-ASR Multi (94M)6Meta MMS-1B22OmniASR-CTC (1B)12OmniASR-CTC (300M)13OmniASR-CTC (3B)11OmniASR-LLM (1B)4OmniASR-LLM (300M)6OmniASR-LLM (3B)4OpenAI Whisper-small196
Audio qualityClean Studio9Ambient Room Noise6Harsh Environment6Distant / Low-Volume Mic12Wideband Phone (VoLTE)6Randomized Phone Channel6Narrowband 2G + Packet Loss5

What did the model get wrong?

OmniASR-CTC (1B) Distant / Low-Volume Mic   Example 2 of 20  ·  speaker: Male

🎧 Listen — Distant / Low-Volume Mic
Very quiet audio, like the microphone was far away or turned down.
✅ What was actually said
ባህር ዳር ነው ያለሁት ኢንተርኔት ተቋርጦብኛል ብልሽት ማስመዝገብ ፈልጌ ነበር ስልኬ ዜሮ ዘጠኝ አንድ አንድ ስድስት ሰባት ዜሮ ሁለት ዘጠኝ አምስት ነው
🤖 What this model heard
አርዳር ነው ያለውት ቴሌብር ተቋርጦ ብኛል ብልሽት ማስመዝገብ ፈልጌ ነበር ስልኬ ዜዘጠ አድ አድ ስስት ሰባት ሁለት ዘጠኝ አምስት ነው
Correct
Wrong (different word)
Missed (skipped)
Extra (added)
11
Correct
10
Wrong
1
Missed
1
Extra
50%
Words right
Out of 22 spoken words, this model got 11 right (50%). Errors: 10 words wrong; 1 missed; 1 extra.

Try switching Audio quality — see the same model degrade as the audio gets noisier.