← All examples

ModelEthio-ASR Amharic (600M)4Ethio-ASR Multi (300M)12Ethio-ASR Multi (600M)6Ethio-ASR Multi (94M)7Meta MMS-1B22OmniASR-CTC (1B)6OmniASR-CTC (300M)5OmniASR-CTC (3B)6OmniASR-LLM (1B)4OmniASR-LLM (300M)6OmniASR-LLM (3B)3OpenAI Whisper-small73
Audio qualityClean Studio20Ambient Room Noise73Harsh Environment22Distant / Low-Volume Mic196Wideband Phone (VoLTE)20Randomized Phone Channel22Narrowband 2G + Packet Loss22

What did the model get wrong?

OpenAI Whisper-small Ambient Room Noise   Example 2 of 20  ·  speaker: Male

🎧 Listen — Ambient Room Noise
Realistic everyday background noise — like a normal room or café.
✅ What was actually said
ባህር ዳር ነው ያለሁት ኢንተርኔት ተቋርጦብኛል ብልሽት ማስመዝገብ ፈልጌ ነበር ስልኬ ዜሮ ዘጠኝ አንድ አንድ ስድስት ሰባት ዜሮ ሁለት ዘጠኝ አምስት ነው
🤖 What this model heard
barb your near load till ever the quarter to bignal but i ll tell you the court of the billy shit was mischid must must must go for the king of the king of the king s a little bit and the key number to the key zero to the thing and and and and said this is the time to the time and and and so this is the time to the
Correct
Wrong (different word)
Missed (skipped)
Extra (added)
0
Correct
22
Wrong
0
Missed
51
Extra
0%
Words right
Out of 22 spoken words, this model got 0 right (0%). Errors: 22 words wrong; 51 extra.

Try switching Audio quality — see the same model degrade as the audio gets noisier.