← All examples

ModelEthio-ASR Amharic (600M)11Ethio-ASR Multi (300M)13Ethio-ASR Multi (600M)9Ethio-ASR Multi (94M)8Meta MMS-1B19OmniASR-CTC (1B)0OmniASR-CTC (300M)0OmniASR-CTC (3B)0OmniASR-LLM (1B)0OmniASR-LLM (300M)0OmniASR-LLM (3B)0OpenAI Whisper-small20
Audio qualityClean Studio4Ambient Room Noise3Harsh Environment6Distant / Low-Volume Mic3Wideband Phone (VoLTE)16Randomized Phone Channel8Narrowband 2G + Packet Loss19

What did the model get wrong?

Ethio-ASR Multi (94M) Randomized Phone Channel   Example 1 of 20  ·  speaker: Female

🎧 Listen — Randomized Phone Channel
Phone-call audio with random extra distortions layered on top.
✅ What was actually said
ሁለት ዜሮ ሁለት አምስት አንድ ሁለት አንድ ሰባት ሁለት አራት ሰባት ስምንት ዜሮ ሰባት ዘጠኝ አራት
🤖 What this model heard
amh ሲsቲ ሁለት ዜሮ ሁለት አምስት አንድ ሁለት አንድ ሰራት ሁለ አራት ሰራት ስምንት ዜሮ ሰባት ዘጠኛ ራት
Correct
Wrong (different word)
Missed (skipped)
Extra (added)
11
Correct
7
Wrong
1
Missed
0
Extra
58%
Words right
Out of 19 spoken words, this model got 11 right (58%). Errors: 7 words wrong; 1 missed.

Try switching Audio quality — see the same model degrade as the audio gets noisier.