151–160 of 255 posts
The dataset is ~100 8kHz call recordings with gnarly UK accents (which I consider to be the final boss of english language ASR). It seems like it's SOTA.
Where it does fall down seems to be the latency distribution but I'm testing against the API. Running it locally will no doubt improve that?
This demo is really impressive: https://huggingface.co/spaces/mistralai/Voxtral-Mini-Realtim... Don't be confused if it says "no microphone", the moment you click the record button it will request browser permission and then start working. I spoke fast and dropped in some jargon and it got it all right - I said this and it transcribed it exactly right, WebAssembly spelling included: > Can you tell me about RSS and At…
Not terrible. It missed or mixed up a lot of words when I was speaking quickly (and not enunciating very well), but it does well with normal-paced speech.
Earlier quoted context omitted.
Nobody ever supports Polish. It's the worst. They'll support like, ̵Swahili, but not Polish. edit: I stand corrected lol. I'll go with "Gaelic" instead.
200 million people speak Swahili. 39 million people speak Polish, and most of those also speak English or another more common language.
Earlier quoted context omitted.
Do you have experience with that model for diarization? Does it feel accurate, and what's its realtime factor on a typical GPU? Diarization has been the biggest thorn in my side for a long time..
You can test it yourself for free on https://console.mistral.ai/build/audio/speech-to-text I tried it on an english-speaking podcast episode, and apart from identying one host as two different speakers (but only once for a few sentences at the start), the rest was flawless from what I could see
This demo is really impressive: https://huggingface.co/spaces/mistralai/Voxtral-Mini-Realtim... Don't be confused if it says "no microphone", the moment you click the record button it will request browser permission and then start working. I spoke fast and dropped in some jargon and it got it all right - I said this and it transcribed it exactly right, WebAssembly spelling included: > Can you tell me about RSS and At…
is this demo running fully in the browser?
Model is around 7.5 GB - once they get above 4 GB running them in a browser gets quite difficult I believe.
Can it translate in real time?
p.s. even the demo uses a remote server via websocket.
In English it is pretty good. But talk to it in Polish, and suddenly it thinks you speak Russian? Ukranian? Belarus? I would understand if an American company launched this, but for a company being so proud about their European roots, I think it should have better support for major European languages. I tried English + Polish: > All right, I'm not really sure if transcribing this makes a lot of sense. Maybe not. A ць…
Do we know if this is better than Nvidia Parakeet V3? That has been my go-to model locally and it's hard to imagine there's something even better.
I liked Parakeet v3 a lot until it started to drop whole sentences, willy-nilly.
Do we know if this is better than Nvidia Parakeet V3? That has been my go-to model locally and it's hard to imagine there's something even better.