I cant wait for models to get smaller enough that they can run on commodity devices.
Hope we can build an app like Whispr Flow using this with the model running completely on device.
Voxtral Transcribe 2
211–220 of 255 posts
Re: Voxtral Transcribe 2
#212You know what I'd love to have? This running on my Android smartphone. Google's speech services are garbage and they LOVE to cut me off mid-sentence for no reason, well over half the time. It's maddening.
Re: Voxtral Transcribe 2
#213Is there an open source Android keyboard that would support it? Everything I find is based on Whisper, which is from 2022. Ages ago given how fast AI is evolving.
Have been using https://github.com/notune/android_transcribe_app And pretty happy with it. Fully local and fast and accurate
This is actually really good. I'm writing with it right now. It's just not the best setup as a keyboard. Because for example you cannot easily switch back to uh the normal keyboard with keys.
Re: Voxtral Transcribe 2
#214> At approximately 4% word error rate on FLEURS and $0.003/min Amazons transcription service is $0.024 per minute, pretty big difference https://aws.amazon.com/transcribe/pricing/
Is it 0.003 per minute of audio uploaded, or "compute minute"? For example fal.ai has a Whisper API endpoint priced at "$0.00125 per compute second" which (at 10-25x realtime) is EXTREMELY cheaper than all the competitors.
Both AWS and Mistral prices above are per minute of input audio.
Re: Voxtral Transcribe 2
#215Earlier quoted context omitted.
Having built with and tried every voice model over the last three years, real time and non-real time... this is off the charts compared to anything I've seen before. And open weight too! So grateful for this.
This past month Parakeet v3 dropped with a streaming ASR model that is 0.6B params, can run on a CPU and is super good.
Re: Voxtral Transcribe 2
#216The other demos didn't work for me, so I made https://github.com/owenbrown/transcribe
It's just a python script to test the streaming.
Wow, Voxtral is amazing. It will be great when someone stitches this up so an LLM starts thinking, researching for you, before you actually finish talking.
Like, create a conversation partner with sub 0.5 second latency. For example, you ask it a multi part questions and, as soon as you finish talking, it gives you the answer to the first part while it looks up the rest of the answer, then stitches it together so that there's no break.
The 2-3 second latency of existing voice chatbots is a non-started for most humans.
Re: Voxtral Transcribe 2
#217I noticed that this model is multilingual and understands 14 languages. For many use cases, we probably only need a single language, and the extra 13 are simply adding extra latency. I believe there will be a trend in the coming years of trimming the fat off of these jack of all trades models. https://aclanthology.org/2025.findings-acl.87/
A single language modèle wouldn't make any sense except for English: there's simply too much English intertwined with any other language nowadays (corporate jargon, brands, tech, etc.)
Re: Voxtral Transcribe 2
#218Very happy with all the mistral work. I feel like I'm always one release behind theirs. Last time they released Mistral 3 I commented saying how excited I was to try it out [1]
Well, I'm happy to report I integrated the new Mistral 3 and have been truly astounded by the results. I still am not a big fan of the model wrt factual information - it seems to be especially confident and especially wrong if left to it's own devices - but with http://phrasing.app I do most of the data aggregation myself and just use an LLM to format it. Mistral 3 was a drop-in replacement for 3x the quality (it was already very very good), 0% error rate for my use case (I had an issue for it occasionally going off the rails that was entirely solved), and sticks to my formatting guidelines perfectly (which even gpt-5-pro failed on). Plus it was somehow even cheaper.
I'm using Scribe v2 at the moment for TTS, but I'm very excited now to try integrating Voxtral Transcribe. The language support is a little lacking for my use cases, but I can always fall back to Scribe and amatorize the cost across languages. I actually was due to work on the transcription of phrasing very soon so I guess look forward to my (hopefully) glowing review on their next hn launch! XD
Re: Voxtral Transcribe 2
#219Earlier quoted context omitted.
You could say the same about Dutch to be fair. 90-95% speak English - I bet that's way higher than in Poland.
As an American, my perspective is that Dutch people speak better English than a large percentage of English people and Americans.
Heh, based on my incorrect and probably wrong experience Dutch and Swedes are the best non-native english speakers in term of both the accent and fluency.
Re: Voxtral Transcribe 2
#220Can it translate in real time?
Real time as in at >1x speed? Probably?
Real time as in per-word basis? Probably not?