191–200 of 255 posts
Ok, I guess this is the regular time for me to look for a local realtime transcription solution on Linux, and not finding anything good. Maybe this'll get wrapped into a nice tool later. Does anyone have any recommendations?
Is there an open source Android keyboard that would support it? Everything I find is based on Whisper, which is from 2022. Ages ago given how fast AI is evolving.
I wish I had a Google Keyboard that could easily run on Whisper Medium. This is already great. But unfortunately would be too much inference cost, incredibly slow. The problem with Whisper is not the inference quality: medium and large are incredible. Is that the base model is not enough, and the only one with fast inference in mobile devices.
This demo is really impressive: https://huggingface.co/spaces/mistralai/Voxtral-Mini-Realtim... Don't be confused if it says "no microphone", the moment you click the record button it will request browser permission and then start working. I spoke fast and dropped in some jargon and it got it all right - I said this and it transcribed it exactly right, WebAssembly spelling included: > Can you tell me about RSS and At…
404 on https://mistralai-voxtral-mini-realtime.hf.space/gradio_api/... for me (which shows up in the UI as a little red error in the top right).
things I hate: "Click me to try now!" banners that lead to a warning screen that says "Oh, only paying members, whoops!" So, you don't mean 'try this out', you mean 'buy this product'. Let's not act like it's a free sampler. I can't comment on the model : i'm not giving them money.
You can try it on HF: https://huggingface.co/spaces/mistralai/Voxtral-Mini-Realtim...
Is there an open source Android keyboard that would support it? Everything I find is based on Whisper, which is from 2022. Ages ago given how fast AI is evolving.
Is there an open source Android keyboard that would support it? Everything I find is based on Whisper, which is from 2022. Ages ago given how fast AI is evolving.
Have been using https://github.com/notune/android_transcribe_app And pretty happy with it. Fully local and fast and accurate
I noticed that this model is multilingual and understands 14 languages. For many use cases, we probably only need a single language, and the extra 13 are simply adding extra latency. I believe there will be a trend in the coming years of trimming the fat off of these jack of all trades models. https://aclanthology.org/2025.findings-acl.87/