Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Gemini-3.5-Transcribe

blog.google

Post reply on HN
Print view View original

31–40 of 140 posts

Re: Gemini-3.5-Transcribe

#31

Post by Lucasoato »

cnxhk wrote: post #25
Lucasoato wrote: post #21

I’ve tested at least 20 STT models in a benchmark I’ve set up with German, Italian and English voices from meetings in my company. The voices contained very industry specific words, the languages changed from one sentence to another, sometimes words in a language were mentioned while a discussion was in another. The only local model that satisfies me is Voxtral Mini 3b, the only paid API that is slightly better is el…

Any possibility to share some of the eval audio?

Of course not, but it’s easily replicable just by mixing different languages conversations together, adding a word here and there of some very specific German jargon.

Re: Gemini-3.5-Transcribe

#32

Post by Lucasoato »

kridsdale1 wrote: post #30
Lucasoato wrote: post #21

I’ve tested at least 20 STT models in a benchmark I’ve set up with German, Italian and English voices from meetings in my company. The voices contained very industry specific words, the languages changed from one sentence to another, sometimes words in a language were mentioned while a discussion was in another. The only local model that satisfies me is Voxtral Mini 3b, the only paid API that is slightly better is el…

I use Parakeet 3. How does that fare in your testing?

I love it but it misses the business specific words when in different language. Sometimes it stretches them out to fit unrelated words in the language of the rest of the conversation. I miss its speed though.

Re: Gemini-3.5-Transcribe

#33

Post by wahnfrieden »

Lucasoato wrote: post #21

I’ve tested at least 20 STT models in a benchmark I’ve set up with German, Italian and English voices from meetings in my company. The voices contained very industry specific words, the languages changed from one sentence to another, sometimes words in a language were mentioned while a discussion was in another. The only local model that satisfies me is Voxtral Mini 3b, the only paid API that is slightly better is el…

Try the recent MOSS one? It’s very good

Re: Gemini-3.5-Transcribe

#34

Post by skinfaxi »

sync wrote: post #26
Crystalin wrote: post #20

I've been testing it on Pixel 11 Pro and I mostly dislike it. It is convenient when you have something long to say without thinking about it first. But the main issue is when you want to say something precise with specific wording it might "simplify" it and break the meaning. Something like "I hesitated to check it, I should have verified" => "I should have verified" (The "I hesitated..." is removed but I said it bec…

Are you in Smart or Verbatim mode? https://ai.google.dev/gemini-api/docs/transcribe#transcripti...

They mentioned the pixel phone so probably using https://blog.google/products-and-platforms/platforms/android...

Re: Gemini-3.5-Transcribe

#35

Post by blissofbeing »

I've been using Wispr Flow on my pixel 9 and I like it. It does the things that Rambler says it's supposed to do but it's available on my Pixel 9 unlike rambler that's currently only available for pixel 11.

Re: Gemini-3.5-Transcribe

#37

Post by zhivota »

I'd certainly use Gemini API a lot more if I could figure out how to give them money and they give me tokens. The whole tier nonsense is just insane hoop jumping compared to their competition.

Re: Gemini-3.5-Transcribe

#38

Post by tech234a »

film42 wrote: post #11

Curious if this suffers from the same hallucination problems as Chirp or not. For example, if you pass chirp some audio with noise or even no audio, it will barf text at you like "I don't know. I don't know. I don't know." until a request timeout fires after like 10 minutes. It's... really bad. For this reason, we've moved back to Whisper for timestamp accuracy and then Gemini Flash for transcription correction.

I’ve noticed the some of YouTube’s auto-generated captions will sometimes hallucinate “Heat” during long music segments; probably an older model though.

Re: Gemini-3.5-Transcribe

#39

Post by crossroadsguy »

Lucasoato wrote: post #21

I’ve tested at least 20 STT models in a benchmark I’ve set up with German, Italian and English voices from meetings in my company. The voices contained very industry specific words, the languages changed from one sentence to another, sometimes words in a language were mentioned while a discussion was in another. The only local model that satisfies me is Voxtral Mini 3b, the only paid API that is slightly better is el…

Do you use it on a desktop? Mac by any chance? What's your setup?

I've been looking to find a simple and fast dictation app for English but almost everything I've tried (from Handy to many apps, eg some with Whisper in their names, after the model I assume) just don't work well. Apple's offering is worse than those though. I even tried with local enhancement models.

Post reply on HN