Live data from Hacker News

Cohere Transcribe: Speech Recognition

cohere.com

21–30 of 77 posts

Re: Cohere Transcribe: Speech Recognition

#24
post #15
post #10

> Limitations >Timestamps/Speaker diarization. The model does not feature either of these. What a shame. Is whisperx still the best choice if you want timestamps/diarization?

Even in the commercial space, there’s a lack of production grade ASR APIs that support diarization and word level timestamps. My experiences with Google’s Chirp have been horrendous, with it sometimes skipping sections of speech entirely, hallucinating speech where the audio contains noise, and unreliable word level timestamps. And this all is even with using their new audio prefiltering feature. AWS works slightly b…

Isn't Elevenlabs the best in this?

Re: Cohere Transcribe: Speech Recognition

#26

I had to set-up fireflies for our company recently. Cool tool, but I'm sending dozens of internal meetings to an american company. Our ISO inspector wouldn't be pleased to know. This is a good option. Will check it out.

There are many open source STT models that can run locally on Mac with good performance, such as whisper and Parakeet

Re: Cohere Transcribe: Speech Recognition

#27
post #10

> Limitations >Timestamps/Speaker diarization. The model does not feature either of these. What a shame. Is whisperx still the best choice if you want timestamps/diarization?

I would try Qwen-ASR: https://qwen.ai/blog?id=qwen3asr

See the very bottom of the page for a transcription with timestamps.

Re: Cohere Transcribe: Speech Recognition

#28

My worry is that ASR will end up like OCR. If the multi modal large AI system is good enough (latency wise), the advantage of domain understanding eats the other technlogies alive. In OCR, even when the characters are poorly scanned, the deep domain understanding these large multi modal AIs have allows it to understand what the document actually meant - this is going to be order id because in the million invoices I h…

This is exactly the case today. Multimodal LLMs like gpt-4o-transcribe are way better than traditional ASR, not only because of deeper understanding but because of the ability to actually prompt it with your company's specific terminology, org chart, etc.

For example, if the prompt includes that Caitlin is an accountant and Kaitlyn is an engineer, if you transcribe "Tell Kaitlyn to review my PR" it will know who you're referring to. That's something WER doesn't really capture.

BTW, I built an open-source Mac tool for using gpt-4o-transcribe with an OpenAI API key and custom prompts: https://github.com/corlinp/voibe

Re: Cohere Transcribe: Speech Recognition

#29
post #25

To clarify, this is SOTA in its size category, right? It's not better than Parakeet, for example?

Well, to clarify, it is both larger than parakeet in parameter count (parakeet is available in 0.6B and 1.1B), since it's 2B params, and also performs better than it on the benchmarks that hugging face publishes on the openASR leaderboard
Post reply on HN