Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Apple's new SpeechAnalyzer API, benchmarked against Whisper and its predecessor

get-inscribe.com

Post reply on HN
Print view View original

181–190 of 251 posts

Re: Apple's new SpeechAnalyzer API, benchmarked against Whisper and its predecessor

#182

Post by phren0logy »

z2 wrote: post #123
satvikpendem wrote: post #34

Whisper is the wrong model to benchmark against, or rather, there are better models that are state of the art now like Nemotron and Parakeet both by Nvidia, as well as Mistral's Voxtral and Cohere Transcribe. However, what's funny is, RIP to a lot of the paid apps that simply wrap Whisper, I'm sure Apple will make a native GUI such as a recorder app for macOS that obviates the need for these wrappers, which everyone…

I don’t know how Apple divides computation between the GPU and the Neural Engine, but one major benefit, especially for real-time transcription on laptops, is the improved power and thermal efficiency. I noticed better accuracy after switching my app to SpeechAnalyzer, and I suspect part of that improvement for me came from the microphone no longer having to compete with jet-engine fan noise.

What Apple laptop has “jet-engine fan noise”?

Re: Apple's new SpeechAnalyzer API, benchmarked against Whisper and its predecessor

#183

Post by FuckButtons »

swiftcoder wrote: post #135
FuckButtons wrote: post #117

Earlier quoted context omitted.

Yeah, apple will be optimizing a model to work on ANE and then turn it into a native app. My only hope is that it has a reasonable api so that I can use that as a generic input source across iOS / macOS that’s equivalent to the ubiquity of the keyboard.

Presumably the existing transcribe button on the keyboard will route through this on iOS 26?

One would hope, though I suspect they may want to make things a bit flashier than “we made the audio transcription on the keyboard not terrible” in the changelog given the amount of work that’s gone in.

Re: Apple's new SpeechAnalyzer API, benchmarked against Whisper and its predecessor

#184

Post by Gagarin1917 »

satvikpendem wrote: post #34

Whisper is the wrong model to benchmark against, or rather, there are better models that are state of the art now like Nemotron and Parakeet both by Nvidia, as well as Mistral's Voxtral and Cohere Transcribe. However, what's funny is, RIP to a lot of the paid apps that simply wrap Whisper, I'm sure Apple will make a native GUI such as a recorder app for macOS that obviates the need for these wrappers, which everyone…

Any models that can understand thick accents better than I can?

Anytime I’m talking to an Indian on the other end, I have to have them repeat everything 2 or 3 times.

Re: Apple's new SpeechAnalyzer API, benchmarked against Whisper and its predecessor

#185

Post by satvikpendem »

arjie wrote: post #157
satvikpendem wrote: post #151

Earlier quoted context omitted.

MOSS-Transcribe-Diarize [0] is by a Chinese team so apparently it's quite good. Try it out here [1]. [0] https://huggingface.co/OpenMOSS-Team/MOSS-Transcribe-Diarize [1] https://huggingface.co/spaces/OpenMOSS-Team/MOSS-transcribe-...

Thank you very much.

I'd also look at the Qwen ASR models, also Chinese made, by Alibaba

Re: Apple's new SpeechAnalyzer API, benchmarked against Whisper and its predecessor

#187

Post by mvkel »

One tangible thing this doesn't touch on: SpeechAnalyzer supports streaming, so you can see what it's hearing from you as you talk. A massive UX improvement. Many of the other models force you to record, then it transcribes the audio to text as a single job, then returns the entire blob of text. It's slow, and frustrating if you're talking, only to realize it stopped listening after 2 minutes.

Re: Apple's new SpeechAnalyzer API, benchmarked against Whisper and its predecessor

#189

Post by yangshutech »

I didn't expect Apple's SpeechAnalyzer to see such an impressive improvement. However, Whisper's biggest moat remains its cross-platform availability and support for 100+ languages. It would be awesome if SpeechAnalyzer could match that level of platform and language coverage.
Post reply on HN