Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Apple's new SpeechAnalyzer API, benchmarked against Whisper and its predecessor

get-inscribe.com

Post reply on HN
Print view View original

81–90 of 251 posts

Re: Apple's new SpeechAnalyzer API, benchmarked against Whisper and its predecessor

#81

Post by techsystems »

wahnfrieden wrote: post #41
satvikpendem wrote: post #34

Whisper is the wrong model to benchmark against, or rather, there are better models that are state of the art now like Nemotron and Parakeet both by Nvidia, as well as Mistral's Voxtral and Cohere Transcribe. However, what's funny is, RIP to a lot of the paid apps that simply wrap Whisper, I'm sure Apple will make a native GUI such as a recorder app for macOS that obviates the need for these wrappers, which everyone…

For multilingual and noisy audio the best right now is MOSS-Transcribe-Diarize which was released just a few days ago Superwhisper does a lot more than just provide a whisper/parakeet UI so I’m not sure Apple will destroy them so easily

Interesting! And what would you say are MTD top competitors?

Re: Apple's new SpeechAnalyzer API, benchmarked against Whisper and its predecessor

#83

Post by madeofpalk »

drnick1 wrote: post #48
edude03 wrote: post #40

Earlier quoted context omitted.

It's not open weight, but the point is to be an on device (and thus local, privacy preserving) option. The article mentions that as the caveat > What this means if you just want good transcription > If you are on a current iPhone or Mac, the best on-device transcription engine for English is already in the operating system, and the private option is no longer the compromise option

> It's not open weight, but the point is to be an on device (and thus local, privacy preserving) option. How can you be sure this isn't leaking data or metadata to Apple? Can Apple really be trusted?

Test it! Does it make network requests? Unplug the internet and see if it still works!

Re: Apple's new SpeechAnalyzer API, benchmarked against Whisper and its predecessor

#84

Post by hectdev »

al_borland wrote: post #77
athnak wrote: post #67

Earlier quoted context omitted.

Apple's own Voice Memos app already does automatic transcription since macOS 15 / iOS 18.

Speech-to-text is also already built into the keyboard as well, so it can be used in any app where a user would type.

From my experience, Speech-to-text falls way short of Wispr flow and I would assume the ones that are said to be better than that. It lacks context awareness and formatting

Re: Apple's new SpeechAnalyzer API, benchmarked against Whisper and its predecessor

#85

Post by bellowsgulch »

satvikpendem wrote: post #34

Whisper is the wrong model to benchmark against, or rather, there are better models that are state of the art now like Nemotron and Parakeet both by Nvidia, as well as Mistral's Voxtral and Cohere Transcribe. However, what's funny is, RIP to a lot of the paid apps that simply wrap Whisper, I'm sure Apple will make a native GUI such as a recorder app for macOS that obviates the need for these wrappers, which everyone…

> However, what's funny is, RIP to a lot of the paid apps that simply wrap Whisper, I'm sure Apple will make a native GUI such as a recorder app for macOS that obviates the need for these wrappers, which everyone seems to be vibe coding these days.

What's insane to me is that you have all of these low-quality me-too apps, and literally no one could bother to read the damn Human Interface Guidelines or follow iOS design conventions.

Doing so is literally LESS WORK than trying to make your own custom awful iOS UI.

Re: Apple's new SpeechAnalyzer API, benchmarked against Whisper and its predecessor

#86

Post by endymi0n »

Finally. I‘d be delighted though if they actually implemented language autodetection (like everywhere else) though. There’s little more frustrating in my day to day than having dictated half a page to find that it‘s complete gibberish because Apple forces you to select the right language first…

Re: Apple's new SpeechAnalyzer API, benchmarked against Whisper and its predecessor

#88

Post by rconti »

paul7986 wrote: post #31
kridsdale1 wrote: post #11

Earlier quoted context omitted.

I’m on iPhone 17 Pro Max, 27 beta 3. New Siri is impressive in that it answers satisfactorily now 80% of the time vs 10% with old Siri. But it’s slow as shit. GPT, Claude, and Gemini can answer me in 5-10 seconds. Google AI Mode can answer in 2 seconds. New Siri usually takes 25 seconds to respond to me. This morning it timed out (with strong network connection) when asked a simple multiplication question.

Damn slow on your newer phone too.

That's crappy, but it's also a beta, so it's not yet time to render a verdict.

Re: Apple's new SpeechAnalyzer API, benchmarked against Whisper and its predecessor

#90

Post by orbital-decay »

satvikpendem wrote: post #34

Whisper is the wrong model to benchmark against, or rather, there are better models that are state of the art now like Nemotron and Parakeet both by Nvidia, as well as Mistral's Voxtral and Cohere Transcribe. However, what's funny is, RIP to a lot of the paid apps that simply wrap Whisper, I'm sure Apple will make a native GUI such as a recorder app for macOS that obviates the need for these wrappers, which everyone…

Of these only Parakeet is <1B, it looks better than Apple's model, however it's not builtin. I wonder how it compares on latency and efficiency.
Post reply on HN