Live data from Hacker News

Apple's new SpeechAnalyzer API, benchmarked against Whisper and its predecessor

get-inscribe.com

241–250 of 251 posts

Re: Apple's new SpeechAnalyzer API, benchmarked against Whisper and its predecessor

#242

I run SuperWhisper on both my Mac (where is uses Whisper) and my iPhone (where it uses SpeechAnalyzer and have found that SA does indeed run faster and anecdotally more accurately. Super exciting!

Lifetime subscriber to a Superwhisper. How do you have SpeechAnalyzer to run as a model on iOS??

Re: Apple's new SpeechAnalyzer API, benchmarked against Whisper and its predecessor

#243

Earlier quoted context omitted.

Oh yeah, this one’s worth hyperlinking https://dictator.robgough.net Great work Rob! Indeed private as promised per App Privacy Report, “Domains contacted directly by app”: cas-bridge.xethub.hf.co; huggingface.co; mzstorekit.itunes.apple.com Site could identify our device and send iOS visitors to the iOS page (or maybe that’s against the vibe and we should tap it ourselves). App might be able to launch the keyboard s…

I appreciate the kind words. Thank you. I really wanted to have background audio and make it so the keyboard would directly record audio etc, but my first pass didn't make it through app review (and that was just keeping background audio listening AFTER you'd already started a recording). I could maybe have fought it, but figured if I was already butting up against app review there was little point as they'd likely r…

Analytics: if you generate them on my device, and bury an option to manually send them to you when I have a bug--or...

you instead bury an opt-in to automatic telemetry, and let us CC ourselves each ~month when the analytics get sent in to you (so we can verify it's all boring data)...

It's hard for me not to opt in to stuff like that, at least periodically. If I'm opted-in by default? Ehhhhh.... I totally get it, weird "flying blind" (quoting a different dev w/similar philosophy), but I guess I'm still weird myself and hence looking for that autonomy or something? Oh and if somebody makes something opt in, and then certainly if they furthermore stick the option somewhere slightly off the beaten path, that seems pretty darn trustworthy.

(I wonder if we'd have enough public data for a decent statistician to calculate a likely number range of how many users you have by extrapolating from the 1% to 10% or 20% of users who'd chose to opt in...)

PS: "bury" concept likely not actually important :)

Re: Apple's new SpeechAnalyzer API, benchmarked against Whisper and its predecessor

#244

I use Spokenly, offline-only mode with the Nvidia model. All local, totally free. Highly recommend

Spokenly is not 100% free.

If you use the offline-only models (I use the Nvidia one and it's great) and put it in offline mode it is. I've used it for 6 months and haven't paid anything

Re: Apple's new SpeechAnalyzer API, benchmarked against Whisper and its predecessor

#246
post #162

Earlier quoted context omitted.

The Two Yoots problem. Do you use d's in place of t's such as dees/dems/dose/dere? I have a heavy queens accent so you'll hear me say things like "deres tree uh dem ova dere."

Surprised to read this as a Queens thing, this sounds perfectly at home in the Midwest.

It's spoken fast with a nasal tone.

Re: Apple's new SpeechAnalyzer API, benchmarked against Whisper and its predecessor

#247

Author here. I ship both Apple speech engines plus WhisperKit side by side in a transcription app, which made it possible to run all five through identical production code on the same audio: LibriSpeech test-clean and test-other, 5,559 utterances, fully on-device on an M2 Pro. Apple published no accuracy numbers for SpeechAnalyzer (or for SFSpeechRecognizer, ever, as far as I can tell), so the migration question has…

[dead]

Re: Apple's new SpeechAnalyzer API, benchmarked against Whisper and its predecessor

#248

Earlier quoted context omitted.

That app was exactly what I was looking for, something like SponsorBlock but for podcasts but I suppose using AI for finding the ads works too. Any chance it'll release on Android?

Yep it's something I wanted for a while too; there were existing apps that did this, but had two issues: they were paid, and the UI was subpar. So for mine, I made sure it's fully free and that the UI is on par with Apple Podcasts, Spotify, etc. Making the ad-finding cheap enough such that I could make it free turned out to be harder than expected. The main issue you run into is dynamic, location-targeted ads. So I c…

Could you speak more on the Shazam style part? Don't you need a database of all ads to figure out if some snippet is an ad or not? That's how Shazam works for songs at least.

A native implementation I had thought of was running the audio through a STT LLM that then detects the ad timestamps then returns that to the UI to block.

Re: Apple's new SpeechAnalyzer API, benchmarked against Whisper and its predecessor

#249

Earlier quoted context omitted.

Yep it's something I wanted for a while too; there were existing apps that did this, but had two issues: they were paid, and the UI was subpar. So for mine, I made sure it's fully free and that the UI is on par with Apple Podcasts, Spotify, etc. Making the ad-finding cheap enough such that I could make it free turned out to be harder than expected. The main issue you run into is dynamic, location-targeted ads. So I c…

Could you speak more on the Shazam style part? Don't you need a database of all ads to figure out if some snippet is an ad or not? That's how Shazam works for songs at least. A native implementation I had thought of was running the audio through a STT LLM that then detects the ad timestamps then returns that to the UI to block.

Yeah that's what I do (STT -> LLM -> timestamps to block), but if you did that for every episode download, due to location-targeted dynamic ads, your LLM API bill would run up very fast. So that's where the fingerprints matching comes in, for further versions of an episode (version = same episode but with different dynamic ads inside).

I explained how the full system works here (someone emailed me and asked): https://pastebin.com/raw/r2YUEkK5

Post reply on HN