Earlier quoted context omitted.
I've been running whisper large-v3 on an m2 max through a self-hosted endpoint and honestly the accuracy is good enough that i stopped bothering with cleanup models. The bigger annoyance for me was latency on longer chunks, like anything over 30 seconds starts feeling sluggish even with metal acceleration. Haven't tried whisperkit specifically but curious how it handles longer audio compared to the full model.
Ah yeah, longform is interesting. Not sure how you're running it, via whichever "app thing", but... On resource limited machines: "Continuous recording" mode outputs when silence is detected via a configurable threshold. This outputs as you speak in more reasonable chunks; in aggregate "the same output" just chunked efficiently. Maybe you can try hackin' that up?
Show HN: Ghost Pepper – Local hold-to-talk speech-to-text for macOS
41–50 of 233 posts
Re: Show HN: Ghost Pepper – Local hold-to-talk speech-to-text for macOS
#42Hi Matt, there's lots of speech-to-text programs out there with varying levels of quality. 100% local is admirable but it's always a tradeoff and users have to decide for themselves what's worth it. Would you consider making available a video showing someone using the app?
Re: Show HN: Ghost Pepper – Local hold-to-talk speech-to-text for macOS
#43Re: Show HN: Ghost Pepper – Local hold-to-talk speech-to-text for macOS
#44Earlier quoted context omitted.
Thanks for sharing! I was literally getting ready to build, essentially, this. Now it looks like I don't have to! Have you ever considered using a foot-pedal for PTT? Apple incidentally already has native STT, but for some reason they just don't use a decent model yet.
sorry, PTT?
Re: Show HN: Ghost Pepper – Local hold-to-talk speech-to-text for macOS
#45Re: Show HN: Ghost Pepper – Local hold-to-talk speech-to-text for macOS
#46That’s awesome! Do you know how it compares to Handy? Handy is open source and local only too. It’s been around a while and what I’ve been using. https://github.com/cjpais/handy
Extra bonus is that Handy lets add an automatic LLM post-processor. This is very handy for the Parakeet V3 model, which can sometimes have issues where it repeats words or makes recognition errors for example, duplicating the recognition of a single word a dozen dozen dozen dozen dozen dozen dozen dozen times.
Re: Show HN: Ghost Pepper – Local hold-to-talk speech-to-text for macOS
#47I have collected the best open-source voice typing tools categorized by platform in this awesome-style GitHub repo. Hope you all find this useful!
Re: Show HN: Ghost Pepper – Local hold-to-talk speech-to-text for macOS
#48Re: Show HN: Ghost Pepper – Local hold-to-talk speech-to-text for macOS
#49Not sure why I should use this instead of the baked-in OS dictation features (which I use almost daily--just double-tap the world key, and you're there). What's the advantage?
Re: Show HN: Ghost Pepper – Local hold-to-talk speech-to-text for macOS
#50Sadly the app doesn't work. There is no popup asking for microphone permission. EDIT: I see there is an open issue for that on github
And many people are mailing in Codex and Claude Code generated PRs - myself included. Fingers crossed, I suppose.