Live data from Hacker News

Show HN: Whispering – Open-source, local-first dictation you can trust

github.com

91–100 of 159 posts

Re: Show HN: Whispering – Open-source, local-first dictation you can trust

#91

I’m beginning to like the idea in this space — local first with a backup with your own tool. Recently, https://hyprnote.com was popular here on Hacker News and it is pretty good. They also do the same, works local-first but you can use your preferred tool too.

Totally agreed, huge fan of Hyprnote as well. We work on two slightly different problems, but a lot of our tech has overlap, and our missions especially overlap :)

Re: Show HN: Whispering – Open-source, local-first dictation you can trust

#93
post #85

Does this functionality exist on iOS ? I'm looking for an iOS app that wraps Parakeet or whisper in a custom iOS keyboard. That way I can switch to the dictation keyboard, press dictate, and have the transcription inserted in any application (first or third party). MacWhisper is fantastic for macOS system dictation but the same abilities don't exist on iOS yet. The native iOS dictation is quite good but not as accura…

superwhisper has that functionality.

Right but not running locally on device. No privacy

Re: Show HN: Whispering – Open-source, local-first dictation you can trust

#94

> "I think there should be an open-source, local-first version of every app, and I would like them all to work together. The idea of Epicenter is to store your data in a folder of plaintext and SQLite, and build a suite of interoperable, local-first tools on top of this shared memory. Everything is totally transparent, so you can trust it." Yes! This. I have almost no experience w/ tts, but if/when I explore the spac…

Thanks so much for the support! Really appreciate the feedback, and it’s great to hear the vision resonates. No worries on the STT/TTS experience; it’s just awesome to connect with someone who shares the values of open-source and owning our data :) I’m hoping my time in YC can be productive and, along the way, create more support for other OSS developers too. Keep in touch!

Re: Show HN: Whispering – Open-source, local-first dictation you can trust

#95
post #75

Earlier quoted context omitted.

Not yet, but I want it too! Parakeet looks incredible (saw that leaderboard result). My current roadmap is: finish stabilizing whisper.cpp integration, then add Parakeet support. If anyone has bandwidth to PR the connector, I’d be thrilled to merge it.

Unfortunately, because it's Nvidia, parakeet doesn't work with Whisper.cpp as far as I'm aware. You need onnx

Some lovely folks have left some other open-source projects that implement Parakeet. I would recommend checking those out! I'll also work on my own implementation in the meantime :D

Re: Show HN: Whispering – Open-source, local-first dictation you can trust

#96
post #82

Are there any speech-to-text models that are fully OSS for everything from training data/code to model weights? https://salsa.debian.org/deeplearning-team/ml-policy

Not that I know of. I think the two most prominent open-source models that we hear about are Whisper and Parakeet!

Re: Show HN: Whispering – Open-source, local-first dictation you can trust

#97

Looks like a really cool project. Do you have any opinions on which transcription models are the best, from a quality perspective? I have heard a lot of mixed opinions on this. Curious what you've found in your development process?

I'm a huge fan of using Whisper hosted on Groq since the transcription is near instantaneous. ElevenLabs' Scribe model is also particularly great with accuracy, and I use it for high-quality transcriptions or manually upload files to their API to get diarization and timestamps (https://elevenlabs.io/app/speech-to-text). That being said, I'm not the biggest expert on models. In my day-to-day workflow, I usually swap between Whisper C++ for local transcription or Groq if I want the best balance of speed/performance, unless I'm working on something particularly sensitive.

Re: Show HN: Whispering – Open-source, local-first dictation you can trust

#98

Earlier today I discovered Vibe: https://github.com/thewh1teagle/vibe Local, using WhisperX. Precompiled binaries available. I'm hoping to find and try a local-first version of an nvidia/canary like (like https://huggingface.co/nvidia/canary-qwen-2.5b ) since it's almost twice as fast as Whisper with even lower word-error-rate

Awesome, thank you so much for bringing this to my attention! Always cool to see other open source projects that have better implementations :) much to learn!

Re: Show HN: Whispering – Open-source, local-first dictation you can trust

#99
post #64

I've been interested in dictation for a while, but I don't want to be sending any audio to a remote API, it all has to be local. Having tried just a couple of models (namely the one used by the FUTO Keyboard), I'm kinda feeling like we're not quite there yet. My biggest gripe perhaps is not being able to get decent content out of a thought stream; the models can't properly filter out the pauses, "uuuuhmms", and much…

Have you tried Whisper itself? It's open-weights. One of the features of the project posted above is "transformations" that you can run on transcripts. They feed the text into an LLM to clean it up. If you're willing to pay for the tokens, I think you could not only remove filler-words, but could probably even get the semantically-aware editing (corrections) you're talking about.

^Yep, unfortunately, the best option right now seems to pipe the output into another LLM to do some cleanup, which we try to help you do in Whispering. Recent transcription models don't have very good built-in inference/cleanup, with Whisper having the very weak "prompt" parameter. It seems like this is probably by design to keep these models lean/specialized/performant in their task.

Re: Show HN: Whispering – Open-source, local-first dictation you can trust

#100
post #40
post #36

Really nice! For OsX there is also the great VoiceInk which is similar and open-source https://github.com/Beingpax/VoiceInk/

Very similar and works well. It’s a bring your own API key if you want/need. Also with local whisper.

Awesome, thank you so much for bringing this to my attention! Cool to see another open source project that has different implementations :) much to learn with their Parakeet implementation!
Post reply on HN