Live data from Hacker News

Ask HN: What's the current best local/open speech-to-speech setup?

news.ycombinator.com

71–78 of 78 posts

Re: Ask HN: What's the current best local/open speech-to-speech setup?

#71

Earlier quoted context omitted.

A 25MB TTS model: https://github.com/kittenml/kittentts

Nice, I’ll have to try it out. They should really make a uv-installable CLI tool like pocket-TTS did. People underestimate just how much more immediately usable something becomes when you can simply get something by doing “uv tool install …”

True that. People, especially developers, underestimate the importance of packaging. Or, in general, making it easier for others to use your product.

Re: Ask HN: What's the current best local/open speech-to-speech setup?

#72
My time to shine!

I just open sourced a REST API and framework that you can point any of your projects to such as OpenClaw so you can do TTS and SST using your own hardware.

It's specially focused on Mac M-class chips to utilize MLX:

https://github.com/Sogni-AI/sogni-voice

All free and open source.

Internally it uses Parakeet, Kokoro TTS, Qwen3 TTS (with voice cloning support!) Also supports creating your own API key to lock your API to your own apps.

Re: Ask HN: What's the current best local/open speech-to-speech setup?

#73

This is not strictly speech-to-speech, but I quite like it when working with Claude Code or other CLI Agents: STT: Handy [1] (open-source), with Parakeet V3 - stunningly fast, near-instant transcription. The slight accuracy drop relative to bigger models is immaterial when you're talking to an AI. I always ask it to restate back to me what it understood, and it gives back a nicely structured version -- this helps con…

I've been dabbling with STT quite a bit and built my own tool using Deepgram. But just tried Handy and it's SO FREAKING FAST! Love it.

Re: Ask HN: What's the current best local/open speech-to-speech setup?

#74

Earlier quoted context omitted.

A 25MB TTS model: https://github.com/kittenml/kittentts

Nice, I’ll have to try it out. They should really make a uv-installable CLI tool like pocket-TTS did. People underestimate just how much more immediately usable something becomes when you can simply get something by doing “uv tool install …”

So I benchmarked it and there’s really no advantage over pocket TTS. There are some tradeoffs like Kitten doesn’t have streaming audio.

Re: Ask HN: What's the current best local/open speech-to-speech setup?

#75
post #73

This is not strictly speech-to-speech, but I quite like it when working with Claude Code or other CLI Agents: STT: Handy [1] (open-source), with Parakeet V3 - stunningly fast, near-instant transcription. The slight accuracy drop relative to bigger models is immaterial when you're talking to an AI. I always ask it to restate back to me what it understood, and it gives back a nicely structured version -- this helps con…

I've been dabbling with STT quite a bit and built my own tool using Deepgram. But just tried Handy and it's SO FREAKING FAST! Love it.

Yes especially with Parakeet V3. It’s also nicely hackable, I Clauded a couple PRs to improve the experience, like removing stutters and filler words.

Re: Ask HN: What's the current best local/open speech-to-speech setup?

#76
post #73

This is not strictly speech-to-speech, but I quite like it when working with Claude Code or other CLI Agents: STT: Handy [1] (open-source), with Parakeet V3 - stunningly fast, near-instant transcription. The slight accuracy drop relative to bigger models is immaterial when you're talking to an AI. I always ask it to restate back to me what it understood, and it gives back a nicely structured version -- this helps con…

I've been dabbling with STT quite a bit and built my own tool using Deepgram. But just tried Handy and it's SO FREAKING FAST! Love it.

For local speech-to-text, Whisper remains the gold standard - you can run it locally with good accuracy across languages. For speech-to-speech, you'd typically chain Whisper with a local TTS model like Coqui TTS or use something like Tortoise TTS for higher quality but slower processing. The key is balancing accuracy, speed, and resource usage based on your specific use case. If you're doing content creation workflows, consider what post-processing you might need - sometimes the raw transcription needs structure and enhancement beyond just accurate words.

Re: Ask HN: What's the current best local/open speech-to-speech setup?

#77
post #73

This is not strictly speech-to-speech, but I quite like it when working with Claude Code or other CLI Agents: STT: Handy [1] (open-source), with Parakeet V3 - stunningly fast, near-instant transcription. The slight accuracy drop relative to bigger models is immaterial when you're talking to an AI. I always ask it to restate back to me what it understood, and it gives back a nicely structured version -- this helps con…

I've been dabbling with STT quite a bit and built my own tool using Deepgram. But just tried Handy and it's SO FREAKING FAST! Love it.

Hex is my new favorite STT on MacOS. Also uses Parakeet V3. I didn't think it could possibly be faster than Handy, but it is much faster - even long ramblings transcribed within a second. It's MacOS only, leverages the CoreML / Apple Neural Engine.

https://github.com/kitlangton/Hex

Also the transcriptions with hex don't seem to suffer from some of the issues with Handy, such as stutter.

Re: Ask HN: What's the current best local/open speech-to-speech setup?

#78
post #73

Earlier quoted context omitted.

I've been dabbling with STT quite a bit and built my own tool using Deepgram. But just tried Handy and it's SO FREAKING FAST! Love it.

For local speech-to-text, Whisper remains the gold standard - you can run it locally with good accuracy across languages. For speech-to-speech, you'd typically chain Whisper with a local TTS model like Coqui TTS or use something like Tortoise TTS for higher quality but slower processing. The key is balancing accuracy, speed, and resource usage based on your specific use case. If you're doing content creation workflow…

+1 on the post-processing point. Raw Whisper output is ~90% there but punctuation, grammar, and formatting are the missing piece.

I built MumbleFlow to address exactly this — whisper.cpp for STT plus llama.cpp for smart text cleanup, all running on-device. Metal/CUDA accelerated, sub-second latency on Apple Silicon. Global hotkey works in any app.

$5 one-time, no cloud, no subscription. https://mumble.helix-co.com

Post reply on HN