Show HN: Real-time AI (audio/video in, voice out) on an M3 Pro with Gemma E2B
1–10 of 47 posts
Re: Show HN: Real-time AI (audio/video in, voice out) on an M3 Pro with Gemma E2B
#2Solid work and great showcase, I've done a bunch of stuff with Kokoro and the latency is incredible. So crazy how badly Apple dropped the ball... feels like your demo should be a Siri demo (I mean that in the most complimentary way possible).
Re: Show HN: Real-time AI (audio/video in, voice out) on an M3 Pro with Gemma E2B
#3[deleted]
Re: Show HN: Real-time AI (audio/video in, voice out) on an M3 Pro with Gemma E2B
#4Solid work and great showcase, I've done a bunch of stuff with Kokoro and the latency is incredible. So crazy how badly Apple dropped the ball... feels like your demo should be a Siri demo (I mean that in the most complimentary way possible).
Thank you. This reminds me of a paragraph from the LatentSpace newsletter [0]
> The excellent on device capabilities makes one wonder if these are the basis for the models that will be deployed in New Siri under the deal with Apple….
https://www.latent.space/p/ainews-gemma-4-the-best-small-mul...
Re: Show HN: Real-time AI (audio/video in, voice out) on an M3 Pro with Gemma E2B
#5Amazing, love your work ,
Re: Show HN: Real-time AI (audio/video in, voice out) on an M3 Pro with Gemma E2B
#6[dead]
Re: Show HN: Real-time AI (audio/video in, voice out) on an M3 Pro with Gemma E2B
#7I have been looking forward to build something like this using open models. A voice assisstant I can talk while I am driving, as I do have long commute. I do use chatGPT voice mode and it works great for querying any information or discussions. But I want to do tasks like browsing web, act like a social media manager for my business etc.
Re: Show HN: Real-time AI (audio/video in, voice out) on an M3 Pro with Gemma E2B
#8That is very, very interesting. I've been hoping to have an assistant in the workshop (hands-free!) that I could talk to and have it help me with simple tasks: timers, calculating, digging up notes, etc. — basically, what the phone assistants were supposed to be, but aren't.
"You will have to unlock your iphone first" is kind of a deal-breaker when you are in the middle of mixing polyurethane resin and have gloves and a mask on.
More and more I find that we have the technology, but the supposedly "tech" companies are the gatekeepers, preventing us from using the technological advances and holding us back years behind the state of the art.
I'll be trying this out on my Macbook, looks very promising!
Re: Show HN: Real-time AI (audio/video in, voice out) on an M3 Pro with Gemma E2B
#9Can someone quickly vibe code MacOS native app for that so it doesn't require running terminal commands and searching for that browser tab? (: (also for iOS, pls)
Re: Show HN: Real-time AI (audio/video in, voice out) on an M3 Pro with Gemma E2B
#10I am making something similar. Also been using Kokoro for TTS. Very cool project!
Gemma 4 is kinda too heavyweight even with E2B. I am sticking with qwen 0.8B at the moment.