Live data from Hacker News

Show HN: Real-time AI (audio/video in, voice out) on an M3 Pro with Gemma E2B

github.com

31–40 of 47 posts

Re: Show HN: Real-time AI (audio/video in, voice out) on an M3 Pro with Gemma E2B

#31
post #8

That is very, very interesting. I've been hoping to have an assistant in the workshop (hands-free!) that I could talk to and have it help me with simple tasks: timers, calculating, digging up notes, etc. — basically, what the phone assistants were supposed to be, but aren't. "You will have to unlock your iphone first" is kind of a deal-breaker when you are in the middle of mixing polyurethane resin and have gloves an…

Siri does have a setting that'll activate it if you say "hey siri" while the phone is locked. Obvious privacy and battery usage concerns though, and it's still Siri, so it's a little clunky.

Mhm. I think I use that. But then I say "call my wife" and it says "you'll need to unlock your iphone first".

It's clear Tim Cook doesn't ever try to use Siri wearing gloves. Or ever, for that matter :-)

Re: Show HN: Real-time AI (audio/video in, voice out) on an M3 Pro with Gemma E2B

#32
post #31

Earlier quoted context omitted.

Siri does have a setting that'll activate it if you say "hey siri" while the phone is locked. Obvious privacy and battery usage concerns though, and it's still Siri, so it's a little clunky.

Mhm. I think I use that. But then I say "call my wife" and it says "you'll need to unlock your iphone first". It's clear Tim Cook doesn't ever try to use Siri wearing gloves. Or ever, for that matter :-)

Siri (on iOS 18, at least) will call people for me without unlocking, in response to a voice command only - I just double-checked...

Re: Show HN: Real-time AI (audio/video in, voice out) on an M3 Pro with Gemma E2B

#34
I have to try it out on my idle laptops. I've been meaning to run some models on them for low cost tasks that need AI - like sorting and filtering photos from 100s of thousands that I have amassed over the years. And applying general size reduction compression to the filtered ones.

Btw if anyone has already created such a pipeline/workflow using such models, please lmk!

Re: Show HN: Real-time AI (audio/video in, voice out) on an M3 Pro with Gemma E2B

#38

If I run this without internet connection it says "loading..." at the bottom of the localhost site and won't work. If I run this with internet connected it works flawlessly. Even if I disconnect my internet afterwards it still goes on working fine. Why there has to be an internet connection established at the time I open the localhost site when all of this should be working purely on device? Despite of this, I am rea…

the index.html is loading remote js files: https://github.com/fikrikarim/parlor/blob/main/src/index.htm...

I saved them locally and changed the reference, and it worked perfectly.

Re: Show HN: Real-time AI (audio/video in, voice out) on an M3 Pro with Gemma E2B

#39
post #24

Earlier quoted context omitted.

Huh that's weird. I just tried it and it works on my machine. Could you perhaps create a GitHub issue and share the reproduction steps and any relevant logs?

Don't have the time right now but will play around with it next weekend for sure and will give you more feedback with logs when I see that I can reproduce it. For now what I did was: - Tested in Chrome/Safari/Firefox on Tahoe. - Followed the quick start install instructions from github repo - Everything worked - Closed terminal - Disconnected internet (Wifi off) - Opened terminal - Started server again (uv run server…

Is this the problem? https://news.ycombinator.com/item?id=47669954

Re: Show HN: Real-time AI (audio/video in, voice out) on an M3 Pro with Gemma E2B

#40
post #35

I've been trying to do this, but I can't get voice recognition to work fast enough (meaning live) with Gemma E2B, on either an M1 max (64GB), a 5060 Ti (16Gb) or a SnapDragon 8 Gen2. Any pointers?

What's your average response time with M1 max and what's the target?
Post reply on HN