Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Show HN: Real-time AI Voice Chat at ~500ms Latency

github.com

Post reply on HN
Print view View original

181–190 of 238 posts

Re: Show HN: Real-time AI Voice Chat at ~500ms Latency

#181

Post by [deleted] »

atoav wrote: post #169
sabellito wrote: post #164

Every time I see these things, they look cool as hell, I get excited, then I try to get them working on my gaming PC (that has the GPU), I spend 1-2h fighting with python and give up. Today's issue is that my python version is 3.12 instead of =3.9. Installing python 3.11 from the official website does nothing, I give up. It's a shame that the amazing work done by people like the OP gets underused because of this mess…

uv is the way. https://docs.astral.sh/uv/ Sadly it appears that people in the LLM space aren't really all that good at packaging their software (maybe, on purpose).

[deleted]

Re: Show HN: Real-time AI Voice Chat at ~500ms Latency

#182

Post by scld »

atoav wrote: post #169
sabellito wrote: post #164

Every time I see these things, they look cool as hell, I get excited, then I try to get them working on my gaming PC (that has the GPU), I spend 1-2h fighting with python and give up. Today's issue is that my python version is 3.12 instead of =3.9. Installing python 3.11 from the official website does nothing, I give up. It's a shame that the amazing work done by people like the OP gets underused because of this mess…

uv is the way. https://docs.astral.sh/uv/ Sadly it appears that people in the LLM space aren't really all that good at packaging their software (maybe, on purpose).

Probably because they're just prompting "Please package this software" and shipping it if it works once.

Re: Show HN: Real-time AI Voice Chat at ~500ms Latency

#183

Post by marziply »

sabellito wrote: post #164

Every time I see these things, they look cool as hell, I get excited, then I try to get them working on my gaming PC (that has the GPU), I spend 1-2h fighting with python and give up. Today's issue is that my python version is 3.12 instead of =3.9. Installing python 3.11 from the official website does nothing, I give up. It's a shame that the amazing work done by people like the OP gets underused because of this mess…

Don't use Bindows then? The tech industry is largely focused on Unix systems so of course there will be inevitable sharp edges when you work on a garbage system like Bindows...

Re: Show HN: Real-time AI Voice Chat at ~500ms Latency

#184

Post by s5ma6n »

jhoho wrote: post #167
sabellito wrote: post #164

Every time I see these things, they look cool as hell, I get excited, then I try to get them working on my gaming PC (that has the GPU), I spend 1-2h fighting with python and give up. Today's issue is that my python version is 3.12 instead of =3.9. Installing python 3.11 from the official website does nothing, I give up. It's a shame that the amazing work done by people like the OP gets underused because of this mess…

Let me introduce you to the beautiful world of virtual environments. They save you the headache of getting a full installation to run, especially when using Windows. I prefer miniconda, but venv also does the job.

I am also using conda and specifically mamba which has a really quick dependency solver.

However, sometimes repos require system level packages as well. Tried to run TRELLIS recently and gave up after 2h of tinkering around to get it to work in Windows.

Also, whenever I try to run some new repo locally, creating a new virtual environment takes a ton of disk space due to CUDA and PyTorch libraries. It adds up quickly to 100s of gigs since most projects use different versions of these libraries.

Sorry for the rant, can't help myself when it's Python package management...

Re: Show HN: Real-time AI Voice Chat at ~500ms Latency

#185

Post by tjbiddle »

smusamashah wrote: post #4

Saying this as a user of these tools (openai, Google voice chat etc). These are fast yes, but they don't allow talking naturally with pauses. When we talk, we take long and small pauses for thinking or for other reasons. With these tools, AI starts taking as soon as we stop. Happens both in text and voice chat tools. I saw a demo on twitter a few weeks back where AI was waiting for the person to actually finish what…

Ha - I have this issue even with non-AI voice assistants like Alexa.

"Hey Alexa, turn the lights to..." thinks for a second while I decide on my mood

"I don't know how to set lights to that setting"

"...blue... damnit."

Re: Show HN: Real-time AI Voice Chat at ~500ms Latency

#186

Post by zo1 »

sabellito wrote: post #164

Every time I see these things, they look cool as hell, I get excited, then I try to get them working on my gaming PC (that has the GPU), I spend 1-2h fighting with python and give up. Today's issue is that my python version is 3.12 instead of =3.9. Installing python 3.11 from the official website does nothing, I give up. It's a shame that the amazing work done by people like the OP gets underused because of this mess…

Do you know how much time I (or any other dev) would spend getting a C#, or C++, or JS/TS, or Java or any language project running that has anything to do with ML up and running on tech and tooling we are kinda unfamiliar with? Yes, pretty much 1-2 hours, and very likely more.

Sorry but this sort of criticism is so contrived and low-effort. "Oh I tried compiling a language I don't know, using tooling I never use, using an OS I never use (and I hate too btw), and have no experience in any of it, oh and on a brand-new project that's kinda cutting-edge and doing something experimental with an AI/ML model."

I could copy-paste your entire thing, replace Windows with Mac, complain about homebrew that I have no idea how to use, developing an iMac app using SwiftUI in some rando editor (probably VSCode or VI), and it would still be the case. It says 0 about the ecosystem, 0 about the OS, 0 about the tools you use, 0 about you as a developer, and dare I say >0 about the usefulness of the comment.

Re: Show HN: Real-time AI Voice Chat at ~500ms Latency

#187

Post by laborcontract »

regularfry wrote: post #176
jhoho wrote: post #167

Earlier quoted context omitted.

Let me introduce you to the beautiful world of virtual environments. They save you the headache of getting a full installation to run, especially when using Windows. I prefer miniconda, but venv also does the job.

Virtual environments with venv don't answer the python version problem unless you throw another tool into the mix.

uv solves this problem.

  uv venv python3.11
done.

Re: Show HN: Real-time AI Voice Chat at ~500ms Latency

#188

Post by turnsout »

jhoho wrote: post #167
sabellito wrote: post #164

Every time I see these things, they look cool as hell, I get excited, then I try to get them working on my gaming PC (that has the GPU), I spend 1-2h fighting with python and give up. Today's issue is that my python version is 3.12 instead of =3.9. Installing python 3.11 from the official website does nothing, I give up. It's a shame that the amazing work done by people like the OP gets underused because of this mess…

Let me introduce you to the beautiful world of virtual environments. They save you the headache of getting a full installation to run, especially when using Windows. I prefer miniconda, but venv also does the job.

And this works about 25% of the time. The rest of the time, there is some inscrutable error with the version number of a dependency in requirements.txt or something similar, which you end up Googling, only to find an open issue on a different project's Github repo.

Someone needs to make an LLM agent that just handles Python dependency hell.

Re: Show HN: Real-time AI Voice Chat at ~500ms Latency

#189

Post by releaslot »

turnsout wrote: post #188
jhoho wrote: post #167

Earlier quoted context omitted.

Let me introduce you to the beautiful world of virtual environments. They save you the headache of getting a full installation to run, especially when using Windows. I prefer miniconda, but venv also does the job.

And this works about 25% of the time. The rest of the time, there is some inscrutable error with the version number of a dependency in requirements.txt or something similar, which you end up Googling, only to find an open issue on a different project's Github repo. Someone needs to make an LLM agent that just handles Python dependency hell.

"Someone needs to make an LLM agent that just handles Python dependency hell."

This is why they are constantly delaying GPT 5.

Re: Show HN: Real-time AI Voice Chat at ~500ms Latency

#190

Post by TeamDman »

zo1 wrote: post #186
sabellito wrote: post #164

Every time I see these things, they look cool as hell, I get excited, then I try to get them working on my gaming PC (that has the GPU), I spend 1-2h fighting with python and give up. Today's issue is that my python version is 3.12 instead of =3.9. Installing python 3.11 from the official website does nothing, I give up. It's a shame that the amazing work done by people like the OP gets underused because of this mess…

Do you know how much time I (or any other dev) would spend getting a C#, or C++, or JS/TS, or Java or any language project running that has anything to do with ML up and running on tech and tooling we are kinda unfamiliar with? Yes, pretty much 1-2 hours, and very likely more. Sorry but this sort of criticism is so contrived and low-effort. "Oh I tried compiling a language I don't know, using tooling I never use, usi…

Python dependency management sucks ass. Installing pytorch with cuda enabled while dealing with issues from the pytorch index having a linux-only version of a package causing shit to fail is endlessly frustrating

A good ecosystem has lockfiles by default, python does not.

Post reply on HN