Live data from Hacker News

AI headphones let wearer listen to a single person in a crowd by looking at them

washington.edu

331–340 of 452 posts

Re: AI headphones let wearer listen to a single person in a crowd by looking at them

#331
post #329

I opened an issue with this. Maybe someone here knows. I see a Python script I can run on my computer, I haven't tried it yet, but I think I could connect a microphone and process real-time audio and output it in real time, but I don’t know how to detect the user looking at someone. Could you tell me how that works?

To use the system, a person wearing off-the-shelf headphones fitted with microphones taps a button while directing their head at someone talking. The sound waves from that speaker’s voice then should reach the microphones on both sides of the headset simultaneously;

I guess by reading the article?

Re: AI headphones let wearer listen to a single person in a crowd by looking at them

#332

Earlier quoted context omitted.

> restaurant and public space designers have stopped thinking about sound. Most bars opened in the last 15 years have cement floors, very little sound insulation, and they’re based on the idea that you’re not having a good time unless your ears are ringing. Recently listened to a really good podcast about this phenomenon https://podcasts.apple.com/us/podcast/gastropod/id918896288?... (or pick your favorite podcast ap…

Aren't there some cheap ways to muffle sound? Wood floors, rugs, curtains, artwork, acoustic panels, etc.

Sound dampening artwork actually seems really interesting.

Re: AI headphones let wearer listen to a single person in a crowd by looking at them

#333

This could actually be really helpful to me, as I have trouble hearing someone speaking in a busy room because my mind is trying to pick up everything (I think this is because of my ADHD). Having a way to significantly quiet out other noises aside for the voice of the person I'm speaking with would be amazing.

Ditto. I would pay big money for this if it came in an inconspicuous form factor like airpods. Hopefully it's just a matter of time before Airpods themselves can do this.

Re: AI headphones let wearer listen to a single person in a crowd by looking at them

#334

Earlier quoted context omitted.

I could not hear anyone in any crowded situation. At middle age I thought my hearing was leaving. Yet every audiologist I went to said my hearing was fine. So I found the best audiologist in my fairly large metro area, and scheduled a year in advance (the wait list was that long). After a whole day of tests the audiologist comes in and says I have good news and bad news and good bad news. The good news is that my hea…

> restaurant and public space designers have stopped thinking about sound. Most bars opened in the last 15 years have cement floors, very little sound insulation, and they’re based on the idea that you’re not having a good time unless your ears are ringing. Recently listened to a really good podcast about this phenomenon https://podcasts.apple.com/us/podcast/gastropod/id918896288?... (or pick your favorite podcast ap…

If you’re near Berkeley, CA, one of the owners of the restaurant Comal also owns a sound company that builds that kind of system, and they use Comal as a showplace. The effect is astounding - it’s an industrial-style design, and it’s got auditory “ambiance”, but you can have a full conversation at normal speaking volumes with everyone at the table. It’s the kind of thing where once you experience it, you’ll judge the hell out of any other “fancy” restaurant you go to that doesn’t have it.

Re: AI headphones let wearer listen to a single person in a crowd by looking at them

#335

Earlier quoted context omitted.

> restaurant and public space designers have stopped thinking about sound. Most bars opened in the last 15 years have cement floors, very little sound insulation, and they’re based on the idea that you’re not having a good time unless your ears are ringing. Recently listened to a really good podcast about this phenomenon https://podcasts.apple.com/us/podcast/gastropod/id918896288?... (or pick your favorite podcast ap…

Aren't there some cheap ways to muffle sound? Wood floors, rugs, curtains, artwork, acoustic panels, etc.

Stuff that works well in homes often is a lot more complicated to implement in restaurants, where you're: a) constantly fighting grease buildup and hard-to-remove dust that clings to greasy or damp surfaces, b) often have a profit margin of like 2% if you're one of the successful ones, c) aside from looking clean, you have to worry about pest control, fire codes, health codes (you can't have built-up dust falling in people's food, d) etc etc etc etc. Also, how restaurants look is as, or in some cases more important than the quality of the food. A good, attractive, practical restaurant design is one of the things that can steer you towards success or failure. Much to many chefs chagrin, hip and attractive restaurants with shitty boring food are often more profitable than ones that only focus on the food. Marketing is annoyingly important.

With, floors hardwood is a hard surface (so only mildly sound damping) so they're not too bad for cleaning and health stuff, but are expensive to install and take a lot to maintain if the worn-in look doesn't fit the aesthetic. Low-pile carpets can be shampood inexpensively for medium-term maintenance and replaced comparatively cheaply in the long run, but take a lot more effort to keep clean when someone drops a catering tray full of crème caramel and something with a port wine reduction.

Artwork: anything that you'd want hanging on your walls is either going to need to be a print or covered with glass or plastic because it will get ruined otherwise.

Acoustic panels are usually pretty ugly, difficult to clean, not resistant to pests, are a fire liability if coated in grease, etc.

Curtains definitely are definitely viable, but if you've got enough of them to really impact the sound level, they probably need to be expensive ones, and expensive curtains can't just be tossed in the wash and pressed on an ironing board.

It's not like they aren't effective, they're just not nearly as easy to deploy or maintain as they are in homes or offices.

Re: AI headphones let wearer listen to a single person in a crowd by looking at them

#336

One thing that the HN crowd should appreciate is just how expensive and shit hearing aids are. go and look the up the price, they are deeply expensive, even for basic "make it louder" type aids. Worse still, because they interfere with your ear, you tend to loose the ability to "steer" your hearing. This means that you can't tune out other conversations/noises or stuff. The one good side effect of facebook spending b…

Are those project aria glasses actually available for purchase? You say cheap, that implies there’s a price somewhere. Looks like an internal experiment. I would love to be able to buy something like this, but all of the commercially available wearable computers are pretty crappy in my experience.

Re: AI headphones let wearer listen to a single person in a crowd by looking at them

#337

Earlier quoted context omitted.

> restaurant and public space designers have stopped thinking about sound. Most bars opened in the last 15 years have cement floors, very little sound insulation, and they’re based on the idea that you’re not having a good time unless your ears are ringing. Recently listened to a really good podcast about this phenomenon https://podcasts.apple.com/us/podcast/gastropod/id918896288?... (or pick your favorite podcast ap…

If you’re near Berkeley, CA, one of the owners of the restaurant Comal also owns a sound company that builds that kind of system, and they use Comal as a showplace. The effect is astounding - it’s an industrial-style design, and it’s got auditory “ambiance”, but you can have a full conversation at normal speaking volumes with everyone at the table. It’s the kind of thing where once you experience it, you’ll judge the…

Been to Comal a few times, need to go again and pay closer attention

Re: AI headphones let wearer listen to a single person in a crowd by looking at them

#338
The open source code is at https://github.com/vb000/LookOnceToHear and the research paper is at https://arxiv.org/abs/2405.06289

So perhaps this is not as out of reach as many pop-science articles. I’d love to hear if anyone is able to get this working independently.

Re: AI headphones let wearer listen to a single person in a crowd by looking at them

#339

If the size could shrink to the size of a small earplug, I'd love to use this as a person who is not hearing-impaired (at least they couldn't diagnose me with it, so now I'm not sure if their diagnostics sucks, or I'm just a normal person and others pretend better that they hear everything well) . In groups and with friends, it's inevitable that you end up in a busy restaurant or a bar, and it always frustrates me th…

I could not hear anyone in any crowded situation. At middle age I thought my hearing was leaving. Yet every audiologist I went to said my hearing was fine. So I found the best audiologist in my fairly large metro area, and scheduled a year in advance (the wait list was that long). After a whole day of tests the audiologist comes in and says I have good news and bad news and good bad news. The good news is that my hea…

My hearing aids have a custom directional hearing section I can modify. I’ll give this a try next time I’m in a crowded area.

Re: AI headphones let wearer listen to a single person in a crowd by looking at them

#340

If the size could shrink to the size of a small earplug, I'd love to use this as a person who is not hearing-impaired (at least they couldn't diagnose me with it, so now I'm not sure if their diagnostics sucks, or I'm just a normal person and others pretend better that they hear everything well) . In groups and with friends, it's inevitable that you end up in a busy restaurant or a bar, and it always frustrates me th…

There are these passive directional earplugs https://www.flareaudio.com/pages/earhd

I responded to another comment but after reading this thread noticed my hearing aids have a custom directional hearing section I can modify.
Post reply on HN