Live data from Hacker News

AI headphones let wearer listen to a single person in a crowd by looking at them

washington.edu

81–90 of 452 posts

Re: AI headphones let wearer listen to a single person in a crowd by looking at them

#82
When ANC headphones came out, my friends thought about something like filtering certain sounds away. I bet many people have also had this kind of idea, but nevertheless, haven't actually built it. This looks intriguing, and with open-source POC code, it seems promising.

Re: AI headphones let wearer listen to a single person in a crowd by looking at them

#83
post #38

As somebody who is hearing impaired, a feature like this would be a Godsend for me! This feature should be integrated into hearing-aids ASAP! Shut up - no, actually - keep talking and take my money!

And we almost all will be where you are now, if we live long enough. If you can pick out audio from individuals, you could also send it through speech recognition and subtitle real world conversations for when hearing is worse or not there at all. But it really needs mobile devices capable of doing the processing locally, as I think round trips to the cloud would make it less useful or potentially useless.

Latency or not, for privacy reasons.

Re: AI headphones let wearer listen to a single person in a crowd by looking at them

#84

How is this AI? Not just some form of a parabolic microphone

With a parabolic microphone you have to keep it aimed at the person you want to listen to. If they or you are moving (other than directly toward or away from each other) you will need to keep moving the microphone.

With this you look at someone, signal that you want to keep listening to them, and the AI learns their voice. It then lets that voice through the noise cancelling system even as you or they move around the room or you look elsewhere.

Re: AI headphones let wearer listen to a single person in a crowd by looking at them

#85

When ANC headphones came out, my friends thought about something like filtering certain sounds away. I bet many people have also had this kind of idea, but nevertheless, haven't actually built it. This looks intriguing, and with open-source POC code, it seems promising.

2nd gen AirPods Pro’s Adaptive Noise Cancellation feature does exactly that.

Re: AI headphones let wearer listen to a single person in a crowd by looking at them

#86
post #25
post #21

Earlier quoted context omitted.

I have sensoneural hearing loss as well and fyi Bose Hearphones do have something a little like this with directional noise cancellation that helps a lot. They are discontinued but you can find them refurbished.

My phonak HAs have some directional noise cancellation (or biasing at least; I don't have rigorous definitions for these terms)... It helps but isn't great. Has a problem that I think the AI headphones wouldn't solve either: in a (non-quiet) group setting you still need to anticipate who's going to speak when and look at them for best results. The direction bit is just biasing to preferring forward stuff (via two mic…

> Sadly, no backwards bias option for overhearing people behind you ;)

Put them on "backwards"; left cup on right ear and vice versa: forward facing mics now face backwards ;)

Re: AI headphones let wearer listen to a single person in a crowd by looking at them

#87
post #78

I'll bet they achieve commercial success with the reverse application. Imagine being able to mute that one obnoxiously loud person with an annoying voice at a party!

I think this is the wildest “I guess I’m” old moment I’ve experienced… Do people wear headphones at parties?

Not unless it’s a silent disco or you’re the DJ.

Re: AI headphones let wearer listen to a single person in a crowd by looking at them

#88

How much is the AI necessary for this? At least for the targeting of sounds in the line of sight, that should be fairly easy to do without AI, but I don’t know about the human voice identification.

Depends on how you do it.

If you have good eyetracking, a microphone array and decent object tracking on your AR glasses, then you don't really need much "AI" (ie you have access to https://facebookresearch.github.io/projectaria_tools/docs/AR...)

but its not quite possible to do it all on device yet. However its not far off.

Re: AI headphones let wearer listen to a single person in a crowd by looking at them

#89

I'll bet they achieve commercial success with the reverse application. Imagine being able to mute that one obnoxiously loud person with an annoying voice at a party!

Being able to selectively mute people was an element in a couple of Black Mirror episodes.

Re: AI headphones let wearer listen to a single person in a crowd by looking at them

#90

How does it solve the problem of humans being able to detect that someone's looking at us? We tend to stop talking when we sense someone's staring at us.

You don’t need to stare at them. You only have to look at them for a moment to tell the system who you want to listen to. Then you can look away and it keeps listening to them.

Actually from the description it sounds (no pun intended!) like you wouldn’t even have to look at them. You just would need to be facing their direction. You could be looking at something else in the direction, like the ground in front of you.

When you tell it to start listening to the person you are looking at what it really does is start listening to the person whose sound is coming from that direction, which it figures out from arrival times at both ears.

Post reply on HN