Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Live-caption glasses let deaf people read conversations [video]

youtube.com

Post reply on HN
Print view View original

31–40 of 181 posts

Re: Live-caption glasses let deaf people read conversations [video]

#31

Post by jackblemming »

elil17 wrote: post #28

I'm a hearing person and I've spent a summer interning in a 50/50 mixed Deaf and hearing research group. My take is that this is a huge UI improvement for AI speech to text, which a lot of Deaf people are already using to listen to conversations. It seems particularity great because it allows this technology to provide situational awareness while, for example, walking. It's important to remember, though that, for con…

Why can’t they also make glasses that translate sign language into English audio or text then?

Re: Live-caption glasses let deaf people read conversations [video]

#32

Post by ape4 »

quantumquetzal wrote: post #15

Background: researched this space for a graduate degree. There are a few issues that are unanswered by this video (which isn't intended to be a technical deep dive, but I don't see any related links in the video description): 1. How do these glasses handle multiple simultaneous speakers? Based on the display I saw, it shows the speakers' words sequentially, which starts to fall apart in real-world environments, espec…

It would be nice if it put the captions over the speaker (in a speech bubble?)

Re: Live-caption glasses let deaf people read conversations [video]

#33

Post by generalizations »

elliekelly wrote: post #21
generalizations wrote: post #16

Earlier quoted context omitted.

The problem with ASL compared to lip reading is that it's a form of self-segregation, limiting the deaf person to primarily communicating only with other people who know ASL. If these glasses are effective, it could help bridge that gap.

I suspect (and hope) you had no ill intent but this comment is really ignorant. There is a terrible history of Deaf people being discriminated against and forced to “lip read” rather than communicate through ASL. And by “forced” I mean they were more or less mentally and physically tortured into compliance. Your comment not only perpetuates this totally false narrative that there’s a “problem” with ASL but it makes i…

I feel like you're making my comment out to be a lot more hostile than it was intended.

I don't see any "problem" with deaf people. I see ASL as, effectively, a foreign language; and it makes sense to me that in general, you're able to live more effectively when you can speak the same language as the people around you.

When I traveled overseas to a spanish-speaking country, I learned spanish so that I could communicate with the people there. It would be unreasonable for me to show up as the cliche american tourist and expect the spanish-speaking people there to learn english so that I could communicate with them.

Re: Live-caption glasses let deaf people read conversations [video]

#35

Post by [deleted] »

generalizations wrote: post #16
giraffe_lady wrote: post #2

Very cool, especially for people who lose their hearing later in life. For other deaf people it's important to remember that written english is not a form of their native sign language¹, so this would be like (because it is) reading captions in a second language. Still potentially useful but with more limitations. Not that there's necessarily a technological way around those limitations either. ¹ Afaik this applies t…

The problem with ASL compared to lip reading is that it's a form of self-segregation, limiting the deaf person to primarily communicating only with other people who know ASL. If these glasses are effective, it could help bridge that gap.

[deleted]

Re: Live-caption glasses let deaf people read conversations [video]

#37

Post by PuppyTailWags »

generalizations wrote: post #33
elliekelly wrote: post #21

Earlier quoted context omitted.

I suspect (and hope) you had no ill intent but this comment is really ignorant. There is a terrible history of Deaf people being discriminated against and forced to “lip read” rather than communicate through ASL. And by “forced” I mean they were more or less mentally and physically tortured into compliance. Your comment not only perpetuates this totally false narrative that there’s a “problem” with ASL but it makes i…

I feel like you're making my comment out to be a lot more hostile than it was intended. I don't see any "problem" with deaf people. I see ASL as, effectively, a foreign language; and it makes sense to me that in general, you're able to live more effectively when you can speak the same language as the people around you. When I traveled overseas to a spanish-speaking country, I learned spanish so that I could communica…

I think you're misunderstanding the parent poster: You don't have to be intentionally hostile to perpetuate harmful and ignorant falsehoods. In fact the parent poster states they don't believe you're intentionally perpetuating ignorance. But, it's reasonable for someone to firmly rebut harmful ignorance in a manner, even if that level of firmness doesn't match your self-perception of your ignorance.

Re: Live-caption glasses let deaf people read conversations [video]

#38

Post by cecilpl2 »

gumby wrote: post #29
quantumquetzal wrote: post #15

Background: researched this space for a graduate degree. There are a few issues that are unanswered by this video (which isn't intended to be a technical deep dive, but I don't see any related links in the video description): 1. How do these glasses handle multiple simultaneous speakers? Based on the display I saw, it shows the speakers' words sequentially, which starts to fall apart in real-world environments, espec…

I have a different use case, involving wearing them in the house: listen to what my girlfriend says, use some ML to analyze whether I need to know it and if so, put it on the display. She has a different "speech mode" than I: she speaks while I'm reading or washing the dishes or whatever, and sometimes it's to herself, sometimes to Siri, and sometimes it's something she wants me to know.

There is a simple wetware solution, which is that she learns to say your name before saying something she wants you to know.

Re: Live-caption glasses let deaf people read conversations [video]

#39

Post by dymk »

jackblemming wrote: post #31
elil17 wrote: post #28

I'm a hearing person and I've spent a summer interning in a 50/50 mixed Deaf and hearing research group. My take is that this is a huge UI improvement for AI speech to text, which a lot of Deaf people are already using to listen to conversations. It seems particularity great because it allows this technology to provide situational awareness while, for example, walking. It's important to remember, though that, for con…

Why can’t they also make glasses that translate sign language into English audio or text then?

I'm sure that's something someone could do! And it sounds like a very fun project. It probably hasn't already been done because there already exist very good speech-to-text models and not many (any?) sign-language-to-{text,audio} models
Post reply on HN