Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Live-caption glasses let deaf people read conversations [video]

youtube.com

Post reply on HN
Print view View original

101–110 of 181 posts

Re: Live-caption glasses let deaf people read conversations [video]

#101

Post by zie »

richbell wrote: post #47
zie wrote: post #41

Earlier quoted context omitted.

Sign language is a complex language, so something has to learn yet another language. Perhaps made all the more complex as it's spatial and visual instead of verbal or written. Not every deaf person uses sign language and there are many different sign languages in the world. American Sign Language(ASL) is but one of these languages.

> Sign language is a complex language Specifically, sign languages are not visual representations of existing languages (e.g. ASL and English) but completely different languages altogether.

Exactly. Though Visual "representations"(for lack of a better word) of English do exist in dialects like SEE(Signed Exact English), which is obviously not the same as ASL.

I'm sure other signed languages have rough equivalents in their regional areas as well. I know Mexico has a few different signed languages, though I only have passing familiarity with 1 of their signed languages and it's definitely not a representation of Spanish.

Re: Live-caption glasses let deaf people read conversations [video]

#102

Post by nohaydeprobleme »

aeturnum wrote: post #18
quantumquetzal wrote: post #15

Background: researched this space for a graduate degree. There are a few issues that are unanswered by this video (which isn't intended to be a technical deep dive, but I don't see any related links in the video description): 1. How do these glasses handle multiple simultaneous speakers? Based on the display I saw, it shows the speakers' words sequentially, which starts to fall apart in real-world environments, espec…

This is a classic curbcut in the sense that it will help those with heading as much (if not more than) the D/deaf community. Still very excited for it - agree with all your questions and concerns. As usual, this marketing seems most directed at normate ideas about what disabled people want / need, but the tech seems very cool and there does seem to be potential. Without looking into the product deeply it seems like t…

To make the comment easier to read for others, it looks like the commenter may have made a slight typo and meant to write "hearing" instead of heading, to convey:

> "This is a classic curbcut in the sense that it will help those with [edit: hearing] as much (if not more than)..."

Re: Live-caption glasses let deaf people read conversations [video]

#104

Post by raldi »

danscarfe wrote: post #94
raldi wrote: post #25

I'm impressed at how not-awful the glasses look. I do wish there had been a real-life shot showing how the text appears to the wearer, though.

You can see how it appears in our promo video: https://www.youtube.com/watch?v=iilN0368vQU

The video gives the general idea, but it only shows a graphical simulation of what the wearer sees. I'm curious to see an actual photo or video of the text appearing on the lens of the glasses, in reality, with no special effects.

Re: Live-caption glasses let deaf people read conversations [video]

#105

Post by morcheeba »

kajecounterhack wrote: post #67
roughly wrote: post #65

Earlier quoted context omitted.

I imagine it’d substantially increase the compute load, but I’d be curious if you could use multiple microphones and beam forming to separate out the streams of speech and feed them to the TTS algorithm independently.

Single-mic source separation is possible in an unsupervised manner today that could probably work better than beamforming both compute-wise and with regard to implementation difficulty (you'd just need a lot of recordings to represent the space of sounds you want to separate).

Maybe a combination? Even simple beamforming/stereo would be helpful to help display the speaker's location. For example, the "speaker 1" tag could appear on the left, center, or right of the display to give a spatial clue where they are located.

Re: Live-caption glasses let deaf people read conversations [video]

#106

Post by gus_massa »

danscarfe wrote: post #99
JoeAltmaier wrote: post #85

Other applications? Travelers, translate Spanish to English etc. Reconstruct voice in noisy environments. ???

We support both!

In Spanish to English are you doing a word by word translation, r fixing some basic gramar (for example changing the order of adjectives and nouns)?

Re: Live-caption glasses let deaf people read conversations [video]

#107

Post by justinator »

quantumquetzal wrote: post #15

Background: researched this space for a graduate degree. There are a few issues that are unanswered by this video (which isn't intended to be a technical deep dive, but I don't see any related links in the video description): 1. How do these glasses handle multiple simultaneous speakers? Based on the display I saw, it shows the speakers' words sequentially, which starts to fall apart in real-world environments, espec…

>3. As mentioned by another commenter, this is a useful idea for people who lose their hearing later in life. That said, this is less (although certainly still) useful for people who have congenital hearing loss and primarily communicate via ASL.>

Someone primarily communicates with ASL and then there's me that doesn't know ASL. I can speak to them, and they can read what I've spoken. That works pretty well. They communicate with me via text to speech, or (I guess in the near future) ASL to speech - however that will work.

I mean, that's awesome.

Re: Live-caption glasses let deaf people read conversations [video]

#108

Post by YurgenJurgensen »

elliekelly wrote: post #91
YurgenJurgensen wrote: post #78

Earlier quoted context omitted.

There’s nothing inherent to the world we have built that’s stopping deaf people using the Internet in their own languages. Yet there’s no ASL Wikipedia. Why not?

There are many languages that don’t use a system of writing.

But there's not many that can't use a system of writing.

Re: Live-caption glasses let deaf people read conversations [video]

#109

Post by aeturnum »

nohaydeprobleme wrote: post #102
aeturnum wrote: post #18

Earlier quoted context omitted.

This is a classic curbcut in the sense that it will help those with heading as much (if not more than) the D/deaf community. Still very excited for it - agree with all your questions and concerns. As usual, this marketing seems most directed at normate ideas about what disabled people want / need, but the tech seems very cool and there does seem to be potential. Without looking into the product deeply it seems like t…

To make the comment easier to read for others, it looks like the commenter may have made a slight typo and meant to write "hearing" instead of heading, to convey: > "This is a classic curbcut in the sense that it will help those with [edit: hearing] as much (if not more than)..."

yes, exactly, thank you

Re: Live-caption glasses let deaf people read conversations [video]

#110

Post by stubish »

zoklet-enjoyer wrote: post #42

My Pixel phone can do this. Why are the glasses so expensive and bulky?

What apps on the phone do you use for live conversation captioning?

I'm thinking a tablet that does this would be ideal for in-home use by some elderly relatives. AR glasses won't be suitable for some time for the elderly, as it seems eyesight starts going before hearing.

Post reply on HN