Live data from Hacker News

Live-caption glasses let deaf people read conversations [video]

youtube.com

61–70 of 181 posts

Re: Live-caption glasses let deaf people read conversations [video]

#61

My Pixel phone can do this. Why are the glasses so expensive and bulky?

1. They don't have the same kind of budget as Google to get the scale down as effectively.

2. If these are the ones I have heard about before, all the speech to text is done on the device not in the cloud. This is for privacy reasons. Means it needs a bit more bulk for the gear to work.

Re: Live-caption glasses let deaf people read conversations [video]

#62
What are the privacy/security issues with this? Does this mean every conversation a person wearing these has (or that occurs within earshot) is being collected and harvested by someone? Will the AR be used to insert ads into people's conversations or plaster images of ads all over the place? Will certain words or phrases be automatically censored?

This is cool tech, that could be used to help people, but it comes with lots of potential for new forms of evil that were not possible without it. Considering that I can't remember the last time I bought a product using a new technology that wasn't also designed to work against my interests, I'm immediately skeptical of any device that can't be used offline and especially one that requires being connected to cell phone apps.

Re: Live-caption glasses let deaf people read conversations [video]

#63
post #44

Earlier quoted context omitted.

Why can’t they also make glasses that translate sign language into English audio or text then?

Not an expert in either technology but I would imagine a lot of the difficulties of speech to text (bad recording conditions, variety of accents & pronunciation differences, etc) also have analogues in computer recognition of hand signs (camera alignment is bad, cut off, lighting is bad, someone's hand signs are lazily performed or slightly different than textbook ASL, etc). Speech to text was "solved" a long time ag…

My experience of speech to text has been terrible. As soon as someone has a bit of an accent, it becomes completely incoherent, even if all participants understand the accent perfectly. Even for good accents, using any kind of technical terms or proper names throws it off. And even when none of these are a problem, it still has at least a few percent error, even for English.

Re: Live-caption glasses let deaf people read conversations [video]

#64

What are the privacy/security issues with this? Does this mean every conversation a person wearing these has (or that occurs within earshot) is being collected and harvested by someone? Will the AR be used to insert ads into people's conversations or plaster images of ads all over the place? Will certain words or phrases be automatically censored? This is cool tech, that could be used to help people, but it comes wit…

Completely agree. There seems to be such a gap in the market for privacy-first hardware but very few companies are doing anything.

Re: Live-caption glasses let deaf people read conversations [video]

#65

Background: researched this space for a graduate degree. There are a few issues that are unanswered by this video (which isn't intended to be a technical deep dive, but I don't see any related links in the video description): 1. How do these glasses handle multiple simultaneous speakers? Based on the display I saw, it shows the speakers' words sequentially, which starts to fall apart in real-world environments, espec…

Thank you for looking at XRAI Glass! 1. For multiple simultaneous speakers of comparable volume, it’s only as good as the underlying speech-to-text engines we’ve implemented/integrated, which is currently not very good. It’s active area of research and engineering for us and we believe we’ll make strides to improve things; but, as you rightly point out, solving the crosstalk problem is very difficult. For the more ge…

I imagine it’d substantially increase the compute load, but I’d be curious if you could use multiple microphones and beam forming to separate out the streams of speech and feed them to the TTS algorithm independently.

Re: Live-caption glasses let deaf people read conversations [video]

#66

Earlier quoted context omitted.

The problem with ASL compared to lip reading is that it's a form of self-segregation, limiting the deaf person to primarily communicating only with other people who know ASL. If these glasses are effective, it could help bridge that gap.

I suspect (and hope) you had no ill intent but this comment is really ignorant. There is a terrible history of Deaf people being discriminated against and forced to “lip read” rather than communicate through ASL. And by “forced” I mean they were more or less mentally and physically tortured into compliance. Your comment not only perpetuates this totally false narrative that there’s a “problem” with ASL but it makes i…

Unfortunately, there are very few Deaf people, so there is no world in which everyone learns ASL just in case they meet a Deaf person. It just doesn't scale, and so what you end up with is isolating them even further. The best approach is to bridge the gap: similar glasses can be used by hearing folks to translate sign language, and it theoretically generalizes to all foreign languages.

Re: Live-caption glasses let deaf people read conversations [video]

#67
post #65

Earlier quoted context omitted.

Thank you for looking at XRAI Glass! 1. For multiple simultaneous speakers of comparable volume, it’s only as good as the underlying speech-to-text engines we’ve implemented/integrated, which is currently not very good. It’s active area of research and engineering for us and we believe we’ll make strides to improve things; but, as you rightly point out, solving the crosstalk problem is very difficult. For the more ge…

I imagine it’d substantially increase the compute load, but I’d be curious if you could use multiple microphones and beam forming to separate out the streams of speech and feed them to the TTS algorithm independently.

Single-mic source separation is possible in an unsupervised manner today that could probably work better than beamforming both compute-wise and with regard to implementation difficulty (you'd just need a lot of recordings to represent the space of sounds you want to separate).

Re: Live-caption glasses let deaf people read conversations [video]

#68
post #40

Would love a version for translation. I don't need the glasses, just read the translation to me and I'll wear an ear bud. And if you could make it work at a loud party, that'd be just perfect..

Speech to text barely works in the best conditions. Combine it with bad audio, automatic translation, and text to speech, and you'll be lucky if you understand 10% of what's being said.

Re: Live-caption glasses let deaf people read conversations [video]

#69

Earlier quoted context omitted.

I suspect (and hope) you had no ill intent but this comment is really ignorant. There is a terrible history of Deaf people being discriminated against and forced to “lip read” rather than communicate through ASL. And by “forced” I mean they were more or less mentally and physically tortured into compliance. Your comment not only perpetuates this totally false narrative that there’s a “problem” with ASL but it makes i…

I feel like you're making my comment out to be a lot more hostile than it was intended. I don't see any "problem" with deaf people. I see ASL as, effectively, a foreign language; and it makes sense to me that in general, you're able to live more effectively when you can speak the same language as the people around you. When I traveled overseas to a spanish-speaking country, I learned spanish so that I could communica…

I’m not sure how you can read hostility into my comment when I plainly stated I didn’t think you were commenting with ill intent. Ignorance doesn’t require intent though.

ASL isn’t a “foreign” language. It’s an American language. In fact, it’s more “American” than English. People who communicate via ASL aren’t foreigners on holiday. They’re our friends and family and neighbors. You are absolutely correct in your assumption that being able to communicate with those around you is important!

Imagine if everyone around you just refused to engage with you verbally and would only communicate via text messages. If you’re speaking they completely ignore you until you write it down. If they’re speaking while you’re around it’s always in whispers so that you can really only get bits and pieces. How would you feel? Annoyed? Excluded? Like you’re not able to fully understand conversations?

Your travel analogy doesn’t hold water because (in addition to Deaf people not being foreigners or guests!) you seem unwilling or unable to understand that (1) hearing is a critical component of effective verbal communication and (2) Deaf people can’t hear. Again, I’ll chalk it up to ignorance rather than ill intent but your analogy as a whole is pretty gross to paint Deaf people as entitled, unreasonable, and demanding. Your analogy is akin to suggesting it’s unreasonable for me, a person who can walk, to rollerskate everywhere I go and it would be unreasonable for me to expect curb cuts just so I could rollerskate everywhere so therefore it’s unreasonable for people who use a wheelchair to expect curb cuts. If someone who uses a wheelchair wants to use the sidewalk they should just try fucking walking right? I don’t know why no one has thought of that!

Re: Live-caption glasses let deaf people read conversations [video]

#70

Earlier quoted context omitted.

ASL is based on French, so the structure is completely different.

ASL is not based on french either. It's related to LSF, the sign language used in france, but that also isn't based on french. The modern sign languages emerged among deaf populations and have completely different grammar and morphology from the spoken languages of the cultures surrounding their origins.

Thank you for correcting me. That's a deep rabbit hole
Post reply on HN