Live data from Hacker News

High-performance speech recognition with no supervision at all

ai.facebook.com

21–30 of 66 posts

Re: High-performance speech recognition with no supervision at all

#21
post #16

Why would FB work on such a tech?

Perhaps having the freedom to work on these problems is necessary to keep talent.

Positive stories associated with the brand seem especially needed these days. Perhaps FB keeps other “rainy day” projects as well.

Re: High-performance speech recognition with no supervision at all

#22
post #8

Will Facebook license this tech out? I can't be the only one who's noticed Google's speech recognition has gotten significantly less accurate the last couple of years, probably the result of some cost-cutting strategy.

I wonder if it's less accurate for specific people, but more accurate generally. In other words speech recognition was more accurate in the beginning on english-speaking men, and maybe now it's better for women, kids, people with accents, other languages, etc... They train this on examples of speaking and maybe it's more broad now.

[deleted]

Re: High-performance speech recognition with no supervision at all

#23
post #21
post #16

Why would FB work on such a tech?

Perhaps having the freedom to work on these problems is necessary to keep talent. Positive stories associated with the brand seem especially needed these days. Perhaps FB keeps other “rainy day” projects as well.

I was contacted by their recruiters recently and started getting warmed up on their interviewing, etc. However, this was back in December when they put out ads against Apple's choice to allow users to opt out of tracking. It kind of made it difficult to want to follow through on the interview process after that... so I didn't.

Re: High-performance speech recognition with no supervision at all

#24
post #8

Will Facebook license this tech out? I can't be the only one who's noticed Google's speech recognition has gotten significantly less accurate the last couple of years, probably the result of some cost-cutting strategy.

I wonder if it's less accurate for specific people, but more accurate generally. In other words speech recognition was more accurate in the beginning on english-speaking men, and maybe now it's better for women, kids, people with accents, other languages, etc... They train this on examples of speaking and maybe it's more broad now.

That's possible, but it wouldn't explain bizarre behavior like capitalizing random words in the middle of sentences or the absolute refusal to type the word "o'clock".

Re: High-performance speech recognition with no supervision at all

#25
It seems that the discriminator tests if the output of the generator obeys the pattern of a language. Isn't it still possible that after training the generator outputs the text wrong for the input? On the other words, the output is understandable but actually not what the sound indicate?

Re: High-performance speech recognition with no supervision at all

#26
post #23
post #21

Earlier quoted context omitted.

Perhaps having the freedom to work on these problems is necessary to keep talent. Positive stories associated with the brand seem especially needed these days. Perhaps FB keeps other “rainy day” projects as well.

I was contacted by their recruiters recently and started getting warmed up on their interviewing, etc. However, this was back in December when they put out ads against Apple's choice to allow users to opt out of tracking. It kind of made it difficult to want to follow through on the interview process after that... so I didn't.

I did the same. I don't think you are alone, at all.

FB pays well and works on really interesting things but I just can't justify the moral price of working there.

Re: High-performance speech recognition with no supervision at all

#27

It seems that the discriminator tests if the output of the generator obeys the pattern of a language. Isn't it still possible that after training the generator outputs the text wrong for the input? On the other words, the output is understandable but actually not what the sound indicate?

Context may help determine the intended word. Certainly any such system can be wrong sometimes.

Re: High-performance speech recognition with no supervision at all

#28
post #21
post #16

Why would FB work on such a tech?

Perhaps having the freedom to work on these problems is necessary to keep talent. Positive stories associated with the brand seem especially needed these days. Perhaps FB keeps other “rainy day” projects as well.

Yes, LeCun is still head of AI research there, and he's a big draw for talent. Any advancements like this (unsupervised learning) are a huge boon for technology. Often, the most time consuming part of machine learning is creating the labeled dataset. It's amazing to see what can be achieved without one.

Re: High-performance speech recognition with no supervision at all

#30
post #19

How does Facebook use speech recognition in its own products?

Haven't you ever wondered if some mobile apps listen to you? And then you get accurate targeted ads...

People keep downvoting me, because "we need you to send a proof", but sorry I don't want to share Snowden's fate, but I know for fact IOS/Android, most TVs and major TV cable boxes (USA) are indeed analyzing your speech and sending back home _keywords_ from your conversations. I can imagine that's how they avoid being sued into oblivion for clear 4A violation, as metatags have been considered not a violation of your privacy by courts.

But go ahead, try it yourself! Have a conversation about having children with your loved one, next to your phones and your TV box, no online search required. Give it few hours and turn your Sling on, or browse some Amazon/Youtube. All of sudden you will see ads for products and companies you have never heard of, trying to sell you diapers or baby cribs. Where do you think it came from? Google, as of today, still is unable to read your mind.

Post reply on HN