Speech-to-Text-WaveNet: End-to-end sentence level English speech recognition • Hacker News Board

Re: Speech-to-Text-WaveNet: End-to-end sentence level English speech recognition

#41

Post by snadal » Sat, Nov 26, 2016, 11:15 PM UTC

bmc7505 wrote: post #33

snadal wrote: post #31

Earlier quoted context omitted.

We've worked in the past with CMU Sphinx too, and it is absolutely amazing the advances in this area in the last months. A little bit off-topic, but do you know any recent work or paper for speech recognition in language teaching area ? (I mean, analysing and rating accuracy of speaker, detect incorrect pronunciation of phones, and so on)

> Do you know any recent work or paper for speech recognition in language teaching area? What you're describing is called "speech verification". Language education is an application I'm personally very interested in, and one that almost no one discusses in the speech community (I assume because of machine translation), so if you find any research papers please let me know! I wrote a little about it: http://breandan.n…

Hey, thank you for the link to you article. I've read it throughly and I cannot agree more. And that was written two years and a half ago, before the AI "explosion" that we saw later.

Actually, checking against confidence is something that we've tried to play with, but to my knowledge there is not a model that allows you to compare speech confidence against an specific text. Public APIs like MS ProjectOxford.ai can return a confidence, but against the "recognised" text, not against a predefined text.

Going further, this kind of approach can be very effective on words and small sentences, but I'd really love to see which specific phones the learner is failing, which can help in analysing full speaking exercises.

It works, but I am sure it should be possible to do better

Re: Speech-to-Text-WaveNet: End-to-end sentence level English speech recognition

#42

Post by dest » Sun, Nov 27, 2016, 3:48 PM UTC

RandomInteger4 wrote: post #39

dest wrote: post #25

Earlier quoted context omitted.

text communication is much lighter (a few bytes/s vs kb/s) but you may miss the non verbal contents of voice

By non-verbal do you mean like ambient sound? Dogs barking, child yelling, garbage truck garbage trucking? I don't know. If they can do voice, then it might be possible to do ambient sounds of there is a separate nets trained with a library of ambient sounds where it's tuned not to be the same every time the sound plays like how when you have tiled graphics, there are algorithms that remove the unnatural sameness fro…

I was thinking about the voice intonation. For example the sentences "this is really great" or "how do you do? -> I'm fine, thank you" can have opposite meanings depending on the intonation. This explains a lot of the misunderstandings on written forums.

It should be possible to train a neural network to catch those special intonations, but it is IMHO substantially harder than the initial project, with uncertain results.

Re: Speech-to-Text-WaveNet: End-to-end sentence level English speech recognition

#43

Post by RandomInteger4 » Tue, Nov 29, 2016, 1:10 AM UTC

dest wrote: post #42

RandomInteger4 wrote: post #39

Earlier quoted context omitted.

By non-verbal do you mean like ambient sound? Dogs barking, child yelling, garbage truck garbage trucking? I don't know. If they can do voice, then it might be possible to do ambient sounds of there is a separate nets trained with a library of ambient sounds where it's tuned not to be the same every time the sound plays like how when you have tiled graphics, there are algorithms that remove the unnatural sameness fro…

I was thinking about the voice intonation. For example the sentences "this is really great" or "how do you do? -> I'm fine, thank you" can have opposite meanings depending on the intonation. This explains a lot of the misunderstandings on written forums. It should be possible to train a neural network to catch those special intonations, but it is IMHO substantially harder than the initial project, with uncertain resu…

Oh, right. I can't believe I forgot about intonation ... I should really get out and talk to people via voice more ...