Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

DeepSpeech 0.6

hacks.mozilla.org

Post reply on HN
Print view View original

51–60 of 68 posts

Re: DeepSpeech 0.6

#51

Post by wstuartcl »

Traktor wrote: post #6
detaro wrote: post #5

> It achieves a 7.5% word error rate on the LibriSpeech test clean benchmark Anyone have a comparison for how good/bad that is compared to other solutions, and what it means for practical usage, if that can be guessed at from a single number?

You can find a leaderboard here: https://paperswithcode.com/sota/speech-recognition-on-libris... It seems like sota is 2.20% word error rate

Note that the leaders there are not "near real time" streaming type implementations like this is. They have the benefit of having full context (they act on the full input not a stream of current state). 7.5% is really good for this type of low latency stream based system.

Re: DeepSpeech 0.6

#52

Post by reubenmorais »

mncharity wrote: post #43
reubenmorais wrote: post #28

Earlier quoted context omitted.

There's a basic example here transcribing from an audio file: https://github.com/mozilla/DeepSpeech/tree/v0.6.0/#project-d... There are also examples transcribing from the microphone as I mentioned above: https://github.com/mozilla/DeepSpeech/tree/master/examples/ I also have a small GUI example here [0], click once to start recording, once again to stop and show transcript. It receives the same command line argument…

> There are also examples Fyi, the other 4 example links there are 404. Also in the root README. The linked README's are missing, or diversely suffixed and mislinked.

Ugh, sorry. I fixed it on master. We'll probably cut a v0.6.1 soon to publish small fixes like these.

Re: DeepSpeech 0.6

#53

Post by jcims »

Enginerrrd wrote: post #48
jcims wrote: post #36

This reminds me of something I would love to see happen but I don't have the skills to put it all together. I really think there's some potential merit to a reading coach app(lication) that listens to someone read and looks for weaknesses/disorders/etc compared to a trained model. It could provide those diagnostics to an educator, guide the content to focus on those, coach the reader directly, etc. It all seems very…

I'll be honest... that seems like a pretty tough sell to me. You could be looking at anything from a speech disorder to a learning disability to a perfectly healthy normal child with idiosyncrasies and those things are usually left to professionals with graduate degrees. The liability seems high, you've got both the potential stigma associated with incorrectly flagging a child, or worse, missing an otherwise obvious…

I totally understand where you're coming from, but the reality is that there is a lot of imbalance and delay in this type of assessment and educational support already. My wife has been an English language arts teacher and instructional coach for almost 20 years. While they definitely have standard diagnostics and regular assessments to try to keep kids on track, it's essentially best effort. And when you move out of 4th/5th grade in many districts you start getting to 90:1 teacher-student ratios with 1-2 interns available to do 1:1 reading support across maybe 500 kids. And this is in a middle class school district.

There's definitely some ways it can go bad, but even basic fluency monitoring without any active remediation attempts would be a good addition.

Re: DeepSpeech 0.6

#55

Post by testbed »

I can't seem to find pre-trained models for other languages (French). How long did you training take for those in English? Do you think it makes sense to start from the English one? Thank you!

Re: DeepSpeech 0.6

#56

Post by Barrin92 »

pete762 wrote: post #26
bayesian_horse wrote: post #10

I just found https://voice.mozilla.org/ Besides being a great resource for speech analysis, this could be a real game changer for acquiring listening comprehension in a foreign language. I feel that even after a few years of learning a new language I still have trouble with listening. Part of that is that it's often all or nothing, even one or two unknown words in a sentence means I can't understand the sentence. But…

Some of the English samples by non-natives were completely incomprehensible. I hope the system learns to be accent free.

given that there are more non-native than native english speakers on the planet I think it makes a fair bit of sense to include non-native data in the training set

Re: DeepSpeech 0.6

#57

Post by mncharity »

sgt101 wrote: post #49
mncharity wrote: post #43

Earlier quoted context omitted.

> There are also examples Fyi, the other 4 example links there are 404. Also in the root README. The linked README's are missing, or diversely suffixed and mislinked.

You are right, and I expect Reuben and team will fix this and are grateful for the heads up. I was able to find the right links though, for example the WAV transcriber is at : https://github.com/mozilla/DeepSpeech/blob/v0.6.0/examples/v...

(Nod. I may have edited that out from under you - sorry. And thanks.)

Re: DeepSpeech 0.6

#58

Post by dabinat »

franciscop wrote: post #15

Tensorflow lite, interesting. Has anyone tried this with Google Coral USB accelerator? I got one laying around but very little experience with ML. I could get the USB Accelerator working with the pretrained posenet after much messing around, but my chances with DeepSpeech are small to none. This seems like the perfect fit though.

To the best of my knowledge, DeepSpeech currently isn’t compatible with any inference or training accelerators (other than NVIDIA GPUs).

But the whole point of the TFLite model is that it has low resource requirements so an accelerator for inference shouldn’t be necessary.

Re: DeepSpeech 0.6

#59

Post by dabinat »

est31 wrote: post #8
detaro wrote: post #5

> It achieves a 7.5% word error rate on the LibriSpeech test clean benchmark Anyone have a comparison for how good/bad that is compared to other solutions, and what it means for practical usage, if that can be guessed at from a single number?

LibriSpeech test clean is without background noise, with a good microphone, and most likely biased to native speakers (it is 50/50 male/female at least). In summary, it's not what an ASR engine will encounter. However, the dataset is used as a common method to benchmark ASR engines and thus that number is valuable. The SpecAugment paper by Google for example claims a 2.5% word error rate [1] on that corpus (using onl…

It’s worth mentioning that while DeepSpeech 0.6 supports SpecAugment, the released model was not trained with SpecAugment switched on.

Re: DeepSpeech 0.6

#60

Post by yorwba »

jcims wrote: post #53
Enginerrrd wrote: post #48

Earlier quoted context omitted.

I'll be honest... that seems like a pretty tough sell to me. You could be looking at anything from a speech disorder to a learning disability to a perfectly healthy normal child with idiosyncrasies and those things are usually left to professionals with graduate degrees. The liability seems high, you've got both the potential stigma associated with incorrectly flagging a child, or worse, missing an otherwise obvious…

I totally understand where you're coming from, but the reality is that there is a lot of imbalance and delay in this type of assessment and educational support already. My wife has been an English language arts teacher and instructional coach for almost 20 years. While they definitely have standard diagnostics and regular assessments to try to keep kids on track, it's essentially best effort. And when you move out of…

> even basic fluency monitoring without any active remediation attempts would be a good addition.

How do you define fluency? I guess it involves some combination of speed and accuracy. Speed shouldn't be too hard to measure, but for accuracy you'll probably need a model that's more accurate than 7.5% WER and can handle the difference in vocal range between children and adults. Otherwise the speech disfluencies you want to detect will be drowned out by the model not correctly recognizing actually pretty clear speech.

Post reply on HN