Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

DeepSpeech 0.6

hacks.mozilla.org

Post reply on HN
Print view View original

11–20 of 68 posts

Re: DeepSpeech 0.6

#11

Post by reubenmorais »

detaro wrote: post #5

> It achieves a 7.5% word error rate on the LibriSpeech test clean benchmark Anyone have a comparison for how good/bad that is compared to other solutions, and what it means for practical usage, if that can be guessed at from a single number?

Author here. I would add to what the sibling comments have mentioned by saying that SotA results should be taken with a grain of salt. Our engine is capable of streaming (processing the audio as it's being recorded), which is not doable with architectures that have bidirectional decoders or attention mechanisms that require the whole encoder input ahead of time.

For real world applications, this is absolutely crucial, users want latency numbers on the order of milliseconds, not seconds. This is why, if you run a standard test set like LibriSpeech on, say, a commercial offering from Google, it will perform considerably worse than state of the art according to Google papers.

This repository [0] has a benchmark of some commercial offerings. Our model beats all of those on Librispeech clean and other (except for Speechmatics on Librispeech clean), as well as on Common Voice. But note that the Common Voice corpus used in that benchmark is very old.

In sum, I would compare this against solutions that go for the same space: fast, client-side ASR, rather than state of the art.

[0] https://github.com/Franck-Dernoncourt/ASR_benchmark#benchmar...

Re: DeepSpeech 0.6

#12

Post by reubenmorais »

bayesian_horse wrote: post #7

I wonder if it is any good at out-of-vocabulary words? Is it hard to teach it new things like medical terms and such?

In the post I mention a Brazilian company who's using DeepSpeech for vocabulary constrained, medical applications. They've trained their own Brazilian Portuguese models.

The English acoustic model that we released does not have a fixed vocabulary. What determines the vocabulary is the language model, which can be created from text. So if you have in-domain text, and would like to try it out, I would say the first step is to create a language model using your text and then experiment with it.

We have some documentation on how to create the LM here: https://github.com/mozilla/DeepSpeech/tree/v0.6.0/data/lm

It's not super detailed, but I'd be happy to answer questions on our Discourse: https://discourse.mozilla.org/c/deep-speech

Re: DeepSpeech 0.6

#13

Post by reubenmorais »

tobylane wrote: post #2

I'm starting to look into the MycroftAI. It sounds like with this release I could use Mycroft+DeepSpeech on a new RaspberryPi for a completely offline smart speaker, do I understand that right?

Correct. The latest release with the TensorFlow Lite model runs in real time on a Raspberry Pi 4. I'm not sure if the Mycroft integration is updated to the latest version though, as it was just released.

Re: DeepSpeech 0.6

#14

Post by reubenmorais »

est31 wrote: post #4

Congrats to the team on the new release! Following their progress since a while. It's an important project, and I'm very happy about the size reductions while they still delivered a WER improvement over the last release. Amazing!

Thank you for your work on the Rust bindings :)

Re: DeepSpeech 0.6

#15

Post by franciscop »

Tensorflow lite, interesting. Has anyone tried this with Google Coral USB accelerator? I got one laying around but very little experience with ML. I could get the USB Accelerator working with the pretrained posenet after much messing around, but my chances with DeepSpeech are small to none. This seems like the perfect fit though.

Re: DeepSpeech 0.6

#18

Post by faissaloo »

bayesian_horse wrote: post #7

I wonder if it is any good at out-of-vocabulary words? Is it hard to teach it new things like medical terms and such?

I did write a small program to make custom vocabularies and datasets for DeepSpeech a while back when I was messing with it: https://github.com/faissaloo/deepspeech_dataset_builder It could use some TLC but it does the job.

Re: DeepSpeech 0.6

#19

Post by bmn__ »

I do not understand how to use Deepspeech even in the most simple use case.

1. I want to teach it ten words. How do I do this?

2. I want to speak into my microphone (available as a Pulseaudio device) and recognise the words and output the words as a text stream on stdout. How do I do this?

This is the documentation:

https://deepspeech.readthedocs.io/en/v0.6.0/Python-Examples.... https://deepspeech.readthedocs.io/en/v0.6.0/Python-API.html

It does not answer the questions I have.

https://deepspeech.readthedocs.io/en/v0.6.0/DeepSpeech.html

The introduction page is full of incomprehensible jargon.

Post reply on HN