Live data from Hacker News

Initial Release of Mozilla’s Open Source Speech Recognition Model and Voice Data

blog.mozilla.org

61–70 of 90 posts

Re: Initial Release of Mozilla’s Open Source Speech Recognition Model and Voice Data

#61
post #44
post #43

Earlier quoted context omitted.

I was thinking earlier that maybe YouTube CC-licensed audio with manually entered subtitles might be a good source? Though, most videos of decent length would only contain say three or four speakers, which is most definitely sub-optimal. https://www.youtube.com/results?sp=EgYYAigBMAE%253D&search_q...

The last time I checked Youtube's terms of service prohibit you from making use of the rights granted by the creative commons licenses on the content.

How so?

Re: Initial Release of Mozilla’s Open Source Speech Recognition Model and Voice Data

#62
post #24

Earlier quoted context omitted.

They have an iOS app too: https://itunes.apple.com/us/app/project-common-voice-by-mozi... It’s a great idea to crowd source this. Wonder if this project can turn voice recognition into a solved problem. I just set a daily reminder so I can do 10 minutes a day.

Thank you so much! I also want to emphasize the importance of listening (validating) as well as recording. Validation is an big part of the puzzle for building machine learning viable data.

One thing that wasn't entirely clear to me is how strict you have to be when validating? i.e. I encountered one recording that was completely silent - I figured that had to be marked as invalid. However, another one was barely audible, but by intently listening I did recognise it pronounced the right words - is that OK?

And should we validate whether they match the proper accents as well? e.g. if I hear a clear Dutch accent, I presume you wouldn't want that labelled "native British speaker"?

Re: Initial Release of Mozilla’s Open Source Speech Recognition Model and Voice Data

#63
post #22

This is super cool, but I'd be cautious about the usefulness of this data set. Both this data set and LibriSpeech are read speech, where the speaker was prompted with a transcription and asked to say it out loud. In practice it's very rare that you're trying to transcribe speech that's already been transcribed. Speech patterns for computer-directed speech (e.g. for voice activated user interfaces) or human-to-human s…

Yup, this is an excellent point. We have, and will continue to explore ways to allow Common Voice users to speak more organically (for instance by answering a question, or responding free-form to some other sort of prompt). The problem with this approach is that it requires an extra step, transcription, which at the scale we are trying to achieve is pretty costly in either money or time (ie. tedium for our users). Ev…

Just had an idea... what about call center providers? They already collect speech data for training purposes and transcription could most likely help there!

Re: Initial Release of Mozilla’s Open Source Speech Recognition Model and Voice Data

#64

Earlier quoted context omitted.

Yup, this is an excellent point. We have, and will continue to explore ways to allow Common Voice users to speak more organically (for instance by answering a question, or responding free-form to some other sort of prompt). The problem with this approach is that it requires an extra step, transcription, which at the scale we are trying to achieve is pretty costly in either money or time (ie. tedium for our users). Ev…

Just had an idea... what about call center providers? They already collect speech data for training purposes and transcription could most likely help there!

They do, but privacy is a major concern.

The bigger problem is, of course, that you need speech data with (fairly) accurate transcripts for training ASR systems. These typically don't exist for call center calls.

Re: Initial Release of Mozilla’s Open Source Speech Recognition Model and Voice Data

#65

Does this foreshadow a day when Firefox starts spying on what I'm talking about?

Wouldn't this be the opposite? By bundling the speech model so that it's on the client device instead of their server, your speech need not leave your device.

Re: Initial Release of Mozilla’s Open Source Speech Recognition Model and Voice Data

#66
post #22

This is super cool, but I'd be cautious about the usefulness of this data set. Both this data set and LibriSpeech are read speech, where the speaker was prompted with a transcription and asked to say it out loud. In practice it's very rare that you're trying to transcribe speech that's already been transcribed. Speech patterns for computer-directed speech (e.g. for voice activated user interfaces) or human-to-human s…

Yup, this is an excellent point. We have, and will continue to explore ways to allow Common Voice users to speak more organically (for instance by answering a question, or responding free-form to some other sort of prompt). The problem with this approach is that it requires an extra step, transcription, which at the scale we are trying to achieve is pretty costly in either money or time (ie. tedium for our users). Ev…

A speech recognition researcher I knew spent some time at Eastern Washington university because they had a lot of transcribed Washington state proceedings, which was open access enough to go into his company’s speech corpus, I guess (I only found out because I mentioned my mom graduated from there). Anyways, these people turn over a lot of rocks to realize their huge corpuses (erm, corpi?).

Re: Initial Release of Mozilla’s Open Source Speech Recognition Model and Voice Data

#67

Earlier quoted context omitted.

Yup, this is an excellent point. We have, and will continue to explore ways to allow Common Voice users to speak more organically (for instance by answering a question, or responding free-form to some other sort of prompt). The problem with this approach is that it requires an extra step, transcription, which at the scale we are trying to achieve is pretty costly in either money or time (ie. tedium for our users). Ev…

A speech recognition researcher I knew spent some time at Eastern Washington university because they had a lot of transcribed Washington state proceedings, which was open access enough to go into his company’s speech corpus, I guess (I only found out because I mentioned my mom graduated from there). Anyways, these people turn over a lot of rocks to realize their huge corpuses (erm, corpi?).

Whether that is “open access” enough for commercial use is an interesting question. I thought that the SCOTUS recordings, for example, can not be used for commercial applications, but that might be a restriction imposed by the organization that processes and publishes the data, not the proceedings themselves.

Re: Initial Release of Mozilla’s Open Source Speech Recognition Model and Voice Data

#68
post #64

Earlier quoted context omitted.

Just had an idea... what about call center providers? They already collect speech data for training purposes and transcription could most likely help there!

They do, but privacy is a major concern. The bigger problem is, of course, that you need speech data with (fairly) accurate transcripts for training ASR systems. These typically don't exist for call center calls.

Transcriptions are not really the issue here, the cost of freelance transcribers is relatively low. It is privacy that makes it so hard, most of the call center calls need to have some kind of user authentication, which means they would need to be anonymized prior to being transcribed and used as a training material.

Re: Initial Release of Mozilla’s Open Source Speech Recognition Model and Voice Data

#69

This is very timely, as today I was thinking of caving in and getting an Echo Dot so I can control my smart home devices by voice. I would love an open-hardware microphone array that I could use with a Pi or something similar, to write my own Alexa. Not only would I love this, I would store all my commands and send them to Mozilla to help with their speech recognition models. I don't want to be the guy who wishes som…

Not affiliated in any way but have you seen the MATRIX Creator or MATRIX Voice? Both contain microphone arrays that can interface with a Raspberry Pi. I’d love to see one of these meshed together with this new Mozilla voice project for an open source Echo or Google Home. The only missing piece it seems at this point is NLP and all of the glue that converts commands to API calls.

Oh I hadn't, this is fantastic (and it integrates with an ESP32), thanks! I wonder if it includes software to do some live DSP to reduce noise... The fact that it can just connect to the Raspberry Pi's GPIOs and provide great sound is ideal, though. I'm very glad someone has made this, I wish I had known about it before so I could back it.

Re: Initial Release of Mozilla’s Open Source Speech Recognition Model and Voice Data

#70

This is tangential, but I wonder if something like this could be (mis)used to break captcha - by feeding in the disabled-friendly audio captcha and passing the results back to the captcha server. As voice recognition becomes more sophisticated I think captchas are going to have to evolve to kjeep up as well.

Captchas are utterly beat, and more so, it's not the technology or difficulty : they are a lost cause. Pretty much any problem you might present in a captcha, machine learning performs better than humans.

So today, failure to captcha is actually an indication that the other end is human.

Post reply on HN