Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Project Common Voice

voice.mozilla.org

Post reply on HN
Print view View original

41–50 of 61 posts

Re: Project Common Voice

#41

Post by zie »

lucb1e wrote: post #39
hardwaresofton wrote: post #10

Earlier quoted context omitted.

It looks like the database will be open sourced later this year: https://voice.mozilla.org/faq I'm wondering if the format will be easily translatable to the kinds of models that software like CMUSphinx and Julius use https://cmusphinx.github.io/ http://julius.osdn.jp/en_index.php

It's weird to me that they publish the project about having an open dataset of voice data, with only a promise the open it up later.

It's Mozilla, they likely just don't have the infrastructure/code in place yet. They definitely get my trust for believing they actually will. They have been very good in the past about keeping things open. They make mistakes sometimes, but their goals are all about being open.

Re: Project Common Voice

#42

Post by punchingwater »

albertzeyer wrote: post #24

The terminology is a bit confusing. They are saying that they want to build voice recognition but it seems like they actually might want to build a speech recognition engine. Speech recognition is about recognizing the speech, the spoken words. Voice recognition is about recognizing the speakers voice, i.e. identifying the speaker. Also, maybe they also want to build a text-to-speech (TTS) system but I'm not sure. No…

I can tell from your comment (and it's responses) that the language on our homepage is a bit confusing, so thank you for the feedback.

To answer you question: Common Voice is about building a collection of labelled voice data (ie. sentence clips w/ transcripts) that can be used to, for instance, train speech-to-text algorithms. Part of the goals of this project though is to figure out how this data can best help people build voice technology. So it's pretty open ended at this point.

Mozilla does have an open source speech-to-text engine [1] we are developing, and we hope one day to use the Common Voice data to train this engine. DeepSpeech and Common Voice are related, but separate projects, if that makes sense.

As for LibriSpeech, the DeepSpeech team at Mozilla does use this data for training. However, the language is pretty antiquated, and we only get about 1K hours of data, whereas you need about 10K hours to get to a decent accuracy (WER of 10% and below). Common Voice is about adding to public corpora like LibraSpeech, not replacing them.

1.) https://github.com/mozilla/DeepSpeech

Re: Project Common Voice

#43

Post by punchingwater »

zie wrote: post #41
lucb1e wrote: post #39

Earlier quoted context omitted.

It's weird to me that they publish the project about having an open dataset of voice data, with only a promise the open it up later.

It's Mozilla, they likely just don't have the infrastructure/code in place yet. They definitely get my trust for believing they actually will. They have been very good in the past about keeping things open. They make mistakes sometimes, but their goals are all about being open.

thanks for the vote of confidence! yes we will absolutely open this data up, and it's just a matter of collecting enough data to be useful, and then building the UI. we have a goal of achieving this by the end of 2017, so stay tuned!

Re: Project Common Voice

#44

Post by punchingwater »

amelius wrote: post #25
albertzeyer wrote: post #24

The terminology is a bit confusing. They are saying that they want to build voice recognition but it seems like they actually might want to build a speech recognition engine. Speech recognition is about recognizing the speech, the spoken words. Voice recognition is about recognizing the speakers voice, i.e. identifying the speaker. Also, maybe they also want to build a text-to-speech (TTS) system but I'm not sure. No…

> Speech recognition is about recognizing the speech, the spoken words. Voice recognition is about recognizing the speakers voice, i.e. identifying the speaker. Perhaps they want to do both eventually (?) That could explain the name.

Common Voice is only about collecting a large public database of voices. We do have a separate project around speech-to-text [1]. We haven't done much work around speaker recognition (AFAIK) or voice synthesis, but they are both very interesting both from a technical and privacy related standpoint. That said, both are out of the scope of Common Voice (which is only about the data).

1.) https://github.com/mozilla/DeepSpeech

Re: Project Common Voice

#45

Post by punchingwater »

pebers wrote: post #8

Is the data going to be freely available as well? It's a little unclear whether they intend to make it separately available or not.

Great feedback, we can look into clarifying on our homepage that our entire goal is to create a dataset in the public domain. We want people to donate not just to Mozilla, but to the world :)

Re: Project Common Voice

#46

Post by punchingwater »

jldugger wrote: post #2

And... 503'd. I didn't catch what the intended use case was before it died, but I'm guessing computer generated voice? Most of the computer generated stuff I've seen uses trained actors. Which neatly avoids the problem of trying to reconcile a myriad of accents and dialects, which was immediately apparent from the first two samples I tried. edit: back up, seems to be about voice recognition, which this could help wit…

Sorry about the 503s! We were adding servers to our cluster to handle the hacker news load, and a few 503s are hard to avoid. If this is consistently happening for you, please file a bug and we'll look at it.

https://github.com/mozilla/voice-web/issues

Re: Project Common Voice

#47

Post by blackkettle »

hardwaresofton wrote: post #10
pebers wrote: post #8

Is the data going to be freely available as well? It's a little unclear whether they intend to make it separately available or not.

It looks like the database will be open sourced later this year: https://voice.mozilla.org/faq I'm wondering if the format will be easily translatable to the kinds of models that software like CMUSphinx and Julius use https://cmusphinx.github.io/ http://julius.osdn.jp/en_index.php

I would assume they are only going to be doing the raw data collection and maybe cleanup and annotation, and that data should be made available so you can train what you like.

If you poke around github and the Kaldi lists a bit more you can see that they are experimenting with and probably planning to use Kaldi.

I wonder what they plan to do for provisioning. It is one thing to collect data and train models, but quite another to make the service available over the web in an unlimited capacity. And we are not yet to the point where you can reasonably expect to run a high quality open-vocabulary STT system in your browser. The search network is typically in the GBs range.

Re: Project Common Voice

#48

Post by punchingwater »

TomasSedovic wrote: post #18
tangue wrote: post #7

Cool project, really aligned with the mission of Mozilla, and with a pleasant UX. And if you're a non-english speaker like me validating sentences is a nice way of improving your comprehension.

Yep! Though us non-native speakers should really be recording, too. So we're not left behind in voice recognition.

Exactly! Part of the goals of Common Voice is to make voice recognition work better for non-north american men (which is where the vast majority of the training data comes from).

If you are a non-native speaker, we need your voice!

Re: Project Common Voice

#49

Post by breakingcups »

a3_nm wrote: post #30
glandium wrote: post #14

Sadly, in Demographic Data, only native english accents can be selected.

I have reported this and it looks like they intend to fix this https://github.com/mozilla/voice-web/issues/242

If I read the issue right they don't intend to fix it at all.

Re: Project Common Voice

#50

Post by tangue »

punchingwater wrote: post #48
TomasSedovic wrote: post #18

Earlier quoted context omitted.

Yep! Though us non-native speakers should really be recording, too. So we're not left behind in voice recognition.

Exactly! Part of the goals of Common Voice is to make voice recognition work better for non-north american men (which is where the vast majority of the training data comes from). If you are a non-native speaker, we need your voice!

Okay but what should strangers submit for country and accent in the form ? The only options are anglophones countries.
Post reply on HN