Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Voice2json: Offline speech and intent recognition on Linux

voice2json.org

Post reply on HN
Print view View original

41–50 of 114 posts

Re: Voice2json: Offline speech and intent recognition on Linux

#41

Post by kelnos »

jfarina wrote: post #11
sodality2 wrote: post #6

Earlier quoted context omitted.

Mozilla CommonVoice is definitely trying. I always do a few validations and a few clips if I have a few minutes to spare, and I recommend everyone does. They need volunteers to validate and upload speech clips to create a dataset. https://commonvoice.mozilla.org/en

I wonder if they use movies and tv; recordings where the script is already available.

I expect that wouldn't be perfect, though. Sometimes the cut that makes it into the final product doesn't exactly match the script. Sometimes it's due to an edit, other times it's due to an actor saying something similar to but not exactly what the script says, but the director deciding to just go with it.

What might work better is using closed captions or subtitles, but I've also seen enough cases where those don't exactly match the actual speech either.

Re: Voice2json: Offline speech and intent recognition on Linux

#42

Post by kelnos »

timvisee wrote: post #29
londons_explore wrote: post #10

Earlier quoted context omitted.

Good speech recognition generally requites massive mountains of training data, both labelled and unlabelled. Massive mountains of data tends to be incompatible with opensource projects. Even Mozilla collecting user statistics is pretty controversial. Imagine someone like Mozilla trying to collect hundreds of voice clips from each of tens of millions of users!!

Another problem is that the models tend to get very very large for what I've seen. A gigabyte to 10s of gigabyes is an undesirable requirement on your local machine.

Not sure about others, but DeepSpeech also distributes a "lite" model that's much smaller and suitable for mobile devices. Not sure how its accuracy compares to the full model though.

Re: Voice2json: Offline speech and intent recognition on Linux

#43

Post by xrd »

bmn__ wrote: post #30

Has anyone had any success getting the software to work? It's entirely unpackaged: https://repology.org/projects/?search=voice2json https://pkgs.org/search/?q=voice2json Docker image is broken, how'd that happen? $ voice2json --debug train-profile ImportError: numpy.core.multiarray failed to import Traceback (most recent call last): File "/usr/lib/voice2json/.venv/lib/python3.7/site-packages/deepspeech/impl.py", line…

I tried docker (both debian version of Dockerfile), building from scratch, none of them work.

Re: Voice2json: Offline speech and intent recognition on Linux

#44

Post by habibur »

kelnos wrote: post #41
jfarina wrote: post #11

Earlier quoted context omitted.

I wonder if they use movies and tv; recordings where the script is already available.

I expect that wouldn't be perfect, though. Sometimes the cut that makes it into the final product doesn't exactly match the script. Sometimes it's due to an edit, other times it's due to an actor saying something similar to but not exactly what the script says, but the director deciding to just go with it. What might work better is using closed captions or subtitles, but I've also seen enough cases where those don't…

He meant subtitle when he talked of script.

Re: Voice2json: Offline speech and intent recognition on Linux

#45

Post by eliaspro »

posmonerd wrote: post #20
londons_explore wrote: post #10

Earlier quoted context omitted.

Good speech recognition generally requites massive mountains of training data, both labelled and unlabelled. Massive mountains of data tends to be incompatible with opensource projects. Even Mozilla collecting user statistics is pretty controversial. Imagine someone like Mozilla trying to collect hundreds of voice clips from each of tens of millions of users!!

Not an expert on any of this, but wouldn’t already published content (public or proprietary) such as Youtube videos, audiobooks, tv interviews, movies, tv programs, radio programs, podcasts, etc. be useful and exempt from privacy concerns? Do user collected clips have soemthing so special to the point that it’s critical to collect them?

Movies etc would need to be transcribed accurately to be useful for training and even then just provide a single sample for the specific item.

Re: Voice2json: Offline speech and intent recognition on Linux

#46

Post by [deleted] »

teraflop wrote: post #28
sodality2 wrote: post #6

Earlier quoted context omitted.

Mozilla CommonVoice is definitely trying. I always do a few validations and a few clips if I have a few minutes to spare, and I recommend everyone does. They need volunteers to validate and upload speech clips to create a dataset. https://commonvoice.mozilla.org/en

I like the idea, and decided to try doing some validation. The first thing I noticed is that it asks me to make a yes-or-no judgment of whether the sentence was spoken "accurately", but nowhere on the site is it explained what "accurate" means, or how strict I should be. (The first clip I got was spoken more or less correctly, but a couple of words are slurred together and the prosody is awkward. Without having a goo…

[deleted]

Re: Voice2json: Offline speech and intent recognition on Linux

#47

Post by londons_explore »

timvisee wrote: post #29
londons_explore wrote: post #10

Earlier quoted context omitted.

Good speech recognition generally requites massive mountains of training data, both labelled and unlabelled. Massive mountains of data tends to be incompatible with opensource projects. Even Mozilla collecting user statistics is pretty controversial. Imagine someone like Mozilla trying to collect hundreds of voice clips from each of tens of millions of users!!

Another problem is that the models tend to get very very large for what I've seen. A gigabyte to 10s of gigabyes is an undesirable requirement on your local machine.

With insane amounts of computation, making models much smaller while having minimal impacts on performance is possible.

Re: Voice2json: Offline speech and intent recognition on Linux

#48

Post by woodson »

londons_explore wrote: post #32
sodality2 wrote: post #23

Earlier quoted context omitted.

> Imagine someone like Mozilla trying to collect hundreds of voice clips from each of tens of millions of users!! They do, and it's working! https://commonvoice.mozilla.org/en

Except they have 12k hours of audio, when really they could do with 12B hours of audio...

Then you need a lot of people that listen to those 12B hours of audio, and multiple listeners agree for each chunk of audio that what is spoken corresponds to the transcript.

Re: Voice2json: Offline speech and intent recognition on Linux

#49

Post by xwx »

teraflop wrote: post #28
sodality2 wrote: post #6

Earlier quoted context omitted.

Mozilla CommonVoice is definitely trying. I always do a few validations and a few clips if I have a few minutes to spare, and I recommend everyone does. They need volunteers to validate and upload speech clips to create a dataset. https://commonvoice.mozilla.org/en

I like the idea, and decided to try doing some validation. The first thing I noticed is that it asks me to make a yes-or-no judgment of whether the sentence was spoken "accurately", but nowhere on the site is it explained what "accurate" means, or how strict I should be. (The first clip I got was spoken more or less correctly, but a couple of words are slurred together and the prosody is awkward. Without having a goo…

I downloaded the (unofficial) Common Voice app [1] and it provides a link to some guidelines [2], which also aren't official but look sensible and seem like the best there is at the moment.

[1] https://f-droid.org/packages/org.commonvoice.saverio/

[2] https://discourse.mozilla.org/t/discussion-of-new-guidelines...

Post reply on HN