Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Voice2json: Offline speech and intent recognition on Linux

voice2json.org

Post reply on HN
Print view View original

51–60 of 114 posts

Re: Voice2json: Offline speech and intent recognition on Linux

#51

Post by JadeNB »

marcodiego wrote: post #13
londons_explore wrote: post #10

Earlier quoted context omitted.

Good speech recognition generally requites massive mountains of training data, both labelled and unlabelled. Massive mountains of data tends to be incompatible with opensource projects. Even Mozilla collecting user statistics is pretty controversial. Imagine someone like Mozilla trying to collect hundreds of voice clips from each of tens of millions of users!!

Really complicated question, but considering the free world got wikipedia and openstreetmaps, I'd bet we'll find a way.

> Really complicated question, but considering the free world got wikipedia and openstreetmaps, I'd bet we'll find a way.

Both of those involve entering data about external things. Asking people to share their own data is another thing entirely—I suspect most people, me included, are much more suspicious about that.

Re: Voice2json: Offline speech and intent recognition on Linux

#53

Post by sodality2 »

wongarsu wrote: post #34
sodality2 wrote: post #22

Earlier quoted context omitted.

Does using copyrighted works to train a machine learning model make that model infringing?

Generally a ML model transforms the copyrighted material to the point where it isn't recognizable, so it should be treated as its own unrelated work that isn't infringing or derivative. But then you have e.g. GPT that is reproducing some (largeish) parts of the training set word-for-word, which might be infringing. Also I don't think there have been any major court cases about this, so there's no clear precedent in e…

Thanks!

Re: Voice2json: Offline speech and intent recognition on Linux

#54

Post by nmstoker »

offtop5 wrote: post #16

Fantastic. Might use this with a Raspberry pi to set up some projects around the house. Is it possible to buy higher quality voice data ?

If you're interested in projects on a Pi then you might just be interested in this: https://github.com/rhasspy/rhasspy

It's from the same author.

Re: Voice2json: Offline speech and intent recognition on Linux

#55

Post by mdaniel »

nerdponx wrote: post #37
bmn__ wrote: post #30

Has anyone had any success getting the software to work? It's entirely unpackaged: https://repology.org/projects/?search=voice2json https://pkgs.org/search/?q=voice2json Docker image is broken, how'd that happen? $ voice2json --debug train-profile ImportError: numpy.core.multiarray failed to import Traceback (most recent call last): File "/usr/lib/voice2json/.venv/lib/python3.7/site-packages/deepspeech/impl.py", line…

The source package does have installation instructions and appears to use Autotools: https://voice2json.org/install.html#from-source . Hopefully at least building from source works.

Building the v2.0 tag (or even master) using docker does not:

    E: The repository 'http://security.ubuntu.com/ubuntu eoan-security Release' does not have a Release file.
And just bumping the image tag to ":groovy" caused subsequent silliness, so this project is obviously only for folks who enjoy fighting with build systems (and that matches my experience of anything in the world that touches Numpy and friends)

Re: Voice2json: Offline speech and intent recognition on Linux

#56

Post by nmstoker »

varispeed wrote: post #52

It's not quite clear, but do you need to sacrifice your privacy in any way to use it? E.g. sending the data to some service in order to get trained model?

The description clarifies the underlying systems:

>> Supported speech to text systems include:

>> CMU’s pocketsphinx

>> Dan Povey’s Kaldi

>> Mozilla’s DeepSpeech 0.6

>> Kyoto University’s Julius

In case you're not aware, those are all locally run (thus not sending data off, not sacrificing privacy as you mention)

Re: Voice2json: Offline speech and intent recognition on Linux

#57

Post by jedimastert »

a-dub wrote: post #50

neat. would be even neater if it used state to provide a prior on likely intents. (ie. in its most simple form, if you know the light is on, "turn on the light" has a prior of 0)

Things like state would probably be under the scope of whatever you're feeding the intents into

Re: Voice2json: Offline speech and intent recognition on Linux

#58

Post by Edman274 »

nwalker85 wrote: post #38

Really interesting use of intents and entities. I feel like some of this is reinventing the wheel, since there is already a grammar specification, but novel use of intents/entities. https://www.w3.org/TR/speech-grammar/

Yeah, in my experience no one uses or supports that specification, which is a shame because if you're using something like AWS Connect with AWS Lex for telephony IVR, you can't just create a grammar and then have AWS Lex figure out how to turn its recognized speech-to-text into something that matches a grammar rule. Thus, Lex will return speech-to-text results that are according to general English grammar rules, rather than what you might have prompted the user to reply with. You'll be unpleasantly surprised if you think that defining a custom entity as alphanumeric always prevents the utterance "[wʌn]" as sometimes matching "won" instead of "one" or "1".

Edit - Sorry, I realize that's a tangent. What I'm saying is that when I was evaluating speech to text engines for things like IVR systems using AWS and Google, neither of them supported SRGS. Microsoft does, I think, but they didn't have a telephony component, and IBM was ignored from the get go, so "no one" really means "two very large companies."

Re: Voice2json: Offline speech and intent recognition on Linux

#59

Post by a-dub »

jedimastert wrote: post #57
a-dub wrote: post #50

neat. would be even neater if it used state to provide a prior on likely intents. (ie. in its most simple form, if you know the light is on, "turn on the light" has a prior of 0)

Things like state would probably be under the scope of whatever you're feeding the intents into

yes, but by the time you've generated an intent it's too late to improve recognition accuracy using the prior.

Re: Voice2json: Offline speech and intent recognition on Linux

#60

Post by cptskippy »

teraflop wrote: post #28
sodality2 wrote: post #6

Earlier quoted context omitted.

Mozilla CommonVoice is definitely trying. I always do a few validations and a few clips if I have a few minutes to spare, and I recommend everyone does. They need volunteers to validate and upload speech clips to create a dataset. https://commonvoice.mozilla.org/en

I like the idea, and decided to try doing some validation. The first thing I noticed is that it asks me to make a yes-or-no judgment of whether the sentence was spoken "accurately", but nowhere on the site is it explained what "accurate" means, or how strict I should be. (The first clip I got was spoken more or less correctly, but a couple of words are slurred together and the prosody is awkward. Without having a goo…

After listening to about 10 clips your point becomes abundantly clear.

One speaker, who sounded like they were from the mid-west United States, was dropping the S off words in a couple clips. I wasn't sure if it was misreads or some accent I'd never heard.

Another speaker, with a thick accent that sounded European, sounded out all the vowels in circuit. Had I not had the line being read, I don't think I'd have understood the word.

I heard a speaker with an Indian accent who added a preposition to the sentence that was inconsequential but incorrect none the less.

I hear these random prepositions added as flourishes frequently with some Indian coworkers, does anyone know the a reason? It's kind of like how American's interject "Umm..." or drop prepositions (e.g. "Are you done your meal?") and I almost didn't pick up on it. For that matter where did the American habit of dropping prepositions come from? It seems like it's people in the North East primarily.

Post reply on HN