Live data from Hacker News

Voice2json: Offline speech and intent recognition on Linux

voice2json.org

31–40 of 114 posts

Re: Voice2json: Offline speech and intent recognition on Linux

#31
Excellent! I just installed MyCroft the other day to play around with it; while it looks like a great start, two odd things. The first is obvious, which is the online/offline thing.

The second was a little surprising (and maybe I missed it?) There was not much in the way of easily accessing transcribed output to and from shell scripts?

Re: Voice2json: Offline speech and intent recognition on Linux

#32

Earlier quoted context omitted.

Good speech recognition generally requites massive mountains of training data, both labelled and unlabelled. Massive mountains of data tends to be incompatible with opensource projects. Even Mozilla collecting user statistics is pretty controversial. Imagine someone like Mozilla trying to collect hundreds of voice clips from each of tens of millions of users!!

> Imagine someone like Mozilla trying to collect hundreds of voice clips from each of tens of millions of users!! They do, and it's working! https://commonvoice.mozilla.org/en

Except they have 12k hours of audio, when really they could do with 12B hours of audio...

Re: Voice2json: Offline speech and intent recognition on Linux

#33

Earlier quoted context omitted.

> Imagine someone like Mozilla trying to collect hundreds of voice clips from each of tens of millions of users!! They do, and it's working! https://commonvoice.mozilla.org/en

Except they have 12k hours of audio, when really they could do with 12B hours of audio...

Good point. I'm doing my part to contribute to it, though, not much else I can do!

Re: Voice2json: Offline speech and intent recognition on Linux

#34

Earlier quoted context omitted.

That's fine for training your own model, but I don't think you could distribute the training set. That seems like a clear copyright violation, against one of the groups that cares most about copyright. Maybe you could convince a couple of indie creators or state-run programs to licence their audio? But I'm not sure if negotiating that is more efficient than just recording a bit more audio, or promoting the project to…

Does using copyrighted works to train a machine learning model make that model infringing?

Generally a ML model transforms the copyrighted material to the point where it isn't recognizable, so it should be treated as its own unrelated work that isn't infringing or derivative. But then you have e.g. GPT that is reproducing some (largeish) parts of the training set word-for-word, which might be infringing.

Also I don't think there have been any major court cases about this, so there's no clear precedent in either direction.

Re: Voice2json: Offline speech and intent recognition on Linux

#35

Good FLOSS speech recognition and TTS is badly needed. Such interaction should not be left to an oligoply with bad history of not respecting users freedoms and privacy.

Speech recognition algorithms today require lots of data, lots of training computation, and a decent design. Decent designs are in published papers all over the place, so thats a solved issue. Lots of compute requires lots of $$$, which isn't opensource-friendly. Lots of data also isn't really opensource friendly. Sadly this is a niche that the opensource business model doesn't really fit.

Sounds like a viable model for certain universities, though.

Re: Voice2json: Offline speech and intent recognition on Linux

#36
post #18

Earlier quoted context omitted.

Speech recognition algorithms today require lots of data, lots of training computation, and a decent design. Decent designs are in published papers all over the place, so thats a solved issue. Lots of compute requires lots of $$$, which isn't opensource-friendly. Lots of data also isn't really opensource friendly. Sadly this is a niche that the opensource business model doesn't really fit.

> Lots of compute requires lots of $$$, which isn't opensource-friendly. Not really, look up BOINC.

There's more involved in than just raw CPU cycles. It's not something that is easily adapted to BOINC, but trying to offload things to BOINC to free up clusters better suited to training models might make sense.

Re: Voice2json: Offline speech and intent recognition on Linux

#37
post #30

Has anyone had any success getting the software to work? It's entirely unpackaged: https://repology.org/projects/?search=voice2json https://pkgs.org/search/?q=voice2json Docker image is broken, how'd that happen? $ voice2json --debug train-profile ImportError: numpy.core.multiarray failed to import Traceback (most recent call last): File "/usr/lib/voice2json/.venv/lib/python3.7/site-packages/deepspeech/impl.py", line…

The source package does have installation instructions and appears to use Autotools: https://voice2json.org/install.html#from-source. Hopefully at least building from source works.

Re: Voice2json: Offline speech and intent recognition on Linux

#39

Good FLOSS speech recognition and TTS is badly needed. Such interaction should not be left to an oligoply with bad history of not respecting users freedoms and privacy.

> should not be left to an oligoply with bad history of not respecting users freedoms and privacy

So companies with a lot of data, then.

Post reply on HN