Live data from Hacker News

Voice2json: Offline speech and intent recognition on Linux

voice2json.org

71–80 of 114 posts

Re: Voice2json: Offline speech and intent recognition on Linux

#71

Earlier quoted context omitted.

Does using copyrighted works to train a machine learning model make that model infringing?

Generally a ML model transforms the copyrighted material to the point where it isn't recognizable, so it should be treated as its own unrelated work that isn't infringing or derivative. But then you have e.g. GPT that is reproducing some (largeish) parts of the training set word-for-word, which might be infringing. Also I don't think there have been any major court cases about this, so there's no clear precedent in e…

> But then you have e.g. GPT that is reproducing some (largeish) parts of the training set word-for-word, which might be infringing.

Easy fix - keep a bloom filter of hashed ngrams ensuring you don't repeat more than N words from the training set.

Re: Voice2json: Offline speech and intent recognition on Linux

#72
Author here. Thanks to everyone for checking out voice2json!

The TLDR of this project is: a unified command-line interface to different offline speech recognition projects, with the ability to train your own grammar/intent recognizer in one step.

My apologies for the broken packages; I'll get those fixed shortly. My focus lately has been on Rhasspy (https://github.com/rhasspy/rhasspy), which has a lot of the same ideas but a larger scope (full voice assistant).

Questions, comments, and suggestions are welcomed and appreciated!

Re: Voice2json: Offline speech and intent recognition on Linux

#73

Good FLOSS speech recognition and TTS is badly needed. Such interaction should not be left to an oligoply with bad history of not respecting users freedoms and privacy.

Indeed, and it doesn't have to be as "machine learning" as the big ones.

A FLOSS system would only have my voice to recognise and I would be willing to spend some time training it. Very different usecase from a massive cloud that should recognise everyone's voice and accent.

Re: Voice2json: Offline speech and intent recognition on Linux

#74

Good FLOSS speech recognition and TTS is badly needed. Such interaction should not be left to an oligoply with bad history of not respecting users freedoms and privacy.

Good speech recognition generally requites massive mountains of training data, both labelled and unlabelled. Massive mountains of data tends to be incompatible with opensource projects. Even Mozilla collecting user statistics is pretty controversial. Imagine someone like Mozilla trying to collect hundreds of voice clips from each of tens of millions of users!!

Well speech recognition for personal use doesn't have to recognise everyone. In fact it's a feature, not a bug if it recognises only me as the user.

Re: Voice2json: Offline speech and intent recognition on Linux

#75
post #68

Good FLOSS speech recognition and TTS is badly needed. Such interaction should not be left to an oligoply with bad history of not respecting users freedoms and privacy.

That's not what this is. This is more like the system you use for phone-answering systems ("Do you want help with a bill, payment, order, or refund?")

Indeed, this is what I got from it too. It seems an alternative to VoiceXML used by companies like Nuance.

Re: Voice2json: Offline speech and intent recognition on Linux

#76
post #16

Fantastic. Might use this with a Raspberry pi to set up some projects around the house. Is it possible to buy higher quality voice data ?

If you're interested in projects on a Pi then you might just be interested in this: https://github.com/rhasspy/rhasspy It's from the same author.

I like rhasspy but the problem I have with it is that it's too much of a toolkit and less of an application. There's too many choices to pick for the different components.. I think they should pick one of each and really tune them so it works really well. This way they'd take a lot of complexity away from the user.

Re: Voice2json: Offline speech and intent recognition on Linux

#78

Earlier quoted context omitted.

I like the idea, and decided to try doing some validation. The first thing I noticed is that it asks me to make a yes-or-no judgment of whether the sentence was spoken "accurately", but nowhere on the site is it explained what "accurate" means, or how strict I should be. (The first clip I got was spoken more or less correctly, but a couple of words are slurred together and the prosody is awkward. Without having a goo…

After listening to about 10 clips your point becomes abundantly clear. One speaker, who sounded like they were from the mid-west United States, was dropping the S off words in a couple clips. I wasn't sure if it was misreads or some accent I'd never heard. Another speaker, with a thick accent that sounded European, sounded out all the vowels in circuit. Had I not had the line being read, I don't think I'd have unders…

I have never heard that example. Maybe it is regional. I have heard, "you done?" as an example.

Re: Voice2json: Offline speech and intent recognition on Linux

#79
post #67

Earlier quoted context omitted.

After listening to about 10 clips your point becomes abundantly clear. One speaker, who sounded like they were from the mid-west United States, was dropping the S off words in a couple clips. I wasn't sure if it was misreads or some accent I'd never heard. Another speaker, with a thick accent that sounded European, sounded out all the vowels in circuit. Had I not had the line being read, I don't think I'd have unders…

I can't quite imagine superfluous prepositions (could you give an example?) but I have found it slightly amusing learning Hindi and coming across things where I think Oh! That's why you sometimes hear X from Indian English speakers, it's just a slightly 'too' literal¹ mapping from Hindi, or trying to use a grammatical construction that doesn't really exist in English, like 'topic marking'. [¹] If that's even fair giv…

Are you talking about phrases like "please do the needful"?

Re: Voice2json: Offline speech and intent recognition on Linux

#80

Good FLOSS speech recognition and TTS is badly needed. Such interaction should not be left to an oligoply with bad history of not respecting users freedoms and privacy.

I'd check out coqui https://coqui.ai/

It's well-documented and works basically out of box. I wish the STT models bundled were closer to the quality of Kaldi but the ease-of-use has no comparisons.

And maybe with time it will surpass Kaldi in quality too.

Post reply on HN