Live data from Hacker News

Voice2json: Offline speech and intent recognition on Linux

voice2json.org

61–70 of 114 posts

Re: Voice2json: Offline speech and intent recognition on Linux

#61

Earlier quoted context omitted.

That's fine for training your own model, but I don't think you could distribute the training set. That seems like a clear copyright violation, against one of the groups that cares most about copyright. Maybe you could convince a couple of indie creators or state-run programs to licence their audio? But I'm not sure if negotiating that is more efficient than just recording a bit more audio, or promoting the project to…

That's fine for training your own model, but I don't think you could distribute the training set. That seems like a clear copyright violation, against one of the groups that cares most about copyright. I'm not sure that is a clear copyright violation. Sure, at a glance it seems like a derivative work, but it may be altered enough that it is not. I believe that collages, and reference guides like cliff notes are both…

And also... it's not like the program actually contains a copy of the training data, right? The training data is a tool which is used to build a model.

Re: Voice2json: Offline speech and intent recognition on Linux

#62
post #11

Earlier quoted context omitted.

I wonder if they use movies and tv; recordings where the script is already available.

That's fine for training your own model, but I don't think you could distribute the training set. That seems like a clear copyright violation, against one of the groups that cares most about copyright. Maybe you could convince a couple of indie creators or state-run programs to licence their audio? But I'm not sure if negotiating that is more efficient than just recording a bit more audio, or promoting the project to…

How is it different from things like GPT3 which (unless I’m mistaken) is trained on a giant web scrape? I thought they didn’t release the model out of concerns for what people would do with a general prose generator rather than any copyright concerns?

Re: Voice2json: Offline speech and intent recognition on Linux

#63
post #7

I wonder if it would be possible to map vim keybindings to sounds and effectively drive the editor with the mouth when the hands are otherwise occupied. It might be possible to use sounds that compose into pronounceable words with minimal syllables for combinations. What would vim bindings look like as a concise command language suited to human vocalization? E.g. maybe "dine" maps to d$ and "chine" to c$. So as in ke…

I do this successfully for work using https://talonvoice.com/ - initial learning curve is steep, but once you learn how to configure and hack on the commands, you can be very effective. I use it maybe half the day to combat lingering RSI symptoms, and with some work I could probably use it for 98% of input for the computer. Some people do use it for 100% afaik

Re: Voice2json: Offline speech and intent recognition on Linux

#64
post #41
post #11

Earlier quoted context omitted.

I wonder if they use movies and tv; recordings where the script is already available.

I expect that wouldn't be perfect, though. Sometimes the cut that makes it into the final product doesn't exactly match the script. Sometimes it's due to an edit, other times it's due to an actor saying something similar to but not exactly what the script says, but the director deciding to just go with it. What might work better is using closed captions or subtitles, but I've also seen enough cases where those don't…

They might work even better for interpreting the intent of spoken text. Not great for dictation though.

Re: Voice2json: Offline speech and intent recognition on Linux

#65

Earlier quoted context omitted.

GP is not talking about the model but about the training data set.

I am aware, I'm asking if the model, however, is infringing. Surely you can't distribute them in a dataset but is training on copyrighted data legal, and can you distribute that model?

All text written by a human in the US is automatically copyright the author. So if an engine trained on works under copyright is a derivative work, GPT3 and friends have serious problems.

Re: Voice2json: Offline speech and intent recognition on Linux

#66

Good FLOSS speech recognition and TTS is badly needed. Such interaction should not be left to an oligoply with bad history of not respecting users freedoms and privacy.

Mozilla CommonVoice is definitely trying. I always do a few validations and a few clips if I have a few minutes to spare, and I recommend everyone does. They need volunteers to validate and upload speech clips to create a dataset. https://commonvoice.mozilla.org/en

Weird sentences

Re: Voice2json: Offline speech and intent recognition on Linux

#67

Earlier quoted context omitted.

I like the idea, and decided to try doing some validation. The first thing I noticed is that it asks me to make a yes-or-no judgment of whether the sentence was spoken "accurately", but nowhere on the site is it explained what "accurate" means, or how strict I should be. (The first clip I got was spoken more or less correctly, but a couple of words are slurred together and the prosody is awkward. Without having a goo…

After listening to about 10 clips your point becomes abundantly clear. One speaker, who sounded like they were from the mid-west United States, was dropping the S off words in a couple clips. I wasn't sure if it was misreads or some accent I'd never heard. Another speaker, with a thick accent that sounded European, sounded out all the vowels in circuit. Had I not had the line being read, I don't think I'd have unders…

I can't quite imagine superfluous prepositions (could you give an example?) but I have found it slightly amusing learning Hindi and coming across things where I think Oh! That's why you sometimes hear X from Indian English speakers, it's just a slightly 'too' literal¹ mapping from Hindi, or trying to use a grammatical construction that doesn't really exist in English, like 'topic marking'.

[¹] If that's even fair given it's a dialect in its own right - Americans also say things differently than I would as a 'Britisher'

Re: Voice2json: Offline speech and intent recognition on Linux

#68

Good FLOSS speech recognition and TTS is badly needed. Such interaction should not be left to an oligoply with bad history of not respecting users freedoms and privacy.

That's not what this is. This is more like the system you use for phone-answering systems ("Do you want help with a bill, payment, order, or refund?")

Re: Voice2json: Offline speech and intent recognition on Linux

#69
post #48

Earlier quoted context omitted.

Except they have 12k hours of audio, when really they could do with 12B hours of audio...

Then you need a lot of people that listen to those 12B hours of audio, and multiple listeners agree for each chunk of audio that what is spoken corresponds to the transcript.

Lots of machine learning systems can use unsupervised and semi-supervised learning. Then nobody has to listen to and annotate all that audio.

Re: Voice2json: Offline speech and intent recognition on Linux

#70
post #7

I wonder if it would be possible to map vim keybindings to sounds and effectively drive the editor with the mouth when the hands are otherwise occupied. It might be possible to use sounds that compose into pronounceable words with minimal syllables for combinations. What would vim bindings look like as a concise command language suited to human vocalization? E.g. maybe "dine" maps to d$ and "chine" to c$. So as in ke…

https://youtu.be/8SkdfdXWYaI?t=600 this guy is already there: Slurp slap scratch buff yank

I now get the joke about Emacs and OS
Post reply on HN