Voice2json: Offline speech and intent recognition on Linux

Good FLOSS speech recognition and TTS is badly needed. Such interaction should not be left to an oligoply with bad history of not respecting users freedoms and privacy.

Re: Voice2json: Offline speech and intent recognition on Linux

#5

Post by yewenjie » Fri, May 21, 2021, 5:13 PM UTC

How does it compare to Vosk and other open source models/APIs?

Re: Voice2json: Offline speech and intent recognition on Linux

#6

Post by sodality2 » Fri, May 21, 2021, 5:15 PM UTC

marcodiego wrote: post #4

Good FLOSS speech recognition and TTS is badly needed. Such interaction should not be left to an oligoply with bad history of not respecting users freedoms and privacy.

Mozilla CommonVoice is definitely trying. I always do a few validations and a few clips if I have a few minutes to spare, and I recommend everyone does. They need volunteers to validate and upload speech clips to create a dataset.

https://commonvoice.mozilla.org/en

Re: Voice2json: Offline speech and intent recognition on Linux

#7

Post by hirundo » Fri, May 21, 2021, 5:16 PM UTC

I wonder if it would be possible to map vim keybindings to sounds and effectively drive the editor with the mouth when the hands are otherwise occupied. It might be possible to use sounds that compose into pronounceable words with minimal syllables for combinations. What would vim bindings look like as a concise command language suited to human vocalization?

E.g. maybe "dine" maps to d$ and "chine" to c$. So as in keyboard vim you can guess what "dend" and "chend" do.

Re: Voice2json: Offline speech and intent recognition on Linux

#8

Post by intrepidhero » Fri, May 21, 2021, 5:18 PM UTC

Would love to see a demo integrating this with an IDE for either voice to code or for voice commands to navigate menus. I think the killer application would layer voice and traditional input rather than replace.

Re: Voice2json: Offline speech and intent recognition on Linux

#9

Post by [deleted] » Fri, May 21, 2021, 5:25 PM UTC

hirundo wrote: post #7

I wonder if it would be possible to map vim keybindings to sounds and effectively drive the editor with the mouth when the hands are otherwise occupied. It might be possible to use sounds that compose into pronounceable words with minimal syllables for combinations. What would vim bindings look like as a concise command language suited to human vocalization? E.g. maybe "dine" maps to d$ and "chine" to c$. So as in ke…

[deleted]

Re: Voice2json: Offline speech and intent recognition on Linux

#10

Post by londons_explore » Fri, May 21, 2021, 5:35 PM UTC

marcodiego wrote: post #4

Good FLOSS speech recognition and TTS is badly needed. Such interaction should not be left to an oligoply with bad history of not respecting users freedoms and privacy.

Good speech recognition generally requites massive mountains of training data, both labelled and unlabelled.

Massive mountains of data tends to be incompatible with opensource projects. Even Mozilla collecting user statistics is pretty controversial. Imagine someone like Mozilla trying to collect hundreds of voice clips from each of tens of millions of users!!