Live data from Hacker News

Voice2json: Offline speech and intent recognition on Linux

voice2json.org

81–90 of 114 posts

Re: Voice2json: Offline speech and intent recognition on Linux

#82
post #81

I can finally build the Jarvis home assistant I dreamt of when first learning coding in high school. To bad now I know voice assistant widgets generally are useless.

Speech recognition is actually orthogonal to AI. In my day the AI prototypes (like ELIZA) were basically chat bots. Speech recognition is now very sophisticated and accurate. Determining meaning from human language (spoken or written) is far more advanced than it used to be but still kinda sucks.

Re: Voice2json: Offline speech and intent recognition on Linux

#83
post #79
post #67

Earlier quoted context omitted.

I can't quite imagine superfluous prepositions (could you give an example?) but I have found it slightly amusing learning Hindi and coming across things where I think Oh! That's why you sometimes hear X from Indian English speakers, it's just a slightly 'too' literal¹ mapping from Hindi, or trying to use a grammatical construction that doesn't really exist in English, like 'topic marking'. [¹] If that's even fair giv…

Are you talking about phrases like "please do the needful"?

That's not one I've heard. Examples that come to mind are 'even I' (which seems closer to 'I too' than the 'you'd scarcely believe it but I' that it naturally sounds to me), 'he himself' (or similar subject emphasis), and adverb repetition.

I'd say it's mostly subtler (I suppose that should be the expected distribution!) things I've noticed though, they're just harder to recall as a result.

(Just want to emphasise I'm not making fun of anybody or saying anything's wrong, in case it's not clear in text. I'm just enjoying learning Hindi, fairly interested in language generally, and interested/amused to notice these things.)

Re: Voice2json: Offline speech and intent recognition on Linux

#84
post #63
post #7

I wonder if it would be possible to map vim keybindings to sounds and effectively drive the editor with the mouth when the hands are otherwise occupied. It might be possible to use sounds that compose into pronounceable words with minimal syllables for combinations. What would vim bindings look like as a concise command language suited to human vocalization? E.g. maybe "dine" maps to d$ and "chine" to c$. So as in ke…

I do this successfully for work using https://talonvoice.com/ - initial learning curve is steep, but once you learn how to configure and hack on the commands, you can be very effective. I use it maybe half the day to combat lingering RSI symptoms, and with some work I could probably use it for 98% of input for the computer. Some people do use it for 100% afaik

You do this on Linux?

Re: Voice2json: Offline speech and intent recognition on Linux

#85

Good FLOSS speech recognition and TTS is badly needed. Such interaction should not be left to an oligoply with bad history of not respecting users freedoms and privacy.

There are a bunch of good libraries that work offline out there for speech recognition -- CMUSphinx[0] has been around a long time and work seems to have shifted a little bit to Kaldi[1] and Vosk[2] (?). Julius is still going strong as well[3].

CMUSphinx and Julius have been around for ~10+ years at this point.

[EDIT] - there's even a useful Quora post[4]

[0]: https://cmusphinx.github.io/

[1]: https://www.kaldi-asr.org/doc/about.html

[2]: https://github.com/alphacep/vosk-server

[3]: https://github.com/julius-speech/julius

[4]: https://www.quora.com/Are-there-any-open-source-APIs-for-spe...

Re: Voice2json: Offline speech and intent recognition on Linux

#86

Author here. Thanks to everyone for checking out voice2json! The TLDR of this project is: a unified command-line interface to different offline speech recognition projects, with the ability to train your own grammar/intent recognizer in one step. My apologies for the broken packages; I'll get those fixed shortly. My focus lately has been on Rhasspy ( https://github.com/rhasspy/rhasspy ), which has a lot of the same i…

Hey there, this looks great. I was wondering why Deepspeech 0.6? Why not the latest version DeepSpeech 0.9?

Re: Voice2json: Offline speech and intent recognition on Linux

#87
post #86

Author here. Thanks to everyone for checking out voice2json! The TLDR of this project is: a unified command-line interface to different offline speech recognition projects, with the ability to train your own grammar/intent recognizer in one step. My apologies for the broken packages; I'll get those fixed shortly. My focus lately has been on Rhasspy ( https://github.com/rhasspy/rhasspy ), which has a lot of the same i…

Hey there, this looks great. I was wondering why Deepspeech 0.6? Why not the latest version DeepSpeech 0.9?

I need to cycle back and update voice2json. Rhasspy (the full voice assistant) supports DeepSpeech 0.9.3.

Re: Voice2json: Offline speech and intent recognition on Linux

#88

Earlier quoted context omitted.

If you're interested in projects on a Pi then you might just be interested in this: https://github.com/rhasspy/rhasspy It's from the same author.

I like rhasspy but the problem I have with it is that it's too much of a toolkit and less of an application. There's too many choices to pick for the different components.. I think they should pick one of each and really tune them so it works really well. This way they'd take a lot of complexity away from the user.

Agreed. I've at least added a "Recommended" option in the web UI that's language-specific.

Part of the problem is that language support varies dramatically between components. There's usually a pretty obvious "best" set for English, but it gets more difficult with other languages.

Re: Voice2json: Offline speech and intent recognition on Linux

#89
post #5

How does it compare to Vosk and other open source models/APIs?

I plan to add Vosk support soon.

The goal of voice2json is to provide a common layer on top of existing open source engines. This common layer lets you train custom speech/intent models with having to know the details of each engine.

Re: Voice2json: Offline speech and intent recognition on Linux

#90
Not familiar with any of these tech, but would it be better to get the intent by

    voice2txt command.wav | txt2intent
? Or the intent analyzation actually requires the sound data (what are the cases of the same phrase expressing different intent, or how do we even define / categorize intent in this context)
Post reply on HN