81–90 of 157 posts
Google AI blog: https://ai.googleblog.com/2019/03/an-all-neural-on-device-sp... arXiv: https://arxiv.org/abs/1811.06621
Interesting that they're using RNN transducer. I thought everyone's moved to CNN lately.
Earlier quoted context omitted.
is more than just newer hardware. These CNN/RNN based methods are vastly more robust than older bayessian/markov based methods.
> These CNN/RNN based methods are vastly more robust than older bayessian/markov based methods. They were invented in the 80's, they weren't used because of limited processing power.
"But it’s sort of funny considering hardly any of Google’s other products work offline. Are you going to dictate into a shared document while you’re offline? Write an email? Ask for a conversion between liters and cups? You’re going to need a connection for that!" While offline, you might write email drafts, your blog, or even a book: https://medium.com/@augustbirch/what-i-learned-writing-an-en... What's missing is t…
The offline aspect is hardly the main draw here though. As mentioned earlier in the article, the latency reduction is huge. Another aspect they didn't really cover is privacy implications. Lastly, you may not be offline, but dodgy connections can also be a pain if you need a stable stream of packets going back and forth.
Hmm, is this how the "what song is playing" feature works? Google claims it works offline (I haven't tested it) but I have a hard time believing that Google is storing information related to every song out there. What about new songs?
https://venturebeat.com/2017/10/19/how-googles-pixel-2-now-p...
Earlier quoted context omitted.
FWIW Google Translate (including the "translate from picture" feature) is an example of a product that has had offline option for quite some time. You have to tell it to download for each language pair IIRC.
Can't wait for different language models to be available to download for recognition, so one could have a genuine offline dictation between languages.
Earlier quoted context omitted.
The offline aspect is hardly the main draw here though. As mentioned earlier in the article, the latency reduction is huge. Another aspect they didn't really cover is privacy implications. Lastly, you may not be offline, but dodgy connections can also be a pain if you need a stable stream of packets going back and forth.
I refuse to put an amazon/apple/google surveillance device in my home, so I am very interested in a DIY digital assistant device. I'm aware of a few options but it seems like offline voice recognition is always a little sub-par. I am really looking forward to the day when an offline, open source digital assistant can compare in quality to a proprietary/cloud device.
Earlier quoted context omitted.
There is also the transformer approach (eventually with local attention to bound latency), (like I'm doing in my project (Work in Progress) : https://github.com/GistNoesis/Wisteria/blob/master/SpeechToT... ), though it's in the same line of thought as the convolutional CTC. The RNN-T is a nice idea though, if I understand it correctly it's another approach to the alignment problem. In CTC, you are generating sequence…
What is "convolutional CTC"? Gated convolutions as LM is similar to RNN-T idea [1], but you have to deal with softmax, so I'm not sure how well this would work in practice, especially on a mobile processor. [1] https://arxiv.org/abs/1612.08083
Earlier quoted context omitted.
Citation?
There is this new type of trolling where someone just puts in bare minimal counterarguments and asks for citations knowing full well it's labour intensive to do so. If your not trolling.. your not doing a good job of avoiding these comparisons. The onus should be on you here to provide citations first that dissprove the person your replying to.
Unless you're dealing with opinions, I disagree. The onus is on the person trying to give evidence to actually give evidence.
The other, gigantic shoe that will someday drop will be Google transcribing every incidental conversation. It can already do that, on-device, for every song that's heard, ever. It's a super power, being able to remember every word spoken around you, time and place, but of course it has privacy implications even if all the work is done without their cloud.
I'm hopeful that voice recognition assistants will help the burden during Christmas visits :D