Voice control engine that runs fully in the browser using WebAssembly

The tab fully loads and appears properly for about... 100ms or so beforehand, so I'm pretty sure it's to do with some kind of wasm interaction. I have my microphone set to "ask before accessing" so I don't think the crash is to do with audio.

FWIW, I've been experiencing periodic tab crashes for the past few weeks, and need to do a package upgrade to move up from 68.0, so this may not be interesting to anybody.

But in case someone sees this and wants to chase it down, let me know; debugging Chromium can be fun. Unfortunately Arch doesn't provide debug symbols for their builds :'( so that's a bit of a setback, but yeah.

Re: Voice control engine that runs fully in the browser using WebAssembly

#6

Post by IanCal » Sun, Oct 07, 2018, 10:47 AM UTC

Interesting tech, but on a very restricted demo it was wrong a huge number of times for me.

I'd recommend adding a note that the lamp itself will go red in response to "ok lamp", at least I think that's why it was doing that - it was a bit confusing and to see the first thing happen after saying "ok lamp, blue" having the picture of a lamp go red was not hugely encouraging initially. Perhaps add "listening for colour" or something.

Re: Voice control engine that runs fully in the browser using WebAssembly

#7

Post by joethebro » Sun, Oct 07, 2018, 11:33 AM UTC

Just to add my experience, the demo worked perfectly straight away (Chrome 70 on macOS). Really cool to see this tech, hope it's easy to integrate.

Re: Voice control engine that runs fully in the browser using WebAssembly

#8

Post by dredds » Sun, Oct 07, 2018, 12:21 PM UTC

Oddly, all site text invisible in Chrome 55 (UC Browser) and FF 57. (text exists, but must be same as bg color, including all buttons)

Re: Voice control engine that runs fully in the browser using WebAssembly

#9

Post by oulipo » Sun, Oct 07, 2018, 12:44 PM UTC

If you are interested in a voice engine which will be open-sourced soon and works on Raspberry Pi 3, iOS, Android, osX and Linux, you can take a look at what we are building at Snips https://snips.ai

Re: Voice control engine that runs fully in the browser using WebAssembly

#10

Post by maxerickson » Sun, Oct 07, 2018, 12:59 PM UTC

oulipo wrote: post #9

If you are interested in a voice engine which will be open-sourced soon and works on Raspberry Pi 3, iOS, Android, osX and Linux, you can take a look at what we are building at Snips https://snips.ai

A bare minimum for advertising your project in this discussion would be a friendly comparison.

All you've done here is spam the discussion, like you always do.