Live data from Hacker News

25 Years In Speech Technology and I still don’t talk to my computer

matthewkaras.medium.com

131–140 of 296 posts

Re: 25 Years In Speech Technology and I still don’t talk to my computer

#131
I use Siri on my phone all the time, but for one thing and one thing only: reminders.

"Hey Siri, remind me in 2 hours to do X"

"Hey Siri, remind me when I get home to do Y"

"Hey Siri, remind me next time I go to Costco to buy Z"

It's pretty quick to set up reminders by voice, especially location-based reminders. Almost anything else I'd rather do via a UI.

Re: 25 Years In Speech Technology and I still don’t talk to my computer

#132
post #33

Earlier quoted context omitted.

I use my voice assistant on my phone to set timers. That's it.

Weather is also useful! Sometimes reminders, which are basically timers. But yea that's it.

Siri doesn't get the weather right.

"What's the weather in Yosemite" and "Yosemite weather" can get you two drastically different results. As of right now (10/26/2020 10:35 AM) the two results I get are 43F and 32F.

Re: 25 Years In Speech Technology and I still don’t talk to my computer

#133
post #13

Earlier quoted context omitted.

> I can set my own alarms, thank you. And not only that, but a specialized user interface is often preferable to voice even when the assistant passes the Turing test. There's a reason that people use apps to get food delivery rather than calling.

It's funny, but for years I've felt like "Hey Siri, set an alarm for 7am" was 1000x easier than using the clunky Clock UI and it's almost exclusively what I use Siri for. Tasks that are so perfectly well-defined are exactly what this "smart" tech is useful for. Except that recently, Siri screwed me. I said "hey Siri, set an alarm for 6:30am" and her response was "Ok, your 6:30am alarm is on," but what she actually me…

Agreed, I find this to be a great use case for voice assistants. Or on the occasion I feel like napping after lunch "Hey Siri, wake me up in an hour".

Re: 25 Years In Speech Technology and I still don’t talk to my computer

#134
post #75

I can barely manage to talk to people. Why on earth would I want to talk to a box?

It might be a good way to learn to talk to people, or just talk... Actually, just use Discord for that, join random servers and the voice chats.

That sounds even worse.

Re: 25 Years In Speech Technology and I still don’t talk to my computer

#135
post #13

Earlier quoted context omitted.

> I can set my own alarms, thank you. And not only that, but a specialized user interface is often preferable to voice even when the assistant passes the Turing test. There's a reason that people use apps to get food delivery rather than calling.

It's funny, but for years I've felt like "Hey Siri, set an alarm for 7am" was 1000x easier than using the clunky Clock UI and it's almost exclusively what I use Siri for. Tasks that are so perfectly well-defined are exactly what this "smart" tech is useful for. Except that recently, Siri screwed me. I said "hey Siri, set an alarm for 6:30am" and her response was "Ok, your 6:30am alarm is on," but what she actually me…

Ouch. I just did a quickie test asking Siri to set me a reminder for 'tomorrow at eighteen'. No dice. It set it for 8 am.

It doesn't even support 24 hour time - at least in English.

Re: 25 Years In Speech Technology and I still don’t talk to my computer

#136

Earlier quoted context omitted.

It's funny, but for years I've felt like "Hey Siri, set an alarm for 7am" was 1000x easier than using the clunky Clock UI and it's almost exclusively what I use Siri for. Tasks that are so perfectly well-defined are exactly what this "smart" tech is useful for. Except that recently, Siri screwed me. I said "hey Siri, set an alarm for 6:30am" and her response was "Ok, your 6:30am alarm is on," but what she actually me…

Alarms and reminders are my most frequent uses of Siri (and to entertain/frustrate the kids...). It's also pretty good for hands-free quick texts while driving and hands-free calling, though I don't do those often. Your alarm example is frustrating. Of course, you could say "set alarm for tomorrow at 6:30 am" which would work, but then you're back in the realm not of natural language commands, but formal commands tha…

Yeah, I would think it would be obvious to most humans that "set an alarm for 6:30am" never means "6:30am four days from now." It seems like it should just be interpreted as the next occurring 6:30am unless otherwise specified, but hey, I'm not a computer.

Edit: also, your "tomorrow at 6:30am" example is also open to interpretation if you're saying it two minutes after midnight. I'd really like it to recognize these sort of ambiguities and prompt me for clarification. "It's after midnight. By 'tomorrow at 6:30am', do you mean you want your alarm to go off about 6 hours from now or the next day?"

Re: 25 Years In Speech Technology and I still don’t talk to my computer

#137
post #48
post #20

Earlier quoted context omitted.

Which is exactly why I prefer formal query languages over NLP queries. In both cases (at least with most state of the art NLP techniques), you have to learn certain patterns and ways to phrase a query so that the system will reliably understand it. With formal query languages, these patterns are well-defined, can be looked up and will most likely not change significantly (so there is value in memorizing them). With N…

Well, to extend the GUI/console metaphor, it means that at some point soon, we'll all be using NLP because it's dramatically more user-friendly for the vast majority of people.

GUIs won over console workflows because GUIs have better discoverability and the "recall vs recognize" difference; it's mentally much easier to recognize the option you want when presented it than to recall the existence or the naming of that option.

In those aspects of UX, voice interfaces have the same drawbacks as console apps when compared to a good GUI.

Also, they have to work within the "bandwidth bottleneck" of audio - just imagine a phone system that tells you all the options you have, "Press 1 for something, Press 2 for another thing..." - they are so annoying because they are slow and inherently linear; a GUI can show the same options all at once, and you can read it much faster than listen to them.

So NLP as such is not dramatically more user-friendly unless it is at the "do what I mean" level which likely requries full human-level general artificial intelligence; before that it's just a voice equivalent of a console app, sharing all the problems of discoverability and needing to remember what the system can do and how should it be invoked.

Re: 25 Years In Speech Technology and I still don’t talk to my computer

#138
post #5

A big problem with the assistants is that as soon as they fail at a query they seem stupid, I feel stupid, and I stop using them for a long time. Last weekend I had the following failed queries: "OK Google, what is the air quality like at Mt. Shasta today?" "OK Google, add a waypoint for the last gas station before the mountain pass" "OK Google, what percentage of people can you detect to be wearing masks on recent I…

> "OK Google, what percentage of people can you detect to be wearing masks on recent Instagram photos tagged at a location within a 10 mile radius of Mt. Shasta?"

Ok, so you need the assistant to:

* Already have a trained dataset of people wearing masks

* Fetch ALL instagram pictures it can find

* Not only detect if there's a mask in the picture, but count them

* Fetch the location of Mount Shasta

* Calculate a 10 mile radius around it

* Apply that calculation to the people counted in the first step

* Calculate a percentage of people wearing masks which needs:

* Count people not wearing masks.

Those steps are sub-optimal. So you need not only understand that, but to run some sort of 'query planner' in order to get the results you are looking for.

You are thinking of Jarvis from Iron Man. Forget assistants. Allow someone to construct a query like this in a couple of minutes and you have a great product you can sell. Existing ones require quite a bit of domain knowledge and setup. Not even things like Wolfram Alpha would be able to parse this query.

This reminds me of: https://xkcd.com/1425/

Re: 25 Years In Speech Technology and I still don’t talk to my computer

#139
post #10

There are good use cases apart from Dictation for Speech tech: 1. Voice based operations in factories, construction workers who want to have both the hands free but want to navigate via a device 2. Use cases while Driving. E.g. A Driver who is delivering goods. 3. Call centre - Analytics of audio calls etc. Can have many use cases 4. Voice assistant like Alexa, Siri. Mind that Alexa, Siri have vision to do more than…

> 1. Voice based operations in factories, construction workers who want to have both the hands free but want to navigate via a device

They can't understand speech properly in a quiet environment, and you want them to get your commands on a factory floor or construction site? :)

Re: 25 Years In Speech Technology and I still don’t talk to my computer

#140
post #20
post #5

A big problem with the assistants is that as soon as they fail at a query they seem stupid, I feel stupid, and I stop using them for a long time. Last weekend I had the following failed queries: "OK Google, what is the air quality like at Mt. Shasta today?" "OK Google, add a waypoint for the last gas station before the mountain pass" "OK Google, what percentage of people can you detect to be wearing masks on recent I…

Which is exactly why I prefer formal query languages over NLP queries. In both cases (at least with most state of the art NLP techniques), you have to learn certain patterns and ways to phrase a query so that the system will reliably understand it. With formal query languages, these patterns are well-defined, can be looked up and will most likely not change significantly (so there is value in memorizing them). With N…

> Which is exactly why I prefer formal query languages over NLP queries.

People like to reference Star Trek for stuff like NLP queries, but if you go back to TNG and pay close attention to the verbal queries to the computer, much of the time it isn't natural language. They seem to actually use some sort of formal query language that fits English a bit closer, but is still distinct from when the characters speak to each other.

Post reply on HN