Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Personalized Hey Siri

machinelearning.apple.com

Post reply on HN
Print view View original

71–78 of 78 posts

Re: Personalized Hey Siri

#71

Post by sib »

gervase wrote: post #34
sib wrote: post #30

Earlier quoted context omitted.

Yes. In this case, the selection of a wake word ("Alexa") or phrase ("Hey Siri" or "OK Google") is driven primarily by performance (i.e., reduction of false accepts & false rejects). The folks designing these products know that, even though customers say that they'd like to customize the wake word or phrase, if the actual performance is significantly worse, those customers will not be happy. We experimented with this…

If you can share, what kind of variation in F1 score were you seeing between different trigger words? I'd expect even within a single product family (i.e. Alexa/Echo/Amazon/Computer) there's probably significant variation. I'd also be interested in the differences between a collectively-optimized wake word (without personal training) and one which the user personally trains against their voice à la the parent article…

Nothing I can share, unfortunately.

Re: Personalized Hey Siri

#72

Post by mattigames »

djur wrote: post #50
ExactoKnight wrote: post #46

Earlier quoted context omitted.

"Computer" should be the wake word, and everyone would be happy with that thanks to global, english interoperability in all places and contexts. But thanks to the hubris of corporate branding and marketing departments we are unlikely to have this universally understandable command usable. Instead to use any light switch every consumer will need to ask what bloody set up the person has...

Alexa devices actually have "Computer" as an option. I did it for a while, because I dislike pretending a computer is a person ("Alexa") and I certainly don't want to address a company ("Amazon"). I ended up switching back to "Echo" after I realized that people in my house say "computer" too often for it to work well as a wake word.

Weak move by Amazon, "OK Computer" would have been so good of an option, also for being a small tribute to Radiohead.

Re: Personalized Hey Siri

#73

Post by pwinnski »

eridius wrote: post #47
TheSpiceIsLife wrote: post #35

Earlier quoted context omitted.

You should be able to say "Hey Siri, listen carefully" brief pause "isle ... of ... dogs", or some such to have the device enter a special mode where it attempts to identify individual words more accurately.

What's wrong with just saying "isle … of … dogs"? Why would you need to enter a special mode before enunciating?

Pausing long enough to be sure the AI knows you're done pronouncing the previous words is often enough to trigger the end of the phrase. We want our AI assistant to be performant, after all!

Without a special mode, you'd likely say "Hey, Siri, play Isle..." "Okay, I found--" "Dammit, Siri, I wasn't done!"

Re: Personalized Hey Siri

#74

Post by pwinnski »

srcmap wrote: post #63

What's the technical reason to limit the wake words to only "Hey Siri", "OK Google", etc? Should one be able to "Personalized" to his/her own phase PER Device such as "Hey Commander Data" for Iphone 6, "Hey Counselor Troi " for IPad Pro or "Ok Skynet" for the google phone? That should also solve the problem where someone said "OK Google" in TV Shows/Podcast and wakeup all the google devices. With the latest "Deep Voi…

I don't work on such projects, but on other ML projects, and I suspect the answer is: training data.

There are many, many, many samples of people saying the approved trigger phrases. Many, many, many samples. To use your own custom trigger phrases, you would likely need to say it thousands of times to being to approach the accuracy the current systems ship with out of the box. Maybe tens of thousands.

That's just my conjecture, though.

Re: Personalized Hey Siri

#75

Post by pwinnski »

__david__ wrote: post #52
snootyresearch wrote: post #15

God this is depressing. Only 3 years behind Amazon and Google.

Really? I'm pretty sure "Alexa" is known for responding to the TV.

When it comes to Apple being behind in machine learning, perception is all that matters. Technical explanations about how Apple makes choices that preserve privacy are irrelevant. Actual head-to-head tests showing that Apple is ahead in some areas and behind in others are irrelevant. All that matters is that we all know that Apple is behind in machine learning.

Re: Personalized Hey Siri

#76

Post by eridius »

pwinnski wrote: post #73
eridius wrote: post #47

Earlier quoted context omitted.

What's wrong with just saying "isle … of … dogs"? Why would you need to enter a special mode before enunciating?

Pausing long enough to be sure the AI knows you're done pronouncing the previous words is often enough to trigger the end of the phrase. We want our AI assistant to be performant, after all! Without a special mode, you'd likely say "Hey, Siri, play Isle..." "Okay, I found--" "Dammit, Siri, I wasn't done!"

You don't have to wait 5 seconds between words. You just have to enunciate clearly enough that the divisions between words become truly unambiguous.

Re: Personalized Hey Siri

#77

Post by TheSpiceIsLife »

eridius wrote: post #76
pwinnski wrote: post #73

Earlier quoted context omitted.

Pausing long enough to be sure the AI knows you're done pronouncing the previous words is often enough to trigger the end of the phrase. We want our AI assistant to be performant, after all! Without a special mode, you'd likely say "Hey, Siri, play Isle..." "Okay, I found--" "Dammit, Siri, I wasn't done!"

You don't have to wait 5 seconds between words. You just have to enunciate clearly enough that the divisions between words become truly unambiguous.

It’s worth noting that, elsewhere in this thread, user smortaz wrote:

Yep, tried that too... but admittedly the sound very similar. I keep getting "I'll of dogs" and "I love dogs".

Re: Personalized Hey Siri

#78

Post by eridius »

TheSpiceIsLife wrote: post #77
eridius wrote: post #76

Earlier quoted context omitted.

You don't have to wait 5 seconds between words. You just have to enunciate clearly enough that the divisions between words become truly unambiguous.

It’s worth noting that, elsewhere in this thread, user smortaz wrote: Yep, tried that too... but admittedly the sound very similar. I keep getting "I'll of dogs" and "I love dogs".

If they're getting "I'll of dogs" then they're getting the word divisions right, but the problem there is "I'll" and "isle" sound identical so no amount of enunciating will distinguish them. The only thing to suggest at this point is to spell out the word.
Post reply on HN