Live data from Hacker News

Build your own Siri locally and on-device

thehyperplane.substack.com

31–40 of 50 posts

Re: Build your own Siri locally and on-device

#31
Faithful year and half user of chatGPT on my iPhone which has made me loathe Siri for how dumb she is in every sense of the way!

When will OpenAI (with the help of Microsoft) release a GPT phone to compete with the iPhone? Im so tired of the boring iPhone! Give me a GPT phone where from my lock screen GPT does everything for me. Fingers crossed :) it's secretively in the works!

Re: Build your own Siri locally and on-device

#33
post #23

Earlier quoted context omitted.

Part of the problem is the wake word “hey siri” is actually handed by a separate coprocessor (AOP) with the model compiled into the firmware. While anything is technically possible, it isn’t as simple as just letting the google app run in the background since the AP is asleep when any of these gesture happen. You could probably setup the action button on the side to open an assistant, but that’s going to be a less pl…

Same with android phones - a super-specific hardcoded phrase is much easier to work in the power budgets required for an "always on" part of the device. It's why a manufacturer (like Samsung) can change that sort of thing on their devices, but it's not realistically something an end user (or even an app) can customize in software. It's not some "arbitrary" limitation.

Back in 1992 or so the NeXT could distinguish (was it 16 or) 64 fixed, trained, phrases. Point being, it doesn’t take too much compute with a finite vocabulary.

Re: Build your own Siri locally and on-device

#34
post #19

I’ve noticed recently (maybe I missed an announcement) that Siri now functions locally for at least some commands. Try putting an Apple watch in airplane mode and asking it to set a timer or reminder

Siri has had limited offline functionality since at least iOS 15? Although I don't think most users noticed at the time, since most of Siri's command vocabulary is for things that require a network connection...

Re: Build your own Siri locally and on-device

#35
post #28

Earlier quoted context omitted.

> Maybe I've just had a bad microphone. Yeah, I would definitely double-check your setup. At work we use Whisper to live-transcribe-and-translate all-hands meetings and it works exceptionally well.

+1 this. Whisper works insanely well. I've been using the medium model as it has yet to mis transcribe anything noticeable, and it's very lightweight. I even converted it to a coreML model so it runs accelerated on apple silicon. It doesn't run *that* much faster than before.. but it ran really fast to begin with. For anyone tinkering, ive had much success with whisper.cpp.

What was the process of converting it like? I assume you then had to write all of the inference code as well?

Re: Build your own Siri locally and on-device

#37
post #33
post #23

Earlier quoted context omitted.

Same with android phones - a super-specific hardcoded phrase is much easier to work in the power budgets required for an "always on" part of the device. It's why a manufacturer (like Samsung) can change that sort of thing on their devices, but it's not realistically something an end user (or even an app) can customize in software. It's not some "arbitrary" limitation.

Back in 1992 or so the NeXT could distinguish (was it 16 or) 64 fixed, trained, phrases. Point being, it doesn’t take too much compute with a finite vocabulary.

But wouldn't adding your own phrases require a reflash of parts of firmware in this context?

Re: Build your own Siri locally and on-device

#38
post #30

Earlier quoted context omitted.

I do not know if it is because I have been trained to make simple requests, but there are only a half dozen things I would verbally ask a robot. - time of day - calendar date - weather - set a timer - simple math calculation That’s 90% of the functionality right there.

I'm sorry, something went wrong with your "what time is it" request. Oh you asked "what time is it in Miami?" Because I already cut you off after "what time is it". This happens on a daily basis when I'm not talking right into my phone.

It's even better asking it to play a playlist I have made and downloaded in Apple Music only for it to say "I'm going to need your permission to access your Spotify data" and play something completely random.

Even saying something like "play the playlist ____ in Apple Music" doesn't help, it cuts the "in Apple Music" part of.

Re: Build your own Siri locally and on-device

#40

Why an LLM-written article, though?

This summary-like style — with heavy formatting and every (!) paragraph as a bulleted list — drives me nuts tbqh. Especially in lengthy texts, it just looks... noisy, bland, and sometimes confusing.

What's the format you would prefer? We're not using ChatGPT to write and we've experimented with this format. The other articles may have a better format?
Post reply on HN