I really hope Apple releases an iPhone with a good on-device private LLM assistant, perhaps next year. Their hardware is well-positioned for it. It could make me get a new phone outside of my usual ~4 year cycle. Siri is almost unusable for me.
Ferret: A Multimodal Large Language Model
161–170 of 332 posts
Re: Ferret: A Multimodal Large Language Model
#162Earlier quoted context omitted.
Correct me if I’m wrong but isn’t the activation word “special” in that it has to work in very low power states? I always assumed that is why the wake words are fixed, because said words need to “fit” within a very small power budget.
Could be — I've heard rumours along those lines, but none came with evidence.
The rumors were true.
Re: Ferret: A Multimodal Large Language Model
#163I really hope Apple releases an iPhone with a good on-device private LLM assistant, perhaps next year. Their hardware is well-positioned for it. It could make me get a new phone outside of my usual ~4 year cycle. Siri is almost unusable for me.
Rumors suggest they’re gearing up to make iOS 18 an AI focused release. It’ll be interesting to see if they offer different capabilities for online/offline scenarios, or if their offerings are strictly offline. Here’s one story to offer some context. There are others. https://archive.is/en3VL
Re: Ferret: A Multimodal Large Language Model
#164Earlier quoted context omitted.
I think your expectations are wrong. They sit there in silence with a few leaks here and there and some github projects, people speculate and get all excited about extrapolating those things. Then Apple deliver what works which may or may not be related to it. What they don't do is sell you a lie a year before release then deliver shit (like every other fucking vendor).
They're plenty capable of delivering garbage. Certain year models of the MacBook pro were inherently faulty. I've had the displeasure of having two of them bought for me at work. All of Apple's windows software (iTunes, Safari, etc) has been, at best, a barely working port. I'm assuming they are putting a lot more thought and care into it than the touchbar, crappy keyboards and the rest, but I'm also not holding out…
It’s incredibly rare for Apple to publicly talk about things that won’t be selling extremely soon.
The iPhone had to be pronounced because it was going to show up on the FCC website, and obviously Apple wanted to control the message. I suspect the Vision Pro may be similar, but they also wanted developers to start getting ready so they would have software day one.
The only thing I can think of that Apple pre-announced and failed at was the Air Power mat. They said it would be coming out soon after and had to push that a couple times before finally canceling it.
Other than that small exception, if modern (post jobs return) Apple announces something is coming, it will come out and be quite close to what they say.
They don’t pull a Humane AI, Segway, Cyberpunk 2077, or No Man’s Sky.
Re: Ferret: A Multimodal Large Language Model
#165>Ferret: A Multimodal Large Language Model What I thought when reading the title: A new base model trained from the ground up on multimodal input, on hundreds to thousands of GPUS The reality: A finetune of Vicuna, trained on 8xA100, which already is a finetune of Llama 13b. Then it further goes on to re-use some parts of LLava, which is an existing multimodal project already built upon Vicuna. It's not really as exc…
Re: Ferret: A Multimodal Large Language Model
#166I really hope Apple releases an iPhone with a good on-device private LLM assistant, perhaps next year. Their hardware is well-positioned for it. It could make me get a new phone outside of my usual ~4 year cycle. Siri is almost unusable for me.
Re: Ferret: A Multimodal Large Language Model
#167Re: Ferret: A Multimodal Large Language Model
#168They're already going multi-modal? Holy crap, if google can't deliver in the accessibility space for this (image descriptions better than "the logo for the company"), then I'll definitely go back to Apple. I mean I do hope Apple cleans out bugs and makes VoiceOver feel like it won't fall over if I breathed hard, but their image descriptions, even without an LLM, are already clean and clear. More like "A green logo on…
Re: Ferret: A Multimodal Large Language Model
#169I really hope Apple releases an iPhone with a good on-device private LLM assistant, perhaps next year. Their hardware is well-positioned for it. It could make me get a new phone outside of my usual ~4 year cycle. Siri is almost unusable for me.
The auto correct is already backed by a smallish LLM, FYI. https://jackcook.com/2023/09/08/predictive-text.html
Re: Ferret: A Multimodal Large Language Model
#170Earlier quoted context omitted.
Rumors suggest they’re gearing up to make iOS 18 an AI focused release. It’ll be interesting to see if they offer different capabilities for online/offline scenarios, or if their offerings are strictly offline. Here’s one story to offer some context. There are others. https://archive.is/en3VL
> Rumors suggest they’re gearing up to make iOS 18 an AI focused release. Don't underestimate Apple at disappointing enthusiasts like you and me. We've been hearing many awesome stories about the next thing Apple will do, only to realize their marketing team chose to keep it for future iOS/MBP/iPhone generations to keep the profits high.
A voice assistant that takes 3 seconds to reply and then takes half a second per word is a nice demo, but not a product Apple wants to sell.
And yes, some people will say they rather have that than nothing on their hardware, but “the Internet” would say iOS 18 is slow, eats battery life, etc, damaging Apple’s brand.