Earlier quoted context omitted.
Multimodal Large Language Model
why not LLMM?
The bikeshed color argument never ceases to be relevant. Would you say "large language model multimodal"? I doubt it.
Ferret: A Multimodal Large Language Model
201–210 of 332 posts
Re: Ferret: A Multimodal Large Language Model
#202I really hope Apple releases an iPhone with a good on-device private LLM assistant, perhaps next year. Their hardware is well-positioned for it. It could make me get a new phone outside of my usual ~4 year cycle. Siri is almost unusable for me.
I really, really doubt it for one reason: I’m convinced Apple is still terrified of that “Amazon Alexa tells child to stick a penny in a socket” story, and will hamstring themselves in an attempt to have their agential cake and eat it too
Apple is all about a controlled pleasant experience, it doesn't matter if it doesn't give you shiny new things; most Apple customers don't even know those shiny new things exist, so they keep spreading the word that "Apple is so easy and simple."
The idea of having an unpredictable LLM in the ecosystem is Apple's worst nightmare. I bet they will overly restrict it to the point that it stops being a general purpose LLM and becomes a neutered obedient LLM that always acts according to Apple's rules.
Also, it doesn't help that ALL the authors of this Apple paper are chinese. It raises questions about how Apple will handle political debates with its LLM.
Re: Ferret: A Multimodal Large Language Model
#203Earlier quoted context omitted.
> Rumors suggest they’re gearing up to make iOS 18 an AI focused release. Don't underestimate Apple at disappointing enthusiasts like you and me. We've been hearing many awesome stories about the next thing Apple will do, only to realize their marketing team chose to keep it for future iOS/MBP/iPhone generations to keep the profits high.
I think your expectations are wrong. They sit there in silence with a few leaks here and there and some github projects, people speculate and get all excited about extrapolating those things. Then Apple deliver what works which may or may not be related to it. What they don't do is sell you a lie a year before release then deliver shit (like every other fucking vendor).
> What they don't do is sell you a lie a year before release then deliver shit (like every other fucking vendor).
If you're referring to Google, then you're right. But OpenAI has consistently delivered what they announced pretty quickly. Same with Microsoft. To think that Apple somehow has a secret sauce that helps them surprise everyone is an illusion. They've had 3 years now to show their interest in LLMs, but they're just too conservative to "think different" anymore.
Re: Ferret: A Multimodal Large Language Model
#204They're already going multi-modal? Holy crap, if google can't deliver in the accessibility space for this (image descriptions better than "the logo for the company"), then I'll definitely go back to Apple. I mean I do hope Apple cleans out bugs and makes VoiceOver feel like it won't fall over if I breathed hard, but their image descriptions, even without an LLM, are already clean and clear. More like "A green logo on…
Honestly if they are coming out with a paper now Apple has probably been working on it for a year or two at minimum . Next year releases of macOS / iOS are rumored to have LLMs as a feature .
I don’t mean to discount this work, but this particular model is the product of a few months of work tops. It’s effectively LLava with different training data, targeted at a specific use case. While I’m sure there is a significant effort at multimodal LLMs within Apple, this is just a tiny corner of it.
Re: Ferret: A Multimodal Large Language Model
#205anyone know what is the best open source model that allows commercial use and can run locally on an iphone?
Mistral 7B is pretty good and the instruct v0.2 runs on my iPhone through MLC Chat.
However, the ChatGPT4 app is much better in usability: better model, multi-modal with text/vision/speech and better UI.
Re: Ferret: A Multimodal Large Language Model
#206Earlier quoted context omitted.
Rumors suggest they’re gearing up to make iOS 18 an AI focused release. It’ll be interesting to see if they offer different capabilities for online/offline scenarios, or if their offerings are strictly offline. Here’s one story to offer some context. There are others. https://archive.is/en3VL
> Rumors suggest they’re gearing up to make iOS 18 an AI focused release. Don't underestimate Apple at disappointing enthusiasts like you and me. We've been hearing many awesome stories about the next thing Apple will do, only to realize their marketing team chose to keep it for future iOS/MBP/iPhone generations to keep the profits high.
This. If there is slightest chance model can say “poop” - they’ll can it
Re: Ferret: A Multimodal Large Language Model
#207Earlier quoted context omitted.
Because the first word is "multimodal" :^) and also because MLLM is the established initialism.
My point was the phrase already contains the word model. Why are we calling it a multimodel LL model? Why not just add multi to the existing model?
There is something like a "multimodel LLM" but it's called MoE ("mixture of experts").
Re: Ferret: A Multimodal Large Language Model
#208anyone know what is the best open source model that allows commercial use and can run locally on an iphone?
Mistral 7B is pretty good and the instruct v0.2 runs on my iPhone through MLC Chat. However, the ChatGPT4 app is much better in usability: better model, multi-modal with text/vision/speech and better UI.
gpt 4 allows commercial use?
Re: Ferret: A Multimodal Large Language Model
#209Earlier quoted context omitted.
With iOS 17 they added a tiny little LLM to the predictive typing. I have the newest and greatest iPhone but I feel that I very rarely see it in action. I must assume that it’s just too slow at to keep up with my typing at the moment. Or it’s just not large enough to give very many useful suggestions.
Is tiny LLM an oxymoron? I believe Apple has told us it’s a transformer language model, but not specifically a LLM.
There's no difference. An LLM is just a transformer language model that's "large".
Re: Ferret: A Multimodal Large Language Model
#210Earlier quoted context omitted.
I really, really doubt it for one reason: I’m convinced Apple is still terrified of that “Amazon Alexa tells child to stick a penny in a socket” story, and will hamstring themselves in an attempt to have their agential cake and eat it too
Apple is all about a controlled pleasant experience, it doesn't matter if it doesn't give you shiny new things; most Apple customers don't even know those shiny new things exist, so they keep spreading the word that "Apple is so easy and simple." The idea of having an unpredictable LLM in the ecosystem is Apple's worst nightmare. I bet they will overly restrict it to the point that it stops being a general purpose LL…
> Also, it doesn't help that ALL the authors of this Apple paper are chinese. It raises questions about how Apple will handle political debates with its LLM.
The CCP thinks it owns all Chinese people on Earth, but that doesn't mean you have to agree with them!