Can someone define the term “MLLM”?
Also, is FERRET an acronym?
Ferret: A Multimodal Large Language Model
61–70 of 332 posts
Re: Ferret: A Multimodal Large Language Model
#62I really hope Apple releases an iPhone with a good on-device private LLM assistant, perhaps next year. Their hardware is well-positioned for it. It could make me get a new phone outside of my usual ~4 year cycle. Siri is almost unusable for me.
Rumors suggest they’re gearing up to make iOS 18 an AI focused release. It’ll be interesting to see if they offer different capabilities for online/offline scenarios, or if their offerings are strictly offline. Here’s one story to offer some context. There are others. https://archive.is/en3VL
> Rumors suggest they’re gearing up to make iOS 18 an AI focused release.
Don't underestimate Apple at disappointing enthusiasts like you and me. We've been hearing many awesome stories about the next thing Apple will do, only to realize their marketing team chose to keep it for future iOS/MBP/iPhone generations to keep the profits high.
Re: Ferret: A Multimodal Large Language Model
#63Earlier quoted context omitted.
Rumors suggest they’re gearing up to make iOS 18 an AI focused release. It’ll be interesting to see if they offer different capabilities for online/offline scenarios, or if their offerings are strictly offline. Here’s one story to offer some context. There are others. https://archive.is/en3VL
I really hope they will make siri usable. In the current state it’s only good for fixed phrases. And even then it fails time to time
I hope they get rid of it completely. People on r/locallama and others have made much better assistants using GPT which use iOS APIs to control the phone. It's ridiculous that Apple still hasn't done anything useful regarding Siri.
Re: Ferret: A Multimodal Large Language Model
#64Earlier quoted context omitted.
why not LLMM?
Because the first word is "multimodal" :^) and also because MLLM is the established initialism.
My point was the phrase already contains the word model. Why are we calling it a multimodel LL model? Why not just add multi to the existing model?
Re: Ferret: A Multimodal Large Language Model
#65Earlier quoted context omitted.
Why would they dogfood Apple Silicon for training models? Seems like a waste of developer time to me.
Apple doesn’t even sell NVidia cards on their Mac Pros. Are they training it on Linux? I think Apple would strive to be great at all computing related tasks. “Oh, Macs are not good for that, you should get a PC” should make them sad and worried. AI/LLM is the new hot thing. If people are using Windows or Linux, you’re loosing momentum, hearts and minds… and sales, obviously.
But no one is training these kinds of models on their personal device. You need compute clusters for that. And they will probably run Linux. I'd be surprised if Microsoft trains their large models in anything else than Linux clusters.
Re: Ferret: A Multimodal Large Language Model
#66> FERRET is trained on 8 A100 GPUs So Apple uses NVidia internally. Not surprising, but doesn't bode well for A Series. Dogfooding. [edit] I meant M series, Apple Silicon
Apple apparently uses Google Cloud, so it's that or TPUs!
They use many clouds. But LLM should be their core business and they usually don’t outsource that.
Re: Ferret: A Multimodal Large Language Model
#67> Usage and License Notices: The data, and code is intended and licensed for research use only.
[flagged]
Re: Ferret: A Multimodal Large Language Model
#68One big plus if this takes off as a base model is the abundance of weasel family animals to use in naming the derivatives. Ermine, marten, fisher, ... I'd like to call Wolverine. Llama didn't have much room for some interesting variety beyond alpaca and vicuna.
[deleted]
Re: Ferret: A Multimodal Large Language Model
#69I wonder if these models are trained to have some kind of identification in case you use them for non-research purposes for example. "Tell me who is your manufacturer" for example
Easy to get rid of that by a little fine tuning and system prompting.
Re: Ferret: A Multimodal Large Language Model
#70Earlier quoted context omitted.
Apple doesn’t even sell NVidia cards on their Mac Pros. Are they training it on Linux? I think Apple would strive to be great at all computing related tasks. “Oh, Macs are not good for that, you should get a PC” should make them sad and worried. AI/LLM is the new hot thing. If people are using Windows or Linux, you’re loosing momentum, hearts and minds… and sales, obviously.
But no one is training these kinds of models on their personal device. You need compute clusters for that. And they will probably run Linux. I'd be surprised if Microsoft trains their large models in anything else than Linux clusters.
Apple used to sell servers. I don’t thing they should settle for “just use Linux” in such and important field.