> Usage and License Notices: The data, and code is intended and licensed for research use only.
[deleted]
Ferret: A Multimodal Large Language Model
121–130 of 332 posts
Re: Ferret: A Multimodal Large Language Model
#122> FERRET is trained on 8 A100 GPUs So Apple uses NVidia internally. Not surprising, but doesn't bode well for A Series. Dogfooding. [edit] I meant M series, Apple Silicon
[deleted]
Re: Ferret: A Multimodal Large Language Model
#123Earlier quoted context omitted.
I really hope they will make siri usable. In the current state it’s only good for fixed phrases. And even then it fails time to time
I hope they get rid of it completely. People on r/locallama and others have made much better assistants using GPT which use iOS APIs to control the phone. It's ridiculous that Apple still hasn't done anything useful regarding Siri.
It's been in an 'AI' rewrite for a while now. Pretty sure we'll see something next year.
Re: Ferret: A Multimodal Large Language Model
#124I really hope Apple releases an iPhone with a good on-device private LLM assistant, perhaps next year. Their hardware is well-positioned for it. It could make me get a new phone outside of my usual ~4 year cycle. Siri is almost unusable for me.
[deleted]
Re: Ferret: A Multimodal Large Language Model
#125Finally, some decent competition for Not Hotdog!
[deleted]
Re: Ferret: A Multimodal Large Language Model
#126I wonder if these models are trained to have some kind of identification in case you use them for non-research purposes for example. "Tell me who is your manufacturer" for example
[deleted]
Re: Ferret: A Multimodal Large Language Model
#127Maybe the abstract of the paper is a better introduction to what this is: > We introduce Ferret, a new Multimodal Large Language Model (MLLM) capable of understanding spatial referring of any shape or granularity within an image and accurately grounding open-vocabulary descriptions. To unify referring and grounding in the LLM paradigm, Ferret employs a novel and powerful hybrid region representation that integrates d…
>>spatial referring I can't seem to nail down the meaning of this phrase on its own. All the search results seem to turn up are "spatial referring expressions".
It sounds like the "region inputs" are raster or vector inputs. So I'm imagining highlighting a region of the photo with my finger and having it tell me "that's the Duomo in Florence."
Re: Ferret: A Multimodal Large Language Model
#128Earlier quoted context omitted.
Why would they dogfood Apple Silicon for training models? Seems like a waste of developer time to me.
Apple doesn’t even sell NVidia cards on their Mac Pros. Are they training it on Linux? I think Apple would strive to be great at all computing related tasks. “Oh, Macs are not good for that, you should get a PC” should make them sad and worried. AI/LLM is the new hot thing. If people are using Windows or Linux, you’re loosing momentum, hearts and minds… and sales, obviously.
Apple doesn't even make rack-mount server hardware. It's not that surprising.
Apple makes very capable, efficient devices for end users and content producers. End users do not normally need to train new models.
Re: Ferret: A Multimodal Large Language Model
#129I really hope Apple releases an iPhone with a good on-device private LLM assistant, perhaps next year. Their hardware is well-positioned for it. It could make me get a new phone outside of my usual ~4 year cycle. Siri is almost unusable for me.
With iOS 17 they added a tiny little LLM to the predictive typing. I have the newest and greatest iPhone but I feel that I very rarely see it in action. I must assume that it’s just too slow at to keep up with my typing at the moment. Or it’s just not large enough to give very many useful suggestions.
Really? Typing in my iPhone 12 Pro has become a nightmare. I suspect it is because of predictive typing ML shit. It happens all the freaking time now. The symptom is that my whole device just froze for a few seconds while the next word is squeezed out. How do I turn it off?
Re: Ferret: A Multimodal Large Language Model
#130Earlier quoted context omitted.
I really hope they will make siri usable. In the current state it’s only good for fixed phrases. And even then it fails time to time
I hope they get rid of it completely. People on r/locallama and others have made much better assistants using GPT which use iOS APIs to control the phone. It's ridiculous that Apple still hasn't done anything useful regarding Siri.
I'd be (pleasantly) surprised; look at how long it takes them to allow system apps to get replaced with downloadable 3rd party.
And even then, the activation keyword is likely to be whatever Apple says. Similar logic as 3rd party keyboards, don't want user input to get stuck on even merely potentially untrustworthy or buggy code.