Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Ferret: A Multimodal Large Language Model

github.com

Post reply on HN
Print view View original

301–310 of 332 posts

Re: Ferret: A Multimodal Large Language Model

#301

Post by ghusbands »

shrimpx wrote: post #230
madeofpalk wrote: post #225

Earlier quoted context omitted.

I doubt Apple’s going to make some big ChatGPT-style chatbot. They’re “just” going to use the same tech to drive iterative (good!) improvements to their products, like Siri and keyboard auto-complete.

Yeah. Siri supports text input already, anyway. Siri is their ChatGPT-style bot that's going to keep improving.

But does it even work sensibly, yet? Almost every time my partner asks Siri something, it works so badly that we end up asking Android/Google's Assistant, which responds well to most things.

Re: Ferret: A Multimodal Large Language Model

#302

Post by zitterbewegung »

refulgentis wrote: post #252
zitterbewegung wrote: post #168

Earlier quoted context omitted.

Honestly if they are coming out with a paper now Apple has probably been working on it for a year or two at minimum . Next year releases of macOS / iOS are rumored to have LLMs as a feature .

> Honestly if they are coming out with a paper now Apple has probably been working on it for a year or two at minimum Why do you say that?

Academic papers can take that long …

Re: Ferret: A Multimodal Large Language Model

#303

Post by [deleted] »

antiframe wrote: post #159
darthrupert wrote: post #146

Earlier quoted context omitted.

My expectation of Apple is that they lurk in the shadows, looking at what others do while perfecting their own thing. Then on the day of release, they'll be a decade ahead of competition. They've done this a dozen times already.

Which dozen times has Apple released something decades ahead of the competition? I'm blanking on 4-12.

[deleted]

Re: Ferret: A Multimodal Large Language Model

#304

Post by hhh »

tambourine_man wrote: post #70
Gorgor wrote: post #65

Earlier quoted context omitted.

But no one is training these kinds of models on their personal device. You need compute clusters for that. And they will probably run Linux. I'd be surprised if Microsoft trains their large models in anything else than Linux clusters.

Apple used to sell servers. I don’t thing they should settle for “just use Linux” in such and important field.

> Used to

Exactly, over a decade ago...

Re: Ferret: A Multimodal Large Language Model

#305

Post by golergka »

LoganDark wrote: post #254
simonair wrote: post #244

Earlier quoted context omitted.

Are you tapping the keys or swiping over those that make up the word you want to type? In my experience, tapping has always been and remained poor but swiping is getting better and better with every iOS version.

Swiping through keys doesn't have anything to do with autocomplete. Autocomplete has to do with predicting which word you're going to type next, not guessing which word best corresponds to the swipe you just made.

Those are very related tasks, you use results of the former to help you with the latter.

Re: Ferret: A Multimodal Large Language Model

#306

Post by lachlan_gray »

theferalrobot wrote: post #239
shrimpx wrote: post #216

Apple has been looking sleepy on LLMs, but they've been consistently evolving their hardware+software AI stack, without much glitzy advertising. I think they could blow away Microsoft/OpenAI and Google, if suddenly a new iOS release makes the OpenAI/Bard chatbox look laughably antiquated. They're also a threat to Nvidia, if a significant swath of AI usage switches over to Apple hardware. Arm and TSMC would stand to w…

Given Apple's track record on anything AI related and the terrible state they keep CoreML that not only seems extraordinarily unlikely, it would take a lot of time to win developer trust and that I just don't see happening.

Maybe MLX is meant to fill this gap?

https://github.com/ml-explore/mlx

Re: Ferret: A Multimodal Large Language Model

#307

Post by emmender2 »

shrimpx wrote: post #216

Apple has been looking sleepy on LLMs, but they've been consistently evolving their hardware+software AI stack, without much glitzy advertising. I think they could blow away Microsoft/OpenAI and Google, if suddenly a new iOS release makes the OpenAI/Bard chatbox look laughably antiquated. They're also a threat to Nvidia, if a significant swath of AI usage switches over to Apple hardware. Arm and TSMC would stand to w…

generic first-order shallow argument

Re: Ferret: A Multimodal Large Language Model

#308

Post by zamalek »

shrimpx wrote: post #216

Apple has been looking sleepy on LLMs, but they've been consistently evolving their hardware+software AI stack, without much glitzy advertising. I think they could blow away Microsoft/OpenAI and Google, if suddenly a new iOS release makes the OpenAI/Bard chatbox look laughably antiquated. They're also a threat to Nvidia, if a significant swath of AI usage switches over to Apple hardware. Arm and TSMC would stand to w…

You're suggesting that Apple could fit what can't be done with a 4090 into a laptop?

Color me doubtful.

Re: Ferret: A Multimodal Large Language Model

#309

Post by hosh »

theferalrobot wrote: post #286
Aerbil313 wrote: post #274

Earlier quoted context omitted.

> see Siri, Apple photos, predictive text etc)... we only have evidence that they suck at ML …or that they only deal with mature tech and not the shiny new thing. Makes sense to me. I don’t doubt everyone will have a personal LLM-based assistant in their phones soon, but with the current rate of improvements to LLMs and AI in general, I’d wait for at least a year more while doing R&D in-house if I were Apple.

You could use that apologist language for any company. If they suck at something just say they are “biding their time” No. Apple is just demonstrably behind. Having terrible predictive text, voice to text, image classification etc isn’t just a quark of the way they do business. Those are problems with years of established work put into them and they just flat out aren’t keeping up.

“Apologists” … this is the domain of strategic analysis, business and products. Apple, Google, et al are not feudal lords or entities owed personal allegiance, nor sporting teams for fans to rally around, nor are we talking about morality and ethics where Apple did something wrong and apologists are justifying it.

As far as whether they are keeping up or not, I disagree, but neither of our opinions really matter unless we’re betting — that is, taking actions based on calculated risks we perceive.

Re: Ferret: A Multimodal Large Language Model

#310

Post by hosh »

theferalrobot wrote: post #258
hosh wrote: post #246

Earlier quoted context omitted.

Apple doesn’t have to win developer trust or build an AI platform. They just have to build a compelling consumer product that can only function with AI, and they are better equipped to do that than Google or Microsoft. It remains to be seen if OpenAI will go that route instead of a business built on training and providing access to foundational models.

>They just have to build a compelling consumer product that can only function with AI Yeah and I'm not talking exclusively about developer trust. Given Apple's current consumer lineup (see Siri, Apple photos, predictive text etc)... we only have evidence that they suck at ML. What makes you think they are going to suddenly transform overnight?

… because Siri, predictive text, etc suck because it isn’t using an LLM. Alexa, and the Google Assistants from the same era all suck as well. I don’t see how evidence that Apple sucked with pre-LLM ML is an indicator that they will suck with integrating an LLM into their products.

No one said anything about transforming overnight.

Post reply on HN