Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Ferret: A Multimodal Large Language Model

github.com

Post reply on HN
Print view View original

231–240 of 332 posts

Re: Ferret: A Multimodal Large Language Model

#231

Post by pkage »

shrimpx wrote: post #227
harryVic wrote: post #220

Earlier quoted context omitted.

Can you give an example? I switched to android because i use personal assistant a lot while driving and siri was absolutely horrible.

- FaceID - Facial recognition in Photos - "Memories" in Photos - iOS keyboard autocomplete using LLMs. I am bilingual and noticed in the latest iOS it now does multi-language autocomplete and you no longer have to manually switch languages. - Event detection for Calendar - Depth Fusion in the iOS camera app, using ML to take crisper photos - Probably others... The crazy thing is most/all of these run on the device.

I just wish you could turn the multilingual keyboard off—I find that I usually only type in one language at a time and having the autocomplete recommend the wrong languages is quite frustrating

Re: Ferret: A Multimodal Large Language Model

#232

Post by cpill »

behnamoh wrote: post #203
baz00 wrote: post #80

Earlier quoted context omitted.

I think your expectations are wrong. They sit there in silence with a few leaks here and there and some github projects, people speculate and get all excited about extrapolating those things. Then Apple deliver what works which may or may not be related to it. What they don't do is sell you a lie a year before release then deliver shit (like every other fucking vendor).

> What they don't do is sell you a lie a year before release then deliver shit (like every other fucking vendor). If you're referring to Google, then you're right. But OpenAI has consistently delivered what they announced pretty quickly. Same with Microsoft. To think that Apple somehow has a secret sauce that helps them surprise everyone is an illusion. They've had 3 years now to show their interest in LLMs, but they…

I think LLMs are to inconsistent for Apple's taste, I mean that in both senses. Their perfectionism won't risk bad output, ever, which is impossible for LLMs

Re: Ferret: A Multimodal Large Language Model

#233

Post by fbdab103 »

madeofpalk wrote: post #225
shrimpx wrote: post #216

Apple has been looking sleepy on LLMs, but they've been consistently evolving their hardware+software AI stack, without much glitzy advertising. I think they could blow away Microsoft/OpenAI and Google, if suddenly a new iOS release makes the OpenAI/Bard chatbox look laughably antiquated. They're also a threat to Nvidia, if a significant swath of AI usage switches over to Apple hardware. Arm and TSMC would stand to w…

I doubt Apple’s going to make some big ChatGPT-style chatbot. They’re “just” going to use the same tech to drive iterative (good!) improvements to their products, like Siri and keyboard auto-complete.

I would challenge the keyboard autocomplete. I find the Apple suggestions to be frustratingly poor vs my experience on Android.

Re: Ferret: A Multimodal Large Language Model

#234

Post by Baldbvrhunter »

astrange wrote: post #211
thebruce87m wrote: post #133

Earlier quoted context omitted.

They are right to be careful, they are held to a much higher standard than their competitors. Pixel phones have had emergency call issues for years across multiple models but they just get a pass. Apple would be crucified for this.

Sounds like a regulator issue. Doing emergency calls is a phone's #1 job, they shouldn't be allowing them to be sold if they don't work.

yet in 15+ years I have never used any of mine for that

Re: Ferret: A Multimodal Large Language Model

#235

Post by Booourns »

fbdab103 wrote: post #233
madeofpalk wrote: post #225

Earlier quoted context omitted.

I doubt Apple’s going to make some big ChatGPT-style chatbot. They’re “just” going to use the same tech to drive iterative (good!) improvements to their products, like Siri and keyboard auto-complete.

I would challenge the keyboard autocomplete. I find the Apple suggestions to be frustratingly poor vs my experience on Android.

Out of curiosity have you experienced their autocorrect on iOS 17 because that’s when they updated to be LLM based?

Re: Ferret: A Multimodal Large Language Model

#236

Post by shrimpx »

pkage wrote: post #231
shrimpx wrote: post #227

Earlier quoted context omitted.

- FaceID - Facial recognition in Photos - "Memories" in Photos - iOS keyboard autocomplete using LLMs. I am bilingual and noticed in the latest iOS it now does multi-language autocomplete and you no longer have to manually switch languages. - Event detection for Calendar - Depth Fusion in the iOS camera app, using ML to take crisper photos - Probably others... The crazy thing is most/all of these run on the device.

I just wish you could turn the multilingual keyboard off—I find that I usually only type in one language at a time and having the autocomplete recommend the wrong languages is quite frustrating

That's true, I have found that mildly annoying sometimes. But most of the time it's a win. It was really annoying manually switching modes over and over when typing in mixed-language, which I do fairly often. It'd be great if there was a setting though.

Re: Ferret: A Multimodal Large Language Model

#238

Post by astrange »

Baldbvrhunter wrote: post #234
astrange wrote: post #211

Earlier quoted context omitted.

Sounds like a regulator issue. Doing emergency calls is a phone's #1 job, they shouldn't be allowing them to be sold if they don't work.

yet in 15+ years I have never used any of mine for that

Good for you. It's the only thing phones are required to be able to do in the US even if they don't have a working SIM or you haven't paid the phone bill.

Well, I guess they're also not allowed to cause RF interference or randomly catch fire.

Re: Ferret: A Multimodal Large Language Model

#239

Post by theferalrobot »

shrimpx wrote: post #216

Apple has been looking sleepy on LLMs, but they've been consistently evolving their hardware+software AI stack, without much glitzy advertising. I think they could blow away Microsoft/OpenAI and Google, if suddenly a new iOS release makes the OpenAI/Bard chatbox look laughably antiquated. They're also a threat to Nvidia, if a significant swath of AI usage switches over to Apple hardware. Arm and TSMC would stand to w…

Given Apple's track record on anything AI related and the terrible state they keep CoreML that not only seems extraordinarily unlikely, it would take a lot of time to win developer trust and that I just don't see happening.

Re: Ferret: A Multimodal Large Language Model

#240

Post by georgespencer »

Booourns wrote: post #235
fbdab103 wrote: post #233

Earlier quoted context omitted.

I would challenge the keyboard autocomplete. I find the Apple suggestions to be frustratingly poor vs my experience on Android.

Out of curiosity have you experienced their autocorrect on iOS 17 because that’s when they updated to be LLM based?

Transformer based autocomplete on iOS 17 feels just as bad -- but in different ways -- as its previous incarnation to me.
Post reply on HN