Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Ferret: A Multimodal Large Language Model

github.com

Post reply on HN
Print view View original

211–220 of 332 posts

Re: Ferret: A Multimodal Large Language Model

#211

Post by astrange »

thebruce87m wrote: post #133
bbor wrote: post #47

Earlier quoted context omitted.

I really, really doubt it for one reason: I’m convinced Apple is still terrified of that “Amazon Alexa tells child to stick a penny in a socket” story, and will hamstring themselves in an attempt to have their agential cake and eat it too

They are right to be careful, they are held to a much higher standard than their competitors. Pixel phones have had emergency call issues for years across multiple models but they just get a pass. Apple would be crucified for this.

Sounds like a regulator issue. Doing emergency calls is a phone's #1 job, they shouldn't be allowing them to be sold if they don't work.

Re: Ferret: A Multimodal Large Language Model

#212

Post by sigmar »

CaptainOfCoit wrote: post #138
nexuist wrote: post #96

Earlier quoted context omitted.

Siri is really quite dumb. I am confident that a 7B model would be able to provide better responses in over 90% of user queries. I can't even get Siri to reliably set a timer.

Yes, Siri is really dumb. But so is every 7B/13B model out there too.

Ask perplexity7B-online anything and then compare it to siri. https://labs.perplexity.ai/

Re: Ferret: A Multimodal Large Language Model

#213

Post by astrange »

michelb wrote: post #123
behnamoh wrote: post #63

Earlier quoted context omitted.

I hope they get rid of it completely. People on r/locallama and others have made much better assistants using GPT which use iOS APIs to control the phone. It's ridiculous that Apple still hasn't done anything useful regarding Siri.

It's been in an 'AI' rewrite for a while now. Pretty sure we'll see something next year.

It's been rewritten several times, people largely don't notice because they don't try using it in different languages. And of course because they want to seem savvy so they repeat impressions from other people's posts, not realizing those posts are years old.

Re: Ferret: A Multimodal Large Language Model

#214

Post by astrange »

lern_too_spel wrote: post #197
airstrike wrote: post #195

Earlier quoted context omitted.

Because they don't sell refrigerators

The point of this thread is that even though Apple makes silly charts saying how good their hardware is at ML, they use products that their silly charts say aren't as good. There is no such hypocrisy if they use Samsung refrigerators.

ML inference and training are not the same task.

Re: Ferret: A Multimodal Large Language Model

#215

Post by fragmede »

evantbyrne wrote: post #199
mrbonner wrote: post #129

Earlier quoted context omitted.

Really? Typing in my iPhone 12 Pro has become a nightmare. I suspect it is because of predictive typing ML shit. It happens all the freaking time now. The symptom is that my whole device just froze for a few seconds while the next word is squeezed out. How do I turn it off?

Compared to Android, the iOS keyboard has always been a nightmare. However, wI feel it has been causing me fewer issues within the past month-ish. Has it been updated recently?

Thankfully, Gboard is available on iOS.

Re: Ferret: A Multimodal Large Language Model

#216

Post by shrimpx »

Apple has been looking sleepy on LLMs, but they've been consistently evolving their hardware+software AI stack, without much glitzy advertising. I think they could blow away Microsoft/OpenAI and Google, if suddenly a new iOS release makes the OpenAI/Bard chatbox look laughably antiquated. They're also a threat to Nvidia, if a significant swath of AI usage switches over to Apple hardware. Arm and TSMC would stand to win.

Re: Ferret: A Multimodal Large Language Model

#217

Post by ignoramous »

behnamoh wrote: post #62
aaronbrethorst wrote: post #33

Earlier quoted context omitted.

Rumors suggest they’re gearing up to make iOS 18 an AI focused release. It’ll be interesting to see if they offer different capabilities for online/offline scenarios, or if their offerings are strictly offline. Here’s one story to offer some context. There are others. https://archive.is/en3VL

> Rumors suggest they’re gearing up to make iOS 18 an AI focused release. Don't underestimate Apple at disappointing enthusiasts like you and me. We've been hearing many awesome stories about the next thing Apple will do, only to realize their marketing team chose to keep it for future iOS/MBP/iPhone generations to keep the profits high.

> marketing team chose to keep it for future iOS/MBP/iPhone generations to keep the profits high.

VisionPro is nice. I can see costs coming down over a period of time. Also, we've been waiting long enough for that AI car.

Re: Ferret: A Multimodal Large Language Model

#218

Post by microtonal »

tjohns wrote: post #128
tambourine_man wrote: post #58

Earlier quoted context omitted.

Apple doesn’t even sell NVidia cards on their Mac Pros. Are they training it on Linux? I think Apple would strive to be great at all computing related tasks. “Oh, Macs are not good for that, you should get a PC” should make them sad and worried. AI/LLM is the new hot thing. If people are using Windows or Linux, you’re loosing momentum, hearts and minds… and sales, obviously.

Apple doesn't even make rack-mount server hardware. It's not that surprising. Apple makes very capable, efficient devices for end users and content producers. End users do not normally need to train new models.

They do make rack mount hardware:

https://www.apple.com/shop/buy-mac/mac-pro/rack

Don't know if that qualifies as server :).

Re: Ferret: A Multimodal Large Language Model

#219

Post by [deleted] »

nicce wrote: post #194
smoldesu wrote: post #42

Earlier quoted context omitted.

It doesn't matter because Apple would not offer OpenAI actual integration terms, period. Their only option is to create an alternative hardware platform, because Apple fights tooth-and-nail to pick and choose what software iPhone users are allowed to run.

That is what I was saying…

[deleted]

Re: Ferret: A Multimodal Large Language Model

#220

Post by harryVic »

shrimpx wrote: post #216

Apple has been looking sleepy on LLMs, but they've been consistently evolving their hardware+software AI stack, without much glitzy advertising. I think they could blow away Microsoft/OpenAI and Google, if suddenly a new iOS release makes the OpenAI/Bard chatbox look laughably antiquated. They're also a threat to Nvidia, if a significant swath of AI usage switches over to Apple hardware. Arm and TSMC would stand to w…

Can you give an example? I switched to android because i use personal assistant a lot while driving and siri was absolutely horrible.
Post reply on HN