Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Apple's On-Device and Server Foundation Models

machinelearning.apple.com

Post reply on HN
Print view View original

341–350 of 562 posts

Re: Apple's On-Device and Server Foundation Models

#341

Post by esskay »

Hugsun wrote: post #285
throwaway4good wrote: post #251

Earlier quoted context omitted.

I think NVIDIA has the highest hardware markup at the moment.

You get considerably more ML FLOPS per dollar in a 4090 than any mac. It seems like the base M2 MAX is at roughly the same price point. It does grant you more RAM. Quadro and Tesla cards might be a different story. I would still like to see concrete FLOPS/$ numbers.

Of course you do, Apple's selling mobile SOC's not high end cards. That doesn't mean they're incapable of making them for the right application. You don't seriously think the server farms running on M4 Pro Max chips do you...

Re: Apple's On-Device and Server Foundation Models

#342

Post by esskay »

orbital-decay wrote: post #337

> 2. Represent our users: We build deeply personal products with the goal of representing users around the globe authentically. We work continuously to avoid perpetuating stereotypes and systemic biases across our AI tools and models. How do they represent users around the globe authentically while being located in Cupertino, CA? (more of a rhetorical question really)

You mean the person on the other side of the planet doesn't know about Philz Coffee down on Stevens Creek Blvd, or that there's a cool park a 2 minute walk away from Apple HQ?!

It does baffle me how California centric they are with many of their announcements, and even some features.

Re: Apple's On-Device and Server Foundation Models

#343

Post by rfoo »

glial wrote: post #228
wraptile wrote: post #224

Earlier quoted context omitted.

RAM is literally the cheapest primary component in a laptop at going rate of 1-4usd/GB. I'd say that shipping 8GB base model in 2024 is clearly manipulation by Apple, i.e. planned obsolescence or a way to moat Apple software. Anyone who doesn't see this is just being delusional. Same way Apple and Samsung ship 128GB of storage when the production price between 128gb and 1tb is like 10$ (on a 1000$ device). Samsung ev…

> RAM is literally the cheapest primary component Is that still true for Apple's integrated memory? It might be - I just don't know.

> integrated memory

Yes. The cost of bonding memory to their chip is mostly the same for 8G / 16G / 32G / practically any number.

Re: Apple's On-Device and Server Foundation Models

#344

Post by csvm »

lolinder wrote: post #185
rishabhjain1198 wrote: post #166

For people interested in AI research, there's nothing new here. IMO they should do a better job of referencing existing papers and techniques. The way they wrote about "adaptors" can make it seem like it's something novel, but it's actually just re-iterating vanilla LoRA. It was enough to convince one of the top-voted HackerNews comments that this was a "huge development". Benchmarks are nice though.

> For people interested in AI research, there's nothing new here. Was anyone expecting anything new? Apple has never been big on living at the cutting edge of technology exploring spaces that no one has explored before—from laptops to the iPhone to iPads to watches, every success they've had has come from taking tech that was already prototyped by many other companies and smoothing out the usability kinks to get it r…

Prototyping tech is one thing; making it a widely adopted success is another. For instance, Apple was the first to bring WiFi to laptops in 1999. Everyone laughed at them at the time. Who needs a wireless network when you can have a physical LAN, ey?

Re: Apple's On-Device and Server Foundation Models

#345

Post by rfoo »

pjmlp wrote: post #259
dimtion wrote: post #122

Earlier quoted context omitted.

With huge blobs of binary model weights, dynamic linking is cool again.

Dynamic linking has always been cool for writing plugins. It is kind of ironic that languages that praise so much for going back to early linking models, have to resort for much heavier OS IPC for similar capabilities.

Which languages?

IIUC Go and Rust resort to OS IPC based plugin system mainly because they refused to have a stable ABI.

On the other hand, at $DAYJOB we have a query engine written in C++ (which itself uses mostly static linking [1]) loading mostly static linked UDFs and ... it works.

[1] Without glibc, but with libstdc++ / libgcc etc.

Re: Apple's On-Device and Server Foundation Models

#346

Post by rfoo »

scosman wrote: post #338
eightysixfour wrote: post #125

Earlier quoted context omitted.

This is how Google is doing it too.

Oh missed that! But kinda as expected: only works on 2 android phones (pixel 8 pro, S24). Pretty typical: Apple isn’t first, but also typically will scale faster with HW+platform integration.

> will scale faster

* Only in USA, both intentionally and not.

Re: Apple's On-Device and Server Foundation Models

#348

Post by blue_light_man »

cloogshicer wrote: post #347

[flagged]

Language is mostly used for conditioning people into doing things. People will continue using language to manipulate you into giving your time or money to them. You cannot change others from trying to manipulate you. You can only change yourself and stop taking language seriously.

Re: Apple's On-Device and Server Foundation Models

#349

Post by Deathmax »

scosman wrote: post #338
eightysixfour wrote: post #125

Earlier quoted context omitted.

This is how Google is doing it too.

Oh missed that! But kinda as expected: only works on 2 android phones (pixel 8 pro, S24). Pretty typical: Apple isn’t first, but also typically will scale faster with HW+platform integration.

On Apple’s side, Apple Intelligence will only be enabled on A17 Pro and M-series chips, so only the iPhone 15 Pro and Pro Max will be supported in terms of phones.
Post reply on HN