Live data from Hacker News

Apple's On-Device and Server Foundation Models

machinelearning.apple.com

421–430 of 562 posts

Re: Apple's On-Device and Server Foundation Models

#421
post #124

I hope, this could mean Apple will push the baseline of ALL Macs to have higher than 8GB of Memory. While I wish we all get 16GB M4 as baseline. Apple being Apple may only give us 12GB, and charges extra $100 for the 16GB option. It will still be a lot better than 8GB though.

The have insane margin on ram and storage, it would be really surprising to see them move away from their current strategy

Re: Apple's On-Device and Server Foundation Models

#422

For people interested in AI research, there's nothing new here. IMO they should do a better job of referencing existing papers and techniques. The way they wrote about "adaptors" can make it seem like it's something novel, but it's actually just re-iterating vanilla LoRA. It was enough to convince one of the top-voted HackerNews comments that this was a "huge development". Benchmarks are nice though.

Feel Apple should have just focused on their models for this one and not complicate the conversation with OpenAI. They could have left that to another announcement later.

Quick straw poll survey around the office, many think their data will be sent off to OpenAI by default for these new features which is not the case.

Re: Apple's On-Device and Server Foundation Models

#423
post #408

Earlier quoted context omitted.

> On the other hand, people who laughed at them removing the 3.5mm jack can still safely laugh away. Then laugh at Samsung and their flagship line of phones as well, since they haven't had headphone jacks for a while now. "After Note 10 dumps headphone jack, Samsung ads mocking iPhone dongles disappear" (2019): * https://www.cnet.com/tech/mobile/after-removing-headphone-ja... "Samsung is hiding its ads that made fun…

>> On the other hand, people who laughed at them removing the 3.5mm jack can still safely laugh away. > Then laugh at Samsung and their flagship line of phones as well, since they haven't had headphone jacks for a while now. "After Note 10 dumps headphone jack, Samsung ads mocking iPhone dongles disappear" (2019): I totally do. One of the problems with Apple is the industry seems to mindlessly ape their good and bad…

At the time I felt like Apple was getting rid of the 3.5mm jack as a potential bottleneck for future iPhone designs (as one of the limiting aspects of form factor), but there still doesn't seem to be anything design-wise to justify it, even several years later. It is very clear now that it was merely to encourage Air Pod adoption.

Re: Apple's On-Device and Server Foundation Models

#424
post #416

Earlier quoted context omitted.

> For people interested in AI research, there's nothing new here. Was anyone expecting anything new? Apple has never been big on living at the cutting edge of technology exploring spaces that no one has explored before—from laptops to the iPhone to iPads to watches, every success they've had has come from taking tech that was already prototyped by many other companies and smoothing out the usability kinks to get it r…

> Apple has never been big on living at the cutting edge of technology There was such a time. Same as with Google. Interestingly, around 2015-2016 both companies significantly shifted to iterative products from big innovations. It's more visible with Google than Apple, but here's both. Apple: - Final Cut Pro - 1998: iMac - 1999: iBook G3 (father of all MacBooks) - 2000: Power Mac G4 Cube (the early grandparent of the…

No Newton?

Re: Apple's On-Device and Server Foundation Models

#425

Earlier quoted context omitted.

People who understand cybersecurity hygiene use iPhones for obvious reasons

Those cybersecurity experts are using GrapheneOS and certainly not an iPhone where they can't even check if all is going well...

I’ve worked with a few people from NCC Group, Matasano, security staff at Airbnb and OpenAI, all carry and recommend iPhones for security footing. Depending on threat model, “lockdown mode” on iOS has a lot of what is useful in Grapheme like turning off built in connectivity services & disabling JIT and other code paths in the webview.

Re: Apple's On-Device and Server Foundation Models

#426

Earlier quoted context omitted.

Is steamdeck sold at cost? From what I know Apple has a rule that everything must be sold at 40% margins. That is prob the main reason.

As a consumer I really cannot be made to care why it's the case. This artificial price tiering is stupid and everyone has been calling it a scam for years. Apple clearly knows they're in the wrong, but continues because they know nobody can stop them.

From a business perspective it's not _stupid_. It sucks for us customers, but it's "smart" from a business point of view.

Until they get serious competition, I doubt they'll change their practices.

And while I hate the overpriced memory upgrades, I still prefer paying extra, rather than Apple switching to a Ad-based business model like Google (and potentially OpenAI in the future)

Re: Apple's On-Device and Server Foundation Models

#428
post #410

Earlier quoted context omitted.

> Also to use the names everyone else is already using. That would be a very un-Apple thing to do. They really like to use their own marketing terms for technologies. It's not ARM, it's Apple Silicon. It wasn't Wi-Fi, it was AirPort. etc. etc.

> It wasn't Wi-Fi, it was AirPort. etc. etc. FWIW the term “airport” predated the name “wifi” — in those days you had to otherwise call it IEEE 802.11. And the name as great: people were buying them like crazy and hiding them in the drop ceiling to get around the corporate IT department. A nice echo of how analysts would buy their own apple II + visicalc to…get around corporate IT. I’m OK with Apple using “apple sili…

As far as I know, both the AirPort trademark and the term Wi-Fi got introduced in 1999 (could be that AirPort was a couple of weeks earlier)

Re: Apple's On-Device and Server Foundation Models

#429

It’s interesting that a sub-ChatGPT 3.5 class model can do a lot of things on-device if you marry it with a good platform and feed it personal context. GPT-4o, living on the browser, is not as compelling as a product compared to what Apple Intelligence can do on the iPhone with a less capable model.

their 3 billion parameter model can't do shit, Only some basic grammar check style rewrite and maybe summarization

Re: Apple's On-Device and Server Foundation Models

#430
post #399
post #285

Earlier quoted context omitted.

You get considerably more ML FLOPS per dollar in a 4090 than any mac. It seems like the base M2 MAX is at roughly the same price point. It does grant you more RAM. Quadro and Tesla cards might be a different story. I would still like to see concrete FLOPS/$ numbers.

They don't need the entire mac. Their cost per Max chip is probably $200-300 which beats the 4090 by a massive margin and each chip can do more than a 4090 because it also has a CPU onboard. 4090 peaks out at around 550w which means they can run 5+ of their Max chips in the same power budget. A 4090 is $2000. Apple can probably get 5 chips on a custom motherboard for that cost. They'll use the same amount of power, b…

The GPU in the M-series is much slower than a 4090. 4060-4070ish performance at best, and it varies quite a bit.
Post reply on HN