Live data from Hacker News

Apple's On-Device and Server Foundation Models

machinelearning.apple.com

131–140 of 562 posts

Re: Apple's On-Device and Server Foundation Models

#131
post #84

Is it me or Apple is really moving fast? I don't think it is easy for a company of this size to concisely put a vision of AI in these short and crazy AI times. BTW, not an Apple fan but an Apple user.

Google had similar AI functionality on Pixels last year and Microsoft had like six AI CoPilot products before that. So I would not say Apple is moving fast.

Most people expected this update 6 months ago.

Re: Apple's On-Device and Server Foundation Models

#132

This is great, however Apple needs to be explicit on what it, and what isn't relayed to third party services, and provide the ability to opt-out if desired. It's one thing to run inference on-device, and another to send your data through OpenAI's APIs. The partnership details are not entirely clear to me as a user.

[deleted]

Re: Apple's On-Device and Server Foundation Models

#133

This is great, however Apple needs to be explicit on what it, and what isn't relayed to third party services, and provide the ability to opt-out if desired. It's one thing to run inference on-device, and another to send your data through OpenAI's APIs. The partnership details are not entirely clear to me as a user.

[deleted]

Re: Apple's On-Device and Server Foundation Models

#134

This is great, however Apple needs to be explicit on what it, and what isn't relayed to third party services, and provide the ability to opt-out if desired. It's one thing to run inference on-device, and another to send your data through OpenAI's APIs. The partnership details are not entirely clear to me as a user.

It's literally the prompt you just gave it, that's what they're sending to ChatGPT, nothing else. None of the features that sift through your data are touching OpenAI.

Re: Apple's On-Device and Server Foundation Models

#136

Earlier quoted context omitted.

I personally disagree but you make fair points. Scale: Many companies (e.g. Google, Bing) have been scraping at scale for decades without issue. Why does scale become an issue when an LLM is thrown into the mix? Informed consent: I’m not sure I fully understand this point, but I’d say most people posting content on the public internet are generally aware that people and bots might view it. I guess you think it’s diff…

There's a big difference between scraping a website so you can direct curious people to it (Googlebot) and scraping a website so you can set up a new website that conveys the same information, but earns you money and doesn't even credit the sources used (which these LLM services often do). There is a whole genre of copyright infringement where someone will scrape a website and create a per-pixel copy of it but loaded…

> remove your name from it, cut it into pieces, and rehost the content on my own page, mashed up with other walkthroughs of the same game.

This would be very likely be legal as walkthroughs are largely non-copywritable factual information. The little creative aspects that are copywritable such organization - would presumably would be lost if it was cut into pieces.

Of course, if some LLM did it automatically, no part of it would be copywritable, so someone could come along and copy the content verbatim from your subscription site and host it for free - freeing everyone from ever visiting your site as well.

Re: Apple's On-Device and Server Foundation Models

#137

Earlier quoted context omitted.

They are? Did you watch the keynote? They talked about it at length.

[flagged]

They told explicitly there are three things. On device AI for queries that can be done on device, private cloud compute for those that can’t and opt in ChatGPT(-4o) support for more general queries.

Cloud compute queries only use the data for answering the queries and are run on an OS where storage is not available along other privacy measures. The builds of the OS will be public and auditable by security researchers.

I think it’s plenty details for a non-tech keynote. The tech details are in the session and SotU.

Re: Apple's On-Device and Server Foundation Models

#138
post #57

“We utilize adapters, small neural network modules that can be plugged into various layers of the pre-trained model, to fine-tune our models for specific tasks.” This is huuuuge. I don’t see announcement of 3rd party training support yet, but I imagine/hope it’s planned. One of the hard things about local+private ML is I don’t want every app I download to need GBs of weights, and don’t want a delay when I open a new…

With huge blobs of binary model weights, dynamic linking is cool again.

Which Apple has put some pretty large effort in the last few years to improve in iOS

Re: Apple's On-Device and Server Foundation Models

#140

> We train our foundation models on licensed data, including data selected to enhance specific features, as well as publicly available data collected by our web-crawler, AppleBot. Web publishers have the option to opt out of the use of their web content for Apple Intelligence training with a data usage control. And, of course, nobody has known to opt-out by blocking AppleBot-Extended until after the announcement wher…

I hate to tell you, but I've been training a neural network on the internet for over a decade now. Specifically the one between my ears. Unfortunately, it seems to be gradually going insane.
Post reply on HN