Apple's On-Device and Server Foundation Models

Post by solarkraft » Tue, Jun 11, 2024, 1:15 AM UTC

threeseed wrote: post #96

advael wrote: post #23

Earlier quoted context omitted.

Woa, good catch! Maybe they're doing better about at least being concrete about it, though I still have to side-eye "Users control their devices" (Even with root on macbooks I don't have access to everything running on it). However, the section that promises to open-source the cloud software are impressive and if true gives them more credibility than I assumed. I would still look out for places where devices they do…

> Even with root on macbooks I don't have access to everything running on it Just disable System Integrity Protection and then you do.

Post by Sabinus » Tue, Jun 11, 2024, 1:19 AM UTC

dang wrote: post #150

idiotsecant wrote: post #148

Earlier quoted context omitted.

[flagged]

" Don't be snarky. " https://news.ycombinator.com/newsguidelines.html

Post by tonynator » Tue, Jun 11, 2024, 1:24 AM UTC

cube2222 wrote: post #30

Halfway down the article contains some great charts with comparisons to other relevant models, like Mistral-7B for the on-device models, and both gpt-3.5 and 4 for the server-side models. They include data about the ratio of which outputs human graders preferred (for server side it’s better than 3.5, worse than 4). BUT, the interesting chart to me is „Human Evaluation of Output Harmfulness” which is much, much ”bette…

Post by asadotzler » Tue, Jun 11, 2024, 1:27 AM UTC

notJim wrote: post #140

kmeisthax wrote: post #3

> We train our foundation models on licensed data, including data selected to enhance specific features, as well as publicly available data collected by our web-crawler, AppleBot. Web publishers have the option to opt out of the use of their web content for Apple Intelligence training with a data usage control. And, of course, nobody has known to opt-out by blocking AppleBot-Extended until after the announcement wher…

I hate to tell you, but I've been training a neural network on the internet for over a decade now. Specifically the one between my ears. Unfortunately, it seems to be gradually going insane.

Post by asadotzler » Tue, Jun 11, 2024, 1:32 AM UTC

ytdytvhxgydvhh wrote: post #80

mdhb wrote: post #5

Earlier quoted context omitted.

So built on stolen data essentially.

What’s the problem with that? Reproducing copyrighted works in full is problematic obviously. But if I learned English by watching American movies, I didn’t steal the language from the movie studios, I learned it.