Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Apple's On-Device and Server Foundation Models

machinelearning.apple.com

Post reply on HN
Print view View original

171–180 of 562 posts

Re: Apple's On-Device and Server Foundation Models

#171

Post by ofou »

Quite interesting this was released right after multiple rants from Elon sparked debates on X.

"If Apple integrates OpenAI at the OS level, then Apple devices will be banned at my companies. That is an unacceptable security violation."

Replying to Tim Cook: "Don’t want it. Either stop this creepy spyware or all Apple devices will be banned from the premises of my companies."

"It’s patently absurd that Apple isn’t smart enough to make their own AI, yet is somehow capable of ensuring that OpenAI will protect your security & privacy!

Apple has no clue what’s actually going on once they hand your data over to OpenAI. They’re selling you down the river."

https://x.com/elonmusk/status/1800269249912381773 https://x.com/elonmusk/status/1800266437677768765 https://x.com/elonmusk/status/1800265431078551973

Re: Apple's On-Device and Server Foundation Models

#172

Post by tonynator »

dghlsakjg wrote: post #164
tonynator wrote: post #155

Earlier quoted context omitted.

So it's not going to be better than other models, but it will be more censored. I guess that might be a selling point for their customer base?

iPhone share is ~59% of smartphones in the US. Their customer base is effectively all demographics.

Those who dislike censorship and enjoy hacking avoid iPhones for obvious reasons.

Re: Apple's On-Device and Server Foundation Models

#173

Post by duxup »

tonynator wrote: post #172
dghlsakjg wrote: post #164

Earlier quoted context omitted.

iPhone share is ~59% of smartphones in the US. Their customer base is effectively all demographics.

Those who dislike censorship and enjoy hacking avoid iPhones for obvious reasons.

I feel that way, have an iPhone.

Re: Apple's On-Device and Server Foundation Models

#174

Post by overstay8930 »

tonynator wrote: post #172
dghlsakjg wrote: post #164

Earlier quoted context omitted.

iPhone share is ~59% of smartphones in the US. Their customer base is effectively all demographics.

Those who dislike censorship and enjoy hacking avoid iPhones for obvious reasons.

People who understand cybersecurity hygiene use iPhones for obvious reasons

Re: Apple's On-Device and Server Foundation Models

#175

Post by musictubes »

talldayo wrote: post #118
immibis wrote: post #74

Earlier quoted context omitted.

Without the "so we can spy on you" part.

But they won't even make good on that : https://arstechnica.com/tech-policy/2023/12/apple-admits-to-... There's your bleeding, sorry truth there. It's only a matter of time until we get another headline like it.

The article did say Apple was compelled to supply the data. Not sure what your point is.

Re: Apple's On-Device and Server Foundation Models

#176

Post by marcellus23 »

rishabhjain1198 wrote: post #166

For people interested in AI research, there's nothing new here. IMO they should do a better job of referencing existing papers and techniques. The way they wrote about "adaptors" can make it seem like it's something novel, but it's actually just re-iterating vanilla LoRA. It was enough to convince one of the top-voted HackerNews comments that this was a "huge development". Benchmarks are nice though.

They refer to LoRA explicitly in the post.

Re: Apple's On-Device and Server Foundation Models

#177

Post by jimbobthrowawy »

xena wrote: post #90
layer8 wrote: post #40

Earlier quoted context omitted.

Public content is still subject to copyright, and I doubt that AppleBot only scrapes content carrying a suitable license. And "fair use" (which is unclear if it applies), in case you want to invoke it, is a notion limited to the US and only a handful of other countries.

All you have to do is drop a token swear word into your content and they remove it from the dataset. Easy.

Why would they? From the moderate of testing I've done of their handwriting recognition on an ipad, they seem to have everything risqué/offensive I could think of in there, even if you have to write it more clearly than other words. I don't expect this to be much different, other than a word filter on the output.

Re: Apple's On-Device and Server Foundation Models

#178

Post by threeseed »

rishabhjain1198 wrote: post #166

For people interested in AI research, there's nothing new here. IMO they should do a better job of referencing existing papers and techniques. The way they wrote about "adaptors" can make it seem like it's something novel, but it's actually just re-iterating vanilla LoRA. It was enough to convince one of the top-voted HackerNews comments that this was a "huge development". Benchmarks are nice though.

It's a huge development in terms of it being a consumer-ready, on-device LLM.

And if Karpathy thinks so then I assume it's good enough for HN:

https://x.com/karpathy/status/1800242310116262150

Re: Apple's On-Device and Server Foundation Models

#179

Post by hotdogscout »

crooked-v wrote: post #82
cube2222 wrote: post #30

Halfway down the article contains some great charts with comparisons to other relevant models, like Mistral-7B for the on-device models, and both gpt-3.5 and 4 for the server-side models. They include data about the ratio of which outputs human graders preferred (for server side it’s better than 3.5, worse than 4). BUT, the interesting chart to me is „Human Evaluation of Output Harmfulness” which is much, much ”bette…

I want to know what they consider "harmful". Is it going to refuse to operate for sex workers, murder mystery writers, or people who use knives?

I bet it's the usual double standards the AI one percenters cater to.

No sex because apparently it's harmful yet never explained why.

No homophobia/transphobia if you're Christian but if you're Muslim it's fine.

Re: Apple's On-Device and Server Foundation Models

#180

Post by rishabhjain1198 »

threeseed wrote: post #178
rishabhjain1198 wrote: post #166

For people interested in AI research, there's nothing new here. IMO they should do a better job of referencing existing papers and techniques. The way they wrote about "adaptors" can make it seem like it's something novel, but it's actually just re-iterating vanilla LoRA. It was enough to convince one of the top-voted HackerNews comments that this was a "huge development". Benchmarks are nice though.

It's a huge development in terms of it being a consumer-ready, on-device LLM. And if Karpathy thinks so then I assume it's good enough for HN: https://x.com/karpathy/status/1800242310116262150

The productization of it (like Karpathy mentioned) is awesome. But I think the URL for that would be this maybe? [link](https://www.apple.com/apple-intelligence/)
Post reply on HN