Apple Intelligence for iPhone, iPad, and Mac • Hacker News Board

Re: Apple Intelligence for iPhone, iPad, and Mac

#981

Post by ducadveritatem » Tue, Jun 11, 2024, 9:30 PM UTC

KaiserPro wrote: post #931

corps_and_code wrote: post #512

Earlier quoted context omitted.

Can you explain what you mean with "extract more information from you than google" here? Not saying you're wrong, I'm just curious what sources or info you're using to make that claim.

on iOS Apple record: o who you message, when you message. o Your locations (find my devices) o your voice (siri) o the location of your items (airtags) o what you look at (App telemetry) o What websites you visit (Safari telemetry) o what you buy (Apple Pay) o Who your with (location services, again) o your facial biometrics (apple photos tags people with similar faces, something FAcebook got fined for) o Who emails…

What do you mean by the “record”? It seems like you think this means Apple somehow has access and stores all that information in their cloud and we just have to hope/trust that they don’t decide they want to poke around in it?

You should look more into their security architecture if you’re curious about stuff like this. The way Secure Enclave, E2EE (including the Advanced Data Protection feature for all iCloud data), etc. The reality is that they use a huge range of privacy enhancing approaches to minimize what data has to leave your device and how it can be used. For example the biometrics you mention are never outside the Secure Enclave in the chip on your phone and nobody except you can access them unless they have your passcode. Things like running facial recognition on your photos library is handled locally on your device with no information going up to the cloud. FindMy is also architected in a fully E2E encrypted way.

You can browse their hundreds of pages of security and privacy documentation via the table of contents here to look up any specific service or functionality you want to know more about: https://support.apple.com/guide/security/welcome/web

Re: Apple Intelligence for iPhone, iPad, and Mac

#982

Post by ducadveritatem » Tue, Jun 11, 2024, 10:04 PM UTC

AshamedCaptain wrote: post #344

tom1337 wrote: post #251

Earlier quoted context omitted.

Your data is being shared. But they've shown that it is being done in a way where only required data leaves the devices and there are some protections in place which try to minimize misuse of the data (the OS will only communicate with publicly signed versions of the server for example). The call to Apples "Private Compute Cloud" is intransparent to the user, ChatGPT calls need permission if I understood it correctly…

> the OS will only communicate with publicly signed versions of the server for example This hardly increases security, and does not increase privacy at all. If anything it provides Apple with an excuse that they will throw at you when you ask "why can't I configure my iOS device to use my servers instead of yours?" , which is one of the few ways to actually increase privacy. This type of BS should be enough to realiz…

Before you write off their claims I encourage you to read more about the detailed specifics (if you have the technical footing and inclination to do so). While the approaches should certainly be probed and audited, it’s clearly more than performative. https://security.apple.com/blog/private-cloud-compute/

Also a good thread from Matthew Green, a privacy/cryptography wonk, on the subject: https://x.com/matthew_d_green/status/1800291897245835616?s=4...

Re: Apple Intelligence for iPhone, iPad, and Mac

#983

Post by ducadveritatem » Tue, Jun 11, 2024, 10:11 PM UTC

dombili wrote: post #283

None of these features seem to be coming to Vision Pro, which I think is quite baffling. Arguably it's the device that can use them the most.

Word on the street (someone who was talking to Apple employees at WWDC) is that the Vision Pro doesn’t have enough headroom on the processor for it. It’s driving that sucker really hard just doing its “regular” thing.

Re: Apple Intelligence for iPhone, iPad, and Mac

#984

Post by ducadveritatem » Tue, Jun 11, 2024, 10:12 PM UTC

losvedir wrote: post #388

> Independent experts can inspect the code that runs on Apple silicon servers to verify privacy, and Private Cloud Compute cryptographically ensures that iPhone, iPad, and Mac do not talk to a server unless its software has been publicly logged for inspection. Technically, the sentence could be read that experts inspect the code, and the client uses TLS and CA's to ensure it's only talking to those Apple servers. But…

The details of their approach: https://security.apple.com/blog/private-cloud-compute/

Re: Apple Intelligence for iPhone, iPad, and Mac

#985

Post by ducadveritatem » Tue, Jun 11, 2024, 10:13 PM UTC

menacingly wrote: post #34

The privacy conversation was pretty shady, and honestly full of technical holes with pointless misleading distractions

You can only go into so much detail in that format for that audience. I was happy that they simultaneously posted a much more technical deep dive: https://security.apple.com/blog/private-cloud-compute/

Re: Apple Intelligence for iPhone, iPad, and Mac

#986

Post by ducadveritatem » Tue, Jun 11, 2024, 10:34 PM UTC

breadwinner wrote: post #65

The worst part of Apple Intelligence is that it will now be a layer in between you and your friends & family. Every message will now be "cleaned up" by Apple Intelligence so you are not directly talking with your mom, best friend etc.

I actually liked that they didn’t show any of the AI writing capabilities being used in iMessage but rather in email client for more professional contexts. I’m really curious to see if they make it available in iMessage…

Re: Apple Intelligence for iPhone, iPad, and Mac

#987

Post by ducadveritatem » Tue, Jun 11, 2024, 10:37 PM UTC

abrichr wrote: post #176

> With onscreen awareness, Siri will be able to understand and take action with users’ content in more apps over time. For example, if a friend texts a user their new address in Messages, the receiver can say, “Add this address to his contact card.” I wonder how they will extend this to business processes that are not in their training set. At https://openadapt.ai we rely on users to demonstrate tasks, then have the…

Can’t find a link right now (search terms are pretty crowded atm!) but I saw they just recently shared an llm they’ve been working on that is designed to answer questions about how a give screen of an app functions. (Identifying buttons, core functionality, etc.)

Re: Apple Intelligence for iPhone, iPad, and Mac

#988

Post by ducadveritatem » Tue, Jun 11, 2024, 10:39 PM UTC

iandanforth wrote: post #606

I think the only way I would trust this is if they explicitly described how they would combat 5-eyes surveillance. If you're not willing to acknowledge that the most dangerous foe of privacy in the western world is the governments of the western world then why should I believe anything you have to say about your implementation?

You can read what they have shared about the security aspects of the cloud portion of their AI offering here: https://security.apple.com/blog/private-cloud-compute/

Re: Apple Intelligence for iPhone, iPad, and Mac

#989

Post by ducadveritatem » Tue, Jun 11, 2024, 10:41 PM UTC

zx10rse wrote: post #488

Jumping on the chatgpt hype train is a mistake. I don't want anything from my devices to be accessible by openai. It will bite them back big time.

Good news then that you’re explicitly asked for permission each time any query would by shared with ChatGPT.

Re: Apple Intelligence for iPhone, iPad, and Mac

#990

Post by ducadveritatem » Tue, Jun 11, 2024, 10:45 PM UTC

Almondsetat wrote: post #259

hu3 wrote: post #101

Am I understanding correctly that some AI will run on Apple servers? So not completely offline AI. If so that's somewhat disappointing given how much AI power Apple hardware packs. > Apple sets a new standard for privacy in AI, with the ability to flex and scale computational capacity between on-device processing and larger, server-based models that run on dedicated Apple silicon servers

I think it's a little disingenuous to think on-device accelerators on a mobile phone would be able to do literally any AI task without help

Based on their presentations yesterday and accompanying written materials they have a pretty capable ~3B parameter Foundational LLM running fully locally on the devices which is the first line. https://machinelearning.apple.com/research/introducing-apple...