Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Apple's On-Device and Server Foundation Models

machinelearning.apple.com

Post reply on HN
Print view View original

351–360 of 562 posts

Re: Apple's On-Device and Server Foundation Models

#351

Post by _w1tm »

snemvalts wrote: post #205
keyle wrote: post #154

Earlier quoted context omitted.

It probably will change. Note that, so far, a 16GB apple device has much better usability than the equivalent on windows. This may sound biased, but the memory compression and foreground/background actions by macOS tight integration with the hardware is really good. I've never felt like I couldn't do things on smaller hardware, except (larges) LLMs. Also when I compare with my co-workers the memory pressure is a lot…

The swapping is indeed faster as the SSD is on the SoC and so fast to access. To the point that an 4 year old 8gb M1 Air is enough for simpler development work, at least for me.

SSD on chip might be a thing one day but I’m pretty sure only the RAM is on the same chip.

Re: Apple's On-Device and Server Foundation Models

#352

Post by jackothy »

kolinko wrote: post #331
jackothy wrote: post #276

Earlier quoted context omitted.

It's not so impossible to spot flaws if you're using worst-case testing scenarios. Which are not worthless because such patterns do actually pop up in real world usage, albeit rarely.

Examples?

Had one happen to me recently where I was scrolling Spotify, and they do the thing where if you try to scroll past max they will stretch the content.

One of the album covers being stretched had some kind of fine pattern on it that caused a clearly visible shifting/flashing Moiré pattern as it was being stretched.

Wish I could remember what album cover it was now.

Though really it's simple enough: As long as you can still spot a single dark pixel in the middle of an illuminated white screen, the pixels could benefit from being smaller. (Edit: swapped black and white)

Re: Apple's On-Device and Server Foundation Models

#353

Post by InsomniacL »

mrweasel wrote: post #296
throwaway4good wrote: post #290

Earlier quoted context omitted.

The M2 is a chip designed to be in a laptop (and it is quite powerful given its low power consumption). Presumedly they have a different chip or at least completely different configuration (RAM, network, etc.) in their data centers.

The interesting point here is that developers targeting the Mac can safely assume that the users will have a processor capable of significant AI/ML workloads. On the Windows (and Linux) side of things, there's no common platform, no assumption that the users will have an NPU or GPU capable of doing what you want. I think that's also why Microsoft was initially going for the ARM laptops, where they'd be sure that the…

That sounds like a big issue, but surely assuming for either case is bad.

I expect OS's will expose an API which, when queried, will indicate the level of AI inference available.

Similar to video decoding/encoding where clients can check if hardware acceleration is available.

Re: Apple's On-Device and Server Foundation Models

#354

Post by rekoil »

solarkraft wrote: post #152
ndgold wrote: post #73

Absolutely awesome amount of content in these two pages. This was not expected. It is appreciated. I can’t wait to use the server model on a Mac to spin up my own cloud optimized for the Apple stack.

What makes you think you'll get that model? Edit: I see they're committing to publishing the OS images running on their inference servers ( https://security.apple.com/blog/private-cloud-compute/ ). Would be cool if that allowed people to run their own.

> Would be cool if that allowed people to run their own.

Oh my god that would be absolutely amazing!

Re: Apple's On-Device and Server Foundation Models

#355

Post by rekoil »

esskay wrote: post #342
orbital-decay wrote: post #337

> 2. Represent our users: We build deeply personal products with the goal of representing users around the globe authentically. We work continuously to avoid perpetuating stereotypes and systemic biases across our AI tools and models. How do they represent users around the globe authentically while being located in Cupertino, CA? (more of a rhetorical question really)

You mean the person on the other side of the planet doesn't know about Philz Coffee down on Stevens Creek Blvd, or that there's a cool park a 2 minute walk away from Apple HQ?! It does baffle me how California centric they are with many of their announcements, and even some features.

The Maps stuff always gets me. Yeah sure it looks pretty, but almost none of what makes it a usable product is available to me in Sweden.

Re: Apple's On-Device and Server Foundation Models

#356

Post by gigglesupstairs »

mazzystar wrote: post #244
gigglesupstairs wrote: post #183

Earlier quoted context omitted.

Was there anything about searching through our own photos using prompts? I thought this could be pretty amazing and still a natural way to find very specific photos in one’s own photo gallery.

Run OpenAI's CLIP model on iOS to search photos. https://github.com/mazzzystar/Queryable

Yes, exactly this. I have had this for a while and works wonderfully well in most cases but it’s wonky and not seamless. I wanted a more integrated approach with Photos app which only Apple can bring to the table.

Re: Apple's On-Device and Server Foundation Models

#357

Post by Malcolmlisk »

pyinstallwoes wrote: post #340
WiSaGaN wrote: post #169

Earlier quoted context omitted.

This gives me the vibe of calling high resolution screens as "retina" screens.

Still no manufacturer compares to the quality of apple screens and resolution …

Those screens are produced by samsung.

Re: Apple's On-Device and Server Foundation Models

#359

Post by boxed »

orbital-decay wrote: post #337

> 2. Represent our users: We build deeply personal products with the goal of representing users around the globe authentically. We work continuously to avoid perpetuating stereotypes and systemic biases across our AI tools and models. How do they represent users around the globe authentically while being located in Cupertino, CA? (more of a rhetorical question really)

I wish I could have one keyboard on my iPhone and could type both Swedish and English with it. These are the basics they can't get right, and I don't see why. They clearly have bilingual people working over there, why is this so bad?
Post reply on HN