Live data from Hacker News

Apple announces Foundation Models and Containerization frameworks, etc

apple.com

441–450 of 514 posts

Re: Apple announces Foundation Models and Containerization frameworks, etc

#441
post #307

TIL macOS doesn’t have native containers, just in vm. Don’t use macOS but had just kinda assumed it would by virtue of shared unixy background with Linux

Dont containers imply a linux kernel interface ? hence, you can only have truly native containers on linux or use containers in a VM or some kind of Wine-like translation layer.

Re: Apple announces Foundation Models and Containerization frameworks, etc

#443

Earlier quoted context omitted.

BSD jails are architected wholly differently from what something like Docker provides. Jails are first-class citizens that are baked deep into the system. A tool like Docker relies using multiple Linux features/tools to assemble/create isolation. Additionally, iirc, the logic for FreeBSD jails never made it into the Darwin kernel. Someone correct me please.

> what something like Docker provides Docker isn't providing any of the underlying functionality. BSD jails and Linux cgroups etc aren't fundamentally different things.

Jails were explicitly designed for security, cgroups were more generalized as more about resource control, and leverages namespaces, capabilities, apparmor/SELinux to accomplish what they do.

> Jails create a safe environment independent from the rest of the system. Processes created in this environment cannot access files or resources outside of it.[1]

While you can accomplish similar tasks, they are not equivalent.

Assume Linux containers are jails, and you will have security problems. And on the flip side, k8s pods share UTM,IPC, Network namespaces, yet have independent PID and FS namespaces.

Depending on your use case they may be roughly equivalent, but they are fundamentally different approaches.

[1] https://freebsdfoundation.org/freebsd-project/resources/intr...

Re: Apple announces Foundation Models and Containerization frameworks, etc

#444
I'm still a little dissapointed. It seems those models are only available for iPhone series 16 and iPhone 15 pro. According to mixpanel that's only 25% of all iOS devices and even less if taking into account iPadOS. You will still have to use some other online model if you want to cover all iOS 26 users because I doubt apple will approve your app if it will only work on those Apple Intelligence devices.

Why should I bother then as a 3rd party developer? Sure nice not having a cost for API for 25% of users but still those models are very small and equivalent of qwen2.5 4B or so and their online models supposed equivalent of llama scout. Those models are already very cheap online so why bother having more complicated code base then? Maybe in 2 years once more iOS users replace their phones but I'm unlikely to use this for developing iOS in the next year.

This would be more interesting if all iOS 26 devices at least had access to their server models.

Re: Apple announces Foundation Models and Containerization frameworks, etc

#445
post #434
post #394

Earlier quoted context omitted.

I might we wrong but I guess this will only works on iphone 16 devices and iphone 15 pro - thus drastically limits your user base and you would still have to use online API for most apps. I was hoping they provide free ai api on their private cloud for other devices even if also running small models

If you start writing an app now, by the time it's polished enough to release it, the iPhone 16 will already be a year old phone, and there will be plenty potential customers. If your app is worthwhile, and gets popular in a few years, by that time iPhone 16 will be an old phone and a reasonable minimum target. Skate to where the puck is going...

Exactly, it can take at least a couple of years to get big/important apps to use iOS, macOS features. By that Iphone 16 would be quite common.

Re: Apple announces Foundation Models and Containerization frameworks, etc

#446

Earlier quoted context omitted.

I think perhaps you are overestimating the computing needs of the majority of the population. Get one of the iPad cases with a keyboard and an iPad is in many ways a better laptop.

But the majority won't pay extra for an ipad and a keyboard, when they can pay less for an air with everything included...

yes they will

Re: Apple announces Foundation Models and Containerization frameworks, etc

#447
post #388
post #329

Earlier quoted context omitted.

Was it ahead? I am not sure. There was lots of research on microkernels at the time and NT was a good compromise between a mono and a microkernel. It was an engineering product of its age. A considerably good one. It is still the best popular kernel today. Not because it is the best possible with today's resouces but because nobody else cares about core OS design anymore. I think it is the Unix side that decided to b…

> Was it ahead? I am not sure. You say this, but then proceed to state that it had a very good design back then informed by research, and still is today. Doesn't that qualify? :-) NT brought a HAL, proper multi-user ACLs, subsystems in user mode (that alone is amazing, even though they sadly never really gained momentum), preemptive multitasking. And then there's NTFS, with journaling, alternate streams, and shadow c…

> You say this, but then proceed to state that it had a very good design back then informed by research, and still is today. Doesn't that qualify? :-)

I meant that NT was a product that matched the state of the art OS design of its time (90s). It was the Unix world that decided to be behind in 80s forever.

NT was ahead not because it is breaking ground and bringing in new design aspects of 2020s to wider audiences but Unix world constantly decides to be hardcore conservative and backwards in OS design. They just accept that a PDP11 simulator is all you need.

It is similar to how NASA got stuck with 70s/80s design of Shuttle. There was research for newer launch systems but nobody made good engineering applications of them.

Re: Apple announces Foundation Models and Containerization frameworks, etc

#448

Some 15 years ago, A friend of mine said to me "mark my words, Apple will eventually merge OSX with iOS on the iPad". And with every passing keynote since then, it seemed Apple's been inching towards that prophecy, and today, the iPad has become practically a MacBook Air with a touch screen. Unless you were a video editor, programmer who needs resources to compile or a 3D artist, I don't see how you'd need anything o…

Yeah I think the majority of users, even in an office environment would be better of with an iPad in 99% of cases. All standard office stuff, like presentations; documents and similar are going to run better on an iPad. There are less foot guns, users are less likely to open 300 tabs just because they can.

If you are a developer or a creative however, then a Mac is still very useful.

Re: Apple announces Foundation Models and Containerization frameworks, etc

#449

Earlier quoted context omitted.

I maintain a llama.cpp wrapper, on everything from web to Android and cannot quite wrap my mind around if you'd have any more info by getting individual token IDs from the API, beyond what you'd get from wall clock time and checking their vocab.

I don’t really see a need for token IDs alone, but you absolutely need per-token logprob vectors if you’re trying to do constrained decoding

Interesting point, my first reaction was "why do you need logprobs? We use constrained decoding for tool calls and don't need them"...which is actually false! Because we need to throw out those log probs then find the highest log prob of a token meeting the constraints.

Re: Apple announces Foundation Models and Containerization frameworks, etc

#450
post #238

There's a different thread if you want to wax about Fluid Glass etc [1], but there's some really interesting new improvements here for Apple Developers in Xcode 26. The new foundation frameworks around generative language model stuff looks very swift-y and nice for Apple developers. And it's local and on device. In the Platforms State of the Union they showed some really interesting sample apps using it to generate d…

If the new foundation models are on device, does that mean they’re limited to information they were trained on up to that point?

Or do have the ability to reach out to the internet for up to the moment information?

Post reply on HN