Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Apple announces Foundation Models and Containerization frameworks, etc

apple.com

Post reply on HN
Print view View original

411–420 of 514 posts

Re: Apple announces Foundation Models and Containerization frameworks, etc

#411

Post by nicbou »

chakintosh wrote: post #46

Some 15 years ago, A friend of mine said to me "mark my words, Apple will eventually merge OSX with iOS on the iPad". And with every passing keynote since then, it seemed Apple's been inching towards that prophecy, and today, the iPad has become practically a MacBook Air with a touch screen. Unless you were a video editor, programmer who needs resources to compile or a 3D artist, I don't see how you'd need anything o…

I really wish there was some sort of hybrid device. I often travel by foot/bike/motorbike and space comes at a premium. I'd have a Microsoft Surface if Windows was not so unbearable.

On the other hand, I have come to love having a reading/writing/sketching device that is completely separate from my work device. I can't get roped into work and emails and notifications when I just want to read in bed. My iPad Mini is a truly distraction-free device.

I also think it would be hard to have a user experience that works great both for mobile work and sitting-at-a-desk work. I returned my Microsoft Surface because of a save dialog in a sketching app. I did not want to do file management because drawing does not feel like a computing task. On the other hand, I do want to deal with files when I'm using 3 different apps to work on a website's files.

Re: Apple announces Foundation Models and Containerization frameworks, etc

#413

Post by Asmod4n »

torginus wrote: post #396
12_throw_away wrote: post #212

Earlier quoted context omitted.

FWIW, here are the repos for the CLI tool [1] and backend [2]. Looks like it is indeed VM-based container support (as opposed to WSLv1-style syscall translation or whatever): Containerization provides APIs to: [...] - Create an optimized Linux kernel for fast boot times. - Spawn lightweight virtual machines. - Manage the runtime environment of virtual machines. [1] https://github.com/apple/container [2] https://githu…

I'm kinda ignorant about the current state of Linux VMs, but my biggest gripe with VMs is that OS kernels kind of assume they have access to all the RAM the hardware has - unlike the reserve/commit scheme processes use for memory. Is there a VM technology that can make Linux aware that it's running in a VM, and be able to hand back the memory it uses to the host OS? Or maybe could Apple patch the kernel to do exactly…

It’s one reason i don’t like WSL2. When you compile something which needs 30 GB RAM the only thing you can do is terminate the wsl2 vm to get that ram back.

Re: Apple announces Foundation Models and Containerization frameworks, etc

#414

Post by emadda »

pxc wrote: post #137

I hoped for a moment that "Containerization Framework" meant that macOS itself would be getting containers. Running Linux containers and VMs on macOS via virtualization is already pretty easy and has many good options. If you're willing to use proprietary applications to do this, OrbStack is the slickest, but Lima/Colima is fine, and Podman Desktop and Rancher Desktop work well, too. The thing macOS really painfully…

> The thing macOS really painfully lacks is not ergonomic ways to run Linux VMs, but actual, native containers-- macOS containers

Linux container processes run on the host kernel with extra sandboxing. The container image is an easily sharable and runnable bundle.

macOS .app bundles are kind of like container images.

You can sign them to ensure they are not modified, and put them into the “registry” (App Store).

The Swift ABI ensures it will likely run against future macOS versions, like the Linux system APIs.

There is a sandbox system to restrict file and network access. Any started processes inherit the sandbox, like containers.

One thing missing is fine grained network rules though - I think the sandbox can just define “allow outbound/inbound”.

Obviously “.app”s are not exactly like container images , but they do cover many of the same features.

Re: Apple announces Foundation Models and Containerization frameworks, etc

#415

Post by Krssst »

lucasoshiro wrote: post #348
daveidol wrote: post #82

Earlier quoted context omitted.

To me it looks more like Windows Vista's "Aero" than OS X's "Aqua".

It also looks like KDE 4. Maybe this is consequence of the Frutiger Aero trend, and that users miss the time where user interfaces were designed to be cool instead of only useful

Current interfaces are not aimed at being optimally useful. Padding everywhere as of today means more time scrolling and wasted screen space. Animations everywhere means a lot of wasted time watching pixels moving instead of the computer/phone giving us control immediately after it did the thing we (maybe) asked for. Hiding scrollbars is a nightmare in general in desktop OSes but is the default (once lost half an hour setting up a proxy because the "save" button was hidden behind a scrollbar).

Usability feels it has only been down since Windows 7. (on another hand, Windows has plenty of accessibility features that help a lot in restoring usability)

Re: Apple announces Foundation Models and Containerization frameworks, etc

#416

Post by resource_waste »

LoganDark wrote: post #321
NotPractical wrote: post #312

Earlier quoted context omitted.

> You're either fully locked in, or fully on your own. I'm not sure what you mean by that. You can trivially root a Pixel factory image. And if you're talking about how they will punish you for that by removing certain features: Apple does that too (but to a lesser extent). https://github.com/cormiertyshawn895/RecordingIndicatorUtili...

On Android devices with AVB (so basically everything nowadays), once the bootloader is unlocked, so many things already either lock you out or degrade your service in various ways. For example, Netflix will downgrade you to 480p, Google Pay will stop working, many apps will just straight up disappear from the Play Store because SafetyNet will stop passing (especially on newer devices with hardware attestation), banki…

This is a pretty wild take.

Its reasonable to install a different OS on Android, even if some features don't work. I've done this, my friends and family have done this, I've seen it IRL.

I've never seen anyone do this on iPhone in my entire life.

But I flipped and I'm a Google hater. Expensive phones and no aux port. At least I can get cheap androids still.

Re: Apple announces Foundation Models and Containerization frameworks, etc

#417

Post by IanCal »

refulgentis wrote: post #361
hbcondo714 wrote: post #285

Earlier quoted context omitted.

> You don’t have to worry about the exact tokens that Foundation Models operates with, the API nicely abstracts that away for you [1] I have the same question. Their Deep dive into the Foundation Models framework video is nice for seeing code using the new `FoundationModels` library but for a "deep dive", I would like to learn more about tokenization. Hopefully these details are eventually disclosed unless someone el…

I guess I'd say "mu", from a dev perspective, you shouldn't care about tokens ever - if your inference framework isn't abstracting that for you, your first task would be to patch it to do so. To parent, yes this is for local models, so insomuch worrying about token implies financial cost, yes

Ish - it always depends how deep in the weeds you need to get. Tokenisation impacts performance, both speed and results, so details can be important.

Re: Apple announces Foundation Models and Containerization frameworks, etc

#418

Post by SkiFire13 »

HighGoldstein wrote: post #403
torginus wrote: post #396

Earlier quoted context omitted.

I'm kinda ignorant about the current state of Linux VMs, but my biggest gripe with VMs is that OS kernels kind of assume they have access to all the RAM the hardware has - unlike the reserve/commit scheme processes use for memory. Is there a VM technology that can make Linux aware that it's running in a VM, and be able to hand back the memory it uses to the host OS? Or maybe could Apple patch the kernel to do exactly…

> Is there a VM technology that can make Linux aware that it's running in a VM, and be able to hand back the memory it uses to the host OS? Isn't this an issue of the hypervisor? The guest OS is just told it has X amount of memory available, whether this memory exists or not (hence why you can overallocate memory for VMs), whether the hypervisor will allocate the entire amount or just what the guest OS is actually us…

> or just what the guest OS is actually using should depend on the hypervisor itself.

How can the hypervisor know which memory the guest OS is actually using? It might have used some memory in the past and now no longer needs it, but from the POV of the hypervisor it might as well be used.

This is a communication problem between hypervisor and guest OS, because the hypervisor manages the physical memory but only the guest OS known how much memory should actually be used.

Re: Apple announces Foundation Models and Containerization frameworks, etc

#419

Post by elektrontamer »

thrawa8387336 wrote: post #358
okanat wrote: post #354

Earlier quoted context omitted.

Using the Linux filesystem has almost no performance penalty under WSL2 since it is a VM. Docker Desktop automatically mounts the correct filesystem. Crossing the OS boundary for Windows files has some overhead of course but that's not the usecase WSL2 is optimized for. With WSL2 you get the best of both worlds. A system with perfect driver and application support and a Linux-native environment. Hybrid GPUs, webcams,…

FWIW I get better battery life with ubuntu.

How? What's your laptop brand and model? I've never had better battery life with any machine using ubuntu.

Re: Apple announces Foundation Models and Containerization frameworks, etc

#420

Post by bandoti »

AdieuToLogic wrote: post #340
McAlpine5892 wrote: post #98

Earlier quoted context omitted.

BSD jails are architected wholly differently from what something like Docker provides. Jails are first-class citizens that are baked deep into the system. A tool like Docker relies using multiple Linux features/tools to assemble/create isolation. Additionally, iirc, the logic for FreeBSD jails never made it into the Darwin kernel. Someone correct me please.

> BSD jails are architected wholly differently from what something like Docker provides. > Jails are first-class citizens that are baked deep into the system. Both very true statements and worth remembering when considering: > Additionally, iirc, the logic for FreeBSD jails never made it into the Darwin kernel. You are quite correct, as Darwin is is based on XNU[0], which itself has roots in the Mach[1] microkernel.…

Thank you for the links I will take a closer look at XNU. It’s neat to see how these projects influence each other.
Post reply on HN