921–930 of 1001 posts
Together with next-generation ML accelerators in the CPU, the high-performance GPU, and higher-bandwidth unified memory, the Neural Engine makes M4 an outrageously powerful chip for AI. In case it is not abundantly clear by now: Apple's AI strategy is to put inference (and longer term even learning) on edge devices. This is completely coherent with their privacy-first strategy (which would be at odds with sending dat…
Together with next-generation ML accelerators in the CPU, the high-performance GPU, and higher-bandwidth unified memory, the Neural Engine makes M4 an outrageously powerful chip for AI. In case it is not abundantly clear by now: Apple's AI strategy is to put inference (and longer term even learning) on edge devices. This is completely coherent with their privacy-first strategy (which would be at odds with sending dat…
> In case it is not abundantly clear by now: Apple's AI strategy is to put inference (and longer term even learning) on edge devices. This is completely coherent with their privacy-first strategy (which would be at odds with sending data up to the cloud for processing). Their primary business goal is to sell hardware. Yes, they’ve diversified into services and being a shopping mall for all, but it is about selling lu…
There are a ton of us out here that consciously choose Apple because of their position on privacy. I have to imagine they know how many customers they'll lose if they ever move on this, and I want to believe that it's a large enough percentage to prevent it from happening. Certainly my circle is not a useful sample, but the Apple people in it are almost all Apple people because of privacy.
I've got a Mac Pro paperweight because the motherboard went. It's going to the landfill. I can't even sell it for parts because I can't erase the SSD. If they didn't solder everything to the board you could actually repair it. When I replace my current Dell laptop, it will be with a repairable framework laptop.
Get a heat gun and remove the NAND. Then sell the rest of it to a local repair store or just give them for free if it's an old Mac Pro. The parts in your Mac Pro are something someone can reuse to restore their Mac Pro instead of a landfill. Not every part is security related. Also Apple may take the Mac Pro itself and give you store credit cause they do recycle it.
I dread using a Mac for any serious work, you lose a lot of the advantages of Linux (proper package and window management, native containers, built-in drivers for every hardware out there, excellent filesystems support, etc). And you get what exactly?
Together with next-generation ML accelerators in the CPU, the high-performance GPU, and higher-bandwidth unified memory, the Neural Engine makes M4 an outrageously powerful chip for AI. In case it is not abundantly clear by now: Apple's AI strategy is to put inference (and longer term even learning) on edge devices. This is completely coherent with their privacy-first strategy (which would be at odds with sending dat…
> In case it is not abundantly clear by now: Apple's AI strategy is to put inference (and longer term even learning) on edge devices. This is completely coherent with their privacy-first strategy (which would be at odds with sending data up to the cloud for processing). Their primary business goal is to sell hardware. Yes, they’ve diversified into services and being a shopping mall for all, but it is about selling lu…
8GB RAM?? what is this, 2005? Seriously, how much would it cost Apple to start its base M4 model with 16GB RAM.
Earlier quoted context omitted.
The fundamental problem with this strategy is model size. I want all my apps to be privacy first with local models, but there is no way they can share models in any kind of coherent way. Especially when good apps are going to fine tune their models. Every app is going to be 3GB+
Foundation models will be the new .so files.
(assuming companies won't easily share all their models for this kind of effort)
The heck do I do with an M4 in an iPad? Scroll hacker news really really fast? Apple needs to reinvest in software innovation on the iPad. I don't think my use case for it has evolved in 5 years.
I was hoping they would come out and say "and now developers can develop apps directly on their iPads with our new release of Xcode" but yeah, no. Don't know if the M4 with just 16GB of memory would be very comfortable for any pro workload.
I dread using a Mac for any serious work, you lose a lot of the advantages of Linux (proper package and window management, native containers, built-in drivers for every hardware out there, excellent filesystems support, etc). And you get what exactly?