Together with next-generation ML accelerators in the CPU, the high-performance GPU, and higher-bandwidth unified memory, the Neural Engine makes M4 an outrageously powerful chip for AI. In case it is not abundantly clear by now: Apple's AI strategy is to put inference (and longer term even learning) on edge devices. This is completely coherent with their privacy-first strategy (which would be at odds with sending dat…
What are the example of the edge devices made by Apple?
Apple introduces M4 chip
661–670 of 1001 posts
Re: Apple introduces M4 chip
#662I'm still rocking an iPad 6th generation. It's a video consumption device only. A faster CPU doesn't enable any new use cases. The only reason is the consumer's desire to buy more.
New oled does look like quite a nice display though...
Once you see it, etc.
Re: Apple introduces M4 chip
#663Earlier quoted context omitted.
> In case it is not abundantly clear by now: Apple's AI strategy is to put inference (and longer term even learning) on edge devices. This is completely coherent with their privacy-first strategy (which would be at odds with sending data up to the cloud for processing). Their primary business goal is to sell hardware. Yes, they’ve diversified into services and being a shopping mall for all, but it is about selling lu…
> but it is about selling luxury hardware. Somewhat true but things are changing. While there are plenty of “luxury” Apple devices like Vision Pro or fully decked out MacBooks for web browsing we no longer live in a world where tech are just lifestyle gadgets. People spend hours a day on their phones, and often run their life and businesses through it. Even with the $1000+/2-3y price tag, it’s simply not that much gi…
Re: Apple introduces M4 chip
#664Anyone know if the ram multiples of the M4 are better than the M3? Example: could a base model M4 sport more than 24GB of ram?
Re: Apple introduces M4 chip
#665[dead]
Re: Apple introduces M4 chip
#666The 256gb and 512gb models have 8gb of ram. The 1tb and 2tb models have 16gb. Not a fan of tying ram to storage. https://www.apple.com/ipad-pro/specs/
> 8gb of ram. WTF? Why so little? That's insane to me, that's the amount of RAM you get with a mid-range android phone.
What needs that amount on a phone? 8GB on a desktop is...well it's not great, but it's usable, and usable for a damn sight more multi-tasking than you would ever do on a smartphone. Is it just because you need to look better on the spec sheet, like the silly camera megapixel wars of the 2010s?
Re: Apple introduces M4 chip
#667Together with next-generation ML accelerators in the CPU, the high-performance GPU, and higher-bandwidth unified memory, the Neural Engine makes M4 an outrageously powerful chip for AI. In case it is not abundantly clear by now: Apple's AI strategy is to put inference (and longer term even learning) on edge devices. This is completely coherent with their privacy-first strategy (which would be at odds with sending dat…
Re: Apple introduces M4 chip
#668Re: Apple introduces M4 chip
#669I get frustrated seeing this go into the iPad and knowing that we can't get a shell, and run our own binaries there. Not even as a VM like [UserLAnd]( https://userland.tech ). I could effectively travel with one device less in my backpack but instead I have to carry two M chips, two displays, batteries, and so on... It's great to see this tech moving forward but it's frustrating to not see it translate into a more si…
Re: Apple introduces M4 chip
#670When this arrives in MacBooks, what would that mean in practice? Assuming base M4 config (not max, not ultra - those were already powerful in earlier iterations), what kind of LLM could I run on it locally?
Anything up to the memory configuration it is limited to. So for base model M4, that likely means you have 8gb of memory with 4-5 of it realistically usable.