The 256gb and 512gb models have 8gb of ram. The 1tb and 2tb models have 16gb. Not a fan of tying ram to storage. https://www.apple.com/ipad-pro/specs/
I don't think it's strictly for price gouging/segmentation purposes. On the Macbooks (running MacOS), RAM has been used as data cache to speed up data read/write performance until the actual SSD storage operation completes. It makes sense for Apple to account for with higher RAM spec for the 1TB/2TB configurations.
Apple introduces M4 chip
641–650 of 1001 posts
Re: Apple introduces M4 chip
#642Earlier quoted context omitted.
> 8gb of ram. WTF? Why so little? That's insane to me, that's the amount of RAM you get with a mid-range android phone.
We've reached a point where their chips has become so amazing they have to introduce "fake scarcity" and "fake limits" to sell their pro lines, while dividing their customers into haves and havenots, while actively stalling the entire field for the masses.
Re: Apple introduces M4 chip
#643Together with next-generation ML accelerators in the CPU, the high-performance GPU, and higher-bandwidth unified memory, the Neural Engine makes M4 an outrageously powerful chip for AI. In case it is not abundantly clear by now: Apple's AI strategy is to put inference (and longer term even learning) on edge devices. This is completely coherent with their privacy-first strategy (which would be at odds with sending dat…
It will take a long time before you can put performant inference on edge device.
Just download one of the various open source large(st) langage model and test it on your desktop...
Compute power and memory and storage requirements are insane if you want decent result... I mean not just Llama gibberish.
Until such requirement are satisfied, distant model are the way to go, at least for conversational model.
Aside llm, AlphaGo would not run on any end user device, by a long shot, even if it is an already 'old' technology.
I think 'neural engine' on end user device is just marketing nonsense at this current state of the art.
Re: Apple introduces M4 chip
#644Given that recent Apple laptops already have solid all-day battery life, with such a big performance per watt improvement, I wonder if they'll end up reducing how much battery any laptops ship with to make them lighter.
Re: Apple introduces M4 chip
#645Together with next-generation ML accelerators in the CPU, the high-performance GPU, and higher-bandwidth unified memory, the Neural Engine makes M4 an outrageously powerful chip for AI. In case it is not abundantly clear by now: Apple's AI strategy is to put inference (and longer term even learning) on edge devices. This is completely coherent with their privacy-first strategy (which would be at odds with sending dat…
Re: Apple introduces M4 chip
#646Together with next-generation ML accelerators in the CPU, the high-performance GPU, and higher-bandwidth unified memory, the Neural Engine makes M4 an outrageously powerful chip for AI. In case it is not abundantly clear by now: Apple's AI strategy is to put inference (and longer term even learning) on edge devices. This is completely coherent with their privacy-first strategy (which would be at odds with sending dat…
Re: Apple introduces M4 chip
#647So why should I buy any Apple Laptop with M3 chip now (if I'm not in hurry)? lol
Re: Apple introduces M4 chip
#648Earlier quoted context omitted.
This comment is odd. I wouldn't say it is misleading, but it is odd because it borders on such definition. > Apple's AI strategy is to put inference (and longer term even learning) on edge devices This is pretty much everyone's strategy. Model distillation is huge because of this. This goes in line with federated learning. This goes in line with model pruning too. And parameter efficient tuning and fine tuning and pr…
> This is pretty much everyone's strategy. I think this is being too charitable on the state of "everyone". It's everyone's goal . Apple is actively achieving that goal, with their many year strategy of in house silicon/features.
So are other companies, with their many year strategy of actually building models that accessible to the public.
yet Apple is "actively" achieving the goal without any distinct models.
Re: Apple introduces M4 chip
#649Earlier quoted context omitted.
>n case it is not abundantly clear by now: Apple's AI strategy is to put inference (and longer term even learning) I'm curious: is anyone seriously using apple hardware to train Ai models at the moment? Obviously not the big players, but I imagine it might be a viable option for Ai engineers in smaller, less ambitious companies.
Not really (I work on AI/ML Infrastructure at a well known tech company and talk regularly w/ our peer companies). That said, inference on apple products is a different story. There's definitely interest in inference on the edge. So far though, nearly everyone is still opting for inference in the cloud for two reasons: 1. There's a lot of extra work involved in getting ML/AI models ready for mobile inference. And thi…
Re: Apple introduces M4 chip
#650LLaMA 3 tokens/second please, that's what we care about.