> M4 has Apple’s fastest Neural Engine ever, capable of up to 38 trillion operations per second, which is faster than the neural processing unit of any AI PC today. I always wonder what crazy meds Apple employees are on. Two RTX 4090s is quite common for hobbyist use, and that is 1321 TOPS each, making two over 69 times more than what Apple claims to be the fastest in the world. That performance is literally less tha…
I have a MacBook M2 and a PC with a 4090 ("just" one of them) - the VRAM barrier is usually what gets me with the 4090 when I try to run local LLMs (not train them). For a lot of things, my MacBook is fast enough, and with more RAM, I can run bigger models easily. And, it's portable and sips battery. The marketing hype is overblown, but for many (most? almost all?) people, the MacBook is a much more useful choice.
Under full throttle/load, even though the M2Pro is rated as less-performant, it is only using 105W — the tower/GPU are >450W!