Earlier quoted context omitted.
No, it's hetrogeneity, system integration, pipeline width and instruction set as well.
Well, that’s a relief then, all any data center needs to run these days is Apple’s wide-ranging suite of in house services, such as applache, dovewin, pOSXgres, and SAPple.
Apple M1 Ultra
801–810 of 855 posts
Re: Apple M1 Ultra
#802Earlier quoted context omitted.
Well, only the macOS users would be spending a thousand dollars or more for their console-capable Macs, which are general purpose computers with absurd amounts of memory. TV users could spend a lot less for an Apple TV 4K with M1 inside, assuming Apple released it with less of this or that.
The Apple TV (A12 chip) is currently $199. The new iPad Air with the M1 chip costs $599. They also don't need the display, camera, microphone. And could sell it at a loss and make the margins with TV+ and game sales. But they would need their own bundled controller/accessories and get serious about AAA gaming.
Re: Apple M1 Ultra
#803Earlier quoted context omitted.
I wouldn't assume heat is solved as it's been Apples weak point in the past. The cube would crack, g5 iMac's would melt capacitors, MacBooks would burn users' laps.
Those issues were all almost 20 years ago. If you think this is still a problem, you haven't used any recent Macs. The current MB Air and MB Pro both run very cool even under prolonged heavy loads. Apple's management of any and all heat issues has been far better than any competitors for a while now.
Only if you define "for a while" as "since a year ago with the introduction of the M1".
Apple refused to make a thicker laptop or one with better ventilation to adequately cool the CPUs & GPUs they were sticking in them. They were among if not the worst of them all at handling the heat of the components they were using. Until the M1 Pro & Max rolled around, anyway, and suddenly they got thicker, with feet that raise it farther off the desk, and absolutely massive amount of vents all over 3 sides of the machine. Curious timing on that...
Re: Apple M1 Ultra
#804Earlier quoted context omitted.
> performance per watt is really irrelevant. Watts are dollars that you'll continue spending over the system life. It matters because you can only draw so many amps per rack and there will be a point when, in order to get more capacity, you'll need to build another datacenter.
The market is not data center use.
Re: Apple M1 Ultra
#805Earlier quoted context omitted.
I suppose given that this is two M1 Max glued together, assuming cooling is a solved problem, the max SOC power consumption just twice as high as usual, plus interconnect overhead. Right? Based on the thermal and power consumption characteristics of previous chips I would not be surprised if say ~120W is the max power draw of this thing. edit: Of course the M1 max only shipped in laptops, so... who knows.
The M1 Max hits 100w in a laptop form factor with 'real' workloads when hitting CPU and GPU simultaneously (or at least not parasitic ones like prime95 & furmark). So this is probably >200w, unless it's been power limited and thus performs worse than 2x M1 Max's do anyway.
Re: Apple M1 Ultra
#806Earlier quoted context omitted.
The GPU claims on the M1 Pro & Max were, let's say, cherry picked to put it nicely. The M1 Ultra claims already look suspicious since the GPU graph tops out at ~120W & the CPU graph tops out at ~60W yet the M1 Studio is rated for 370W continuous power draw. Since you mention ML specifically, looking at some benchmarks out there (like https://tlkh.dev/benchmarking-the-apple-m1-max#heading-gpu & https://wandb.ai/tcapel…
> Well, assuming you can actually buy any of these, anyway. The M1 Ultra might win "by default" by simply being purchasable at all unlike pretty much every other GPU :/ Can we stop it with the meme that these GPUs are unobtainable? Yes, they are still overpriced compared to their supposed original prices and they'll likely never return to that price given that the base prices of manufacturing, materials and such have…
Re: Apple M1 Ultra
#807I think the GPU claims are interesting. According to the graph's footer, the M1 Ultra was compared to an RTX 3090. If the performance/wattage claims are correct, I'm wondering if the Mac Studio could become an "affordable" personal machine learning workstation (which also won't make the electricity bill skyrocket). If Pytorch becomes stable and easy to use on Apple Silicon [0][1], it could be an appealing choice. [0]…
It shocks me how much payroll and cap-ex is spent on the M1 and how little is invested in getting TensorFlow/Pytorch to work on it. I could 10x my M1 purchases for our business if we could reliably run TensorFlow on it. Seems pretty shortsighted. The GPU claims wouldnt even need to be on parity with NVIDIA, it would just need to offer a vertically integrated alternative to having to use EC2.
Re: Apple M1 Ultra
#808Earlier quoted context omitted.
AMD has never disappointed me in this regard.
Zen 4 will being using a new socket, I wouldn’t go buying a Zen 3 with plans to upgrade the CPU down the road.
Re: Apple M1 Ultra
#809Earlier quoted context omitted.
I know Nvidia has never really care much about TDP, but this still seems unbelievable to me. How could a relatively new design beat a 3090 with 200W less power, while having to share a die with a CPU? It just doesn't seem possible.
Unless the M1 Ultra is actually magic I don't think it is possible. My guess is they're putting a lot of weight on the phrase "relative power" and hoping you assume it means "relative to each other" and not "relative to their previous generation" (i.e. M1 Ultra -> M1 Max and RTX 3090 -> RTX 2080Ti) or "relative to the stock power profile". Put bluntly, if the M1 Ultra was capable of achieving performance parity with…
But you'll all but certainly see the 3090 win more benchmarks (and by a landslide) than the M1 Ultra does. Because Nvidia is really, really fucking good at this, and they spend an absurd amount of money working with external projects to fix their stuff. Like contributing a TensorFlow backend for CUDA. Or tons of optimizations in the driver to handle game-specific issues.
Meanwhile Apple is mostly in the camp of "well we built Metal2, what's taking ya'll so long to port it to our tiny marketshare platform that historically had terrible GPU drivers?"
Re: Apple M1 Ultra
#810Earlier quoted context omitted.
The first half of the event was old wine in new bottles - I reckon that’s the main growth area they are squeezing.
Or was it last seasons wine in old bottles?