M3 Max looks like the top tier GPU is a 40 series rival am I missing something?
Why do you say that? I'm sure its good but why do you specifically call out the 40s?
Apple unveils M3, M3 Pro, and M3 Max
341–350 of 1001 posts
Re: Apple unveils M3, M3 Pro, and M3 Max
#342Earlier quoted context omitted.
Are the cool kids using GGML?
Also that.
FWIW, the main developer of GGML apparently runs a M2 Ultra himself. Apple Silicon is a first class citizen on GGML and runs fast.
See eg. https://www.reddit.com/r/LocalLLaMA/comments/16o4ka8/running...
Re: Apple unveils M3, M3 Pro, and M3 Max
#343I don't understand why they don't update the entire lineup whenever a new chip comes out, especially if really only swapping the chip in the macbook pro and imac here. On a separate note does anyone have any insight on how unified memory compares to vram in the context of machine learning performance? Considering an H100 with 80GB costs like $30k a maxed out macbook pro with 128gb unified memory for $5k is interestin…
The M2 Ultra tops out at 800GB/s unified memory bandwidth. A 4090, on the other hand, has 1,008 GB/s. On the PC side, dual-channel DDR4-6400 offers a bandwidth of 102 GB/s.
Bandwidth means much less if those numbers aren't crunched faster.
Re: Apple unveils M3, M3 Pro, and M3 Max
#344I feel very disappointed that the laptops lack decent i/o. They spend all this time talking about how advanced the GPU is, but it's a $1,600 laptop that can only power one external display or a 2,000 laptop that can only power two displays? Plus they are nerfing the desktops by only offering the all-in-ones with m2, so you can walk into a store and want to buy any other desktop now you are paying a huge premium for o…
[flagged]
Re: Apple unveils M3, M3 Pro, and M3 Max
#345Earlier quoted context omitted.
I imagine the amount of people upgrading from an M2 Mac will be close to 0, while there's a lot of Intel stragglers out there.
Intel straggler here. And I'll remain one until Linux runs flawlessly on the newer generation. I have an older Thinkpad as my main workhorse and a now quite old Macbook air for on the road, it's battery has been shot for a long time but it still works quite good when plugged in and I'm too much of a miser to have it replaced. But if there is a way to run a full Linux distro on the newer hardware then I'll probably bu…
> it's battery has been shot for a long time but it still works quite good when plugged in and I'm too much of a miser to have it replaced
Consider a battery pack? I have a Bluetti K2 and get far more hours running heavy workloads than people report on M1. It's never bothered me carrying it around, though some might care I guess.
My only regret is that it's slightly over the amount that is legal on planes in most jurisdictions.
Re: Apple unveils M3, M3 Pro, and M3 Max
#346>Rendering speeds are now up to 2.5x faster than on the M1 family of chips.1 The CPU performance cores and efficiency cores are 30 percent and 50 percent faster than those in M1, respectively, and the Neural Engine is 60 percent faster than the Neural Engine in the M1 family of chips. WTH, was Apple sandbagging on the M1?
These are the new 3nm chips from TSMC, right?
The A17 Pro benchmarks are extremely disappointing, so I don't think 3nm is actually doing much.
Re: Apple unveils M3, M3 Pro, and M3 Max
#347One thing that left me a bit confused was the comparison against Intel Macs. Although I am still using an Intel 16-inch MacBook, I really wanted to see how the M3 fared against the M2, not Intel and M1. I think it's no surprise the M3 exceeds the Intel Core i7-9750H in basically all of Apple's own benchmarking. My real question, which will probably be answered next week, is how it compares to the generation right bef…
I was more surprised not to see any AI-specific benchmarks—sure, the most popular open-source models are from avowed competitors, but there should have been a way to define a re-training task that would be relevant for the wave of ML programmers.
Re: Apple unveils M3, M3 Pro, and M3 Max
#348Earlier quoted context omitted.
Why do I need to select the most expensive M3 Max version (the one with 16 cores) to get 48 or 64 gigs of RAM. The M3 Max with 14 cores only allow 36 or 96 gigs. Just let me choose 14 cores and 64 gigs.
In previous gens they had different die sizes with different physical numbers of memory controllers and connections. Guessing it's similar here. Rumor is Apple bought all of TSMC's initial 3nm production. They are probably yield limited on full featured chips.
Most likely. Let's not kid ourselves, there would be more players sharing those if they felt it was worth it.
Re: Apple unveils M3, M3 Pro, and M3 Max
#349Apple launched M2 MBPs only in January. I wonder if Qualcomm's Snapdragon X Elite (benchmarking now, but not in products until mid-2024) drove some of the timing on this launch: https://www.windowscentral.com/hardware/laptops/qualcomm-bri...
From what I’ve heard from folks connected with Apple, M3 was designed some time ago and TSMC delays on 3NM are why M2 happened at all. So, Apple is releasing M3 later than they’d have liked, and I expect we will see the M4 refresh faster than we would have otherwise.
Re: Apple unveils M3, M3 Pro, and M3 Max
#350Earlier quoted context omitted.
Any reason for not upgrading?
> Any reason for not upgrading? Why is this sort of question always framed as if people have to provide a justification for not buying a new model, as if spending money on the new shiny without any reason is normal or desirable? We live in a day and age where hardware bought a decade ago still packs enough punch to run most of today's software without any hiccup. Why would anyone waste their cash to replace something…
I'm rocking a 2017 MacBook Air and it's great--really the only down side is that Apple stopped supporting it in macOS past Monterey. Almost all of my past and present Apple hardware has long outlasted software support, which is my biggest complaint with the company.