81–90 of 1001 posts
The M4 Max goes up to 128GB RAM, and "over half a terabyte per second of unified memory bandwidth" - LLM users rejoice.
- Apple: all the capacity and bandwidth, but no compute to utilize it
- AMD/Nvidia: all the compute and bandwidth, but no capacity to load anything
- DDR5: all the capacity, but no compute or bandwidth (cheap tho)
Another positive development was bumping up baseline amounts of RAM. They kept selling machines with just 8 gigabytes of RAM for way longer than they should have. It might be fine for many workflows, but feels weird on “pro” machines at their price points.
I’m sure Apple has been coerced to up its game because of AI. Yet we can rejoice in seeing their laptop hardware, which already surpassed the competition, become even better.
The M4 Max goes up to 128GB RAM, and "over half a terabyte per second of unified memory bandwidth" - LLM users rejoice.
The M3 Max was 400GBps, this is 540GBps. Truly an outstanding case for unified memory. DDR5 doesn't come anywhere near.
https://en.wikipedia.org/wiki/DDR5_SDRAM (info from the first section):
> DDR5 is capable of 8GT/s which translates to 64 GB/s (8 gigatransfers/second * 64-bit width / 8 bits/byte = 64 GB/s) of bandwidth per DIMM.
So for example if you have a server with 16 DDR5 DIMMs (sticks) it equates to 1,024 GB/s of total bandwidth.
DDR4 clocks in at 3.2GT/s and the fastest DDR3 at 2.1GT/s.
DDR5 is an impressive jump. HBM is totally bonkers at 128GB/s per DIMM (HBM is the memory used in the top end Nvidia datacenter cards).
Cheers.
[flagged]
Disingenuous to mention the x86 based MacBooks as a basis for comparison in their benchmarks; they are trying to conflate current-gen Intel with what they shipped more than 4 years ago. Are they going to claim that 16GB RAM is equivalent to 32GB on Intel laptops? (/sarc)
Lot's of people don't upgrade on the cadence that users on this forum do. Someone was mentioning yesterday that they are trying to sell their Intel Mac {edit: on this forum] and asking advice on getting the best price. Someone else replied that they still had a 2017 model. I spoke to someone at my job (I'm IT) who told me they'd just ordered a new iMac to replace one that is 11 years old. There's no smoke and mirrors…
Wonder how good are those for LLMs (compared to M3 Pro/Max)... They talk about the Neural Engine a lot in the press release.
A specced out Mac Studio (M2 being the latest model as of today) isn't cheap, but it can run 180B models, run them fast for the price, and use <300W of power doing it. It idles below 10W as well.
It seems they also update the base memory on MacBook Air: > MacBook Air: The World’s Most Popular Laptop Now Starts at 16GB > MacBook Air is the world’s most popular laptop, and with Apple Intelligence, it’s even better. Now, models with M2 and M3 double the starting memory to 16GB, while keeping the starting price at just $999 — a terrific value for the world’s best-selling laptop.
Every M-series device now comes with at least 16GB, except for the base iPad Pro, right?
I'm pleased that the Pro's base memory starts at 16 GB, but surprised they top out at 32 GB: > ...the new MacBook Pro starts with 16GB of faster unified memory with support for up to 32GB, along with 120GB/s of memory bandwidth... I haven't been an Apple user since 2012 when I graduated from college and retired my first computer, a mid-2007 Core2 Duo Macbook Pro, which I'd upgraded with a 2.5" SSD and 6GB of RAM with…
It seems they also update the base memory on MacBook Air: > MacBook Air: The World’s Most Popular Laptop Now Starts at 16GB > MacBook Air is the world’s most popular laptop, and with Apple Intelligence, it’s even better. Now, models with M2 and M3 double the starting memory to 16GB, while keeping the starting price at just $999 — a terrific value for the world’s best-selling laptop.
Every M-series device now comes with at least 16GB, except for the base iPad Pro, right?