M4 MacBook Pro • Hacker News Board

Re: M4 MacBook Pro

#71

Post by wslh » Wed, Oct 30, 2024, 3:23 PM UTC

I really like these new devices, but I’ve found that the latest MacBook Air (M3) is sufficient for my needs as a manager and casual developer. My MacBook Pro M1 Max has essentially become a desktop due to its support for multiple monitors, but since the Mac Mini M4 Pro can also support up to three external displays, I’m considering selling the MacBook Pro and switching to the Mini. I’ve also noticed that the MacBook Pro’s battery, as a portable device, is less efficient in terms of performance/battery (for my usage) compared to the MacBook Air.

Regarding LLMs, the hottest topic here nowadays, I plan to either use the cloud or return to a bare-metal PC.

Re: M4 MacBook Pro

#72

Post by [deleted] » Wed, Oct 30, 2024, 3:23 PM UTC

LeifCarrotson wrote: post #55

I'm pleased that the Pro's base memory starts at 16 GB, but surprised they top out at 32 GB: > ...the new MacBook Pro starts with 16GB of faster unified memory with support for up to 32GB, along with 120GB/s of memory bandwidth... I haven't been an Apple user since 2012 when I graduated from college and retired my first computer, a mid-2007 Core2 Duo Macbook Pro, which I'd upgraded with a 2.5" SSD and 6GB of RAM with…

[deleted]

Re: M4 MacBook Pro

#73

Post by doctoboggan » Wed, Oct 30, 2024, 3:23 PM UTC

Does anyone know of any good deals on the older models of apple laptops? Now is usually a great time to purchase (a still very capable) older model.

Re: M4 MacBook Pro

#74

Post by commandersaki » Wed, Oct 30, 2024, 3:23 PM UTC

Hm, the M3 MacBook Pro had a 96GB of ram model (which is what I have). I wonder why it's not an option with the M4.

Re: M4 MacBook Pro

#75

Post by redundantly » Wed, Oct 30, 2024, 3:23 PM UTC

LeifCarrotson wrote: post #55

I'm pleased that the Pro's base memory starts at 16 GB, but surprised they top out at 32 GB: > ...the new MacBook Pro starts with 16GB of faster unified memory with support for up to 32GB, along with 120GB/s of memory bandwidth... I haven't been an Apple user since 2012 when I graduated from college and retired my first computer, a mid-2007 Core2 Duo Macbook Pro, which I'd upgraded with a 2.5" SSD and 6GB of RAM with…

The M4 tops off at 32 GB

The M4 Pro goes up to 48 GB

The M4 Max can have up to 128 GB

Re: M4 MacBook Pro

#76

Post by BenFranklin100 » Wed, Oct 30, 2024, 3:24 PM UTC

tomrod wrote: post #19

This is the first compelling Mac to me. I've used Macs for a few clients and muscle memory is very deeply ingrained for linux desktops. But with local LLMs finally on the verge of usability along with sufficient memory... I might need to make the jump! Wish I could spin up a Linux OS on the hardware though. Not a bright spot for me.

Off topic, but I’m very interested in local LLMs. Could you point me in the right direction, both hardware specs and models?

Re: M4 MacBook Pro

#77

Post by abhinavk » Wed, Oct 30, 2024, 3:24 PM UTC

opjjf wrote: post #5

It seems they also update the base memory on MacBook Air: > MacBook Air: The World’s Most Popular Laptop Now Starts at 16GB > MacBook Air is the world’s most popular laptop, and with Apple Intelligence, it’s even better. Now, models with M2 and M3 double the starting memory to 16GB, while keeping the starting price at just $999 — a terrific value for the world’s best-selling laptop.

> while keeping the starting price at just $999 — a terrific value for the world’s best-selling laptop

Only in US it seems. India got a price increase by $120.

Re: M4 MacBook Pro

#78

Post by ithkuil » Wed, Oct 30, 2024, 3:24 PM UTC

sgt101 wrote: post #57

garciasn wrote: post #28

Earlier quoted context omitted.

We run our LLM workloads on a M2 Ultra because of this. 2x the VRAM; one-time cost at $5350 was the same as, at the time, 1 month of 80GB VRAM GPU in GCP. Works well for us.

You have another one with a network gateway to provide hot failover? Right?

High availability story for AI workloads will be a problem for another decade. From what I can see the current pressing problem is to get stuff working quickly and iterate quickly.

Re: M4 MacBook Pro

#79

Post by fckgw » Wed, Oct 30, 2024, 3:24 PM UTC

LeifCarrotson wrote: post #55

I'm pleased that the Pro's base memory starts at 16 GB, but surprised they top out at 32 GB: > ...the new MacBook Pro starts with 16GB of faster unified memory with support for up to 32GB, along with 120GB/s of memory bandwidth... I haven't been an Apple user since 2012 when I graduated from college and retired my first computer, a mid-2007 Core2 Duo Macbook Pro, which I'd upgraded with a 2.5" SSD and 6GB of RAM with…

On the standard M4 processor. If you move the M4 Pro it tops out at 48gb or moving to the M4 Max goes up to 128gb.

Re: M4 MacBook Pro

#80

Post by jsheard » Wed, Oct 30, 2024, 3:24 PM UTC

manaskarekar wrote: post #17

BrentOzar wrote: post #9

The M4 Max goes up to 128GB RAM, and "over half a terabyte per second of unified memory bandwidth" - LLM users rejoice.

The M3 Max was 400GBps, this is 540GBps. Truly an outstanding case for unified memory. DDR5 doesn't come anywhere near.

It's not the memory being unified that makes it fast, it's the combination of the memory bus being extremely wide and the memory being extremely close to the processor. It's the same principle that discrete GPUs or server CPUs with onboard HBM memory use to make their non-unified memory go ultra fast.