721–730 of 1001 posts
The M4 Max goes up to 128GB RAM, and "over half a terabyte per second of unified memory bandwidth" - LLM users rejoice.
[0] https://au.store.asus.com/proart-p16-h7606wi-me124xs.html
I really respect Apple's privacy focused engineering. They didn't roll out _any_ AI features until they were capable of running them locally, and before doing any cloud-based AI they designed and rolled out Private Cloud Compute. You can argue about whether it's actually bulletproof or not but the fact is, nobody else is even trying, and have lost sight of all privacy-focused features in their rush to ship anything a…
Mac OS calls home every time you execute an application. Apple is well on its way to ensure you can only run things they allow via app store, they would probably already be there if it wasn't for the pesky EU. If you send your computer/phone to Apple for repair you may get back different physical hardware. Those things very much highlight that "your" Apple hardware is not yours and that privacy on Apple hardware does…
The single core performance looks really fast. Chip | Geekbench Score (Process) ---- | ------------------------ M1 | 2,419 (5nm) M2 | 2,658 (5nm) M3 | 3,076 (3nm) M4* | 3,810 (3nm) In my experience, single-core CPU is the best all-around indicator of how "fast" a machine feels. I feel like Apple kind of buried this in their press release. M4 benchmark source: https://browser.geekbench.com/v6/cpu/8171874
I don't know much about modern Geekbench scores, but it that chart seems to show that M1s are still pretty good? It appears that M4 is only about 50% faster. Somehow I would expect more like 100% improvement. Flameproof suit donned. Please correct me because I'm pretty ignorant about modern hardware. My main interest is playing lots of tracks live in Logic Pro.
On the variants: An M1 Max is 10 CPU cores with 8 power and 2 efficiency cores.
M4 Max is 16 cores, 12 + 4. So each power core is 50% faster, but it also has 50% more of them. Add in twice as many efficiency cores, that are also faster for less power, plus more memory bandwidth, and it snowballs together.
One nice pseudo-feature of the M1 is that the thermal design of the current MacBook Pro really hasn't changed since then. It was designed with a few generations of headroom in mind, but that means it's very, very hard to make the fans spin on a 16" M1 Max. You have to utilize all CPU/GPU/NPU cores together to even make them move, while an M3 Max is easier to make (slightly) audible.
Does anyone understand this claim from the press release? > M4 Max supports up to 128GB of fast unified memory and up to 546GB/s of memory bandwidth, which is 4x the bandwidth of the latest AI PC chip. This allows developers to easily interact with large language models that have nearly 200 billion parameters. Having more memory bandwidth is not directly helpful in using larger LLM models. A 200B param model requires…
Edit: Actually you'd want q3 to fit a 200B model into 128GB of RAM. e.g. this one is about 140GB https://huggingface.co/lmstudio-community/DeepSeek-V2.5-GGUF...
I really respect Apple's privacy focused engineering. They didn't roll out _any_ AI features until they were capable of running them locally, and before doing any cloud-based AI they designed and rolled out Private Cloud Compute. You can argue about whether it's actually bulletproof or not but the fact is, nobody else is even trying, and have lost sight of all privacy-focused features in their rush to ship anything a…
> to purchase a machine that feels like it really belongs to me How true is this when they devices are increasingly hostile to user repair and upgrades? MacOS also tightens the screws on what you can run and from where, or at least require more hoop jumping over time.
You can install whatever OS you want on your computer - Asahi Linux is the only one that's done the work to support that.
You can disable the system lockdowns that "tighten the screws" you refer to and unlock most things back to how they used to be.
The single core performance looks really fast. Chip | Geekbench Score (Process) ---- | ------------------------ M1 | 2,419 (5nm) M2 | 2,658 (5nm) M3 | 3,076 (3nm) M4* | 3,810 (3nm) In my experience, single-core CPU is the best all-around indicator of how "fast" a machine feels. I feel like Apple kind of buried this in their press release. M4 benchmark source: https://browser.geekbench.com/v6/cpu/8171874
Mx is such a incredible achievement by apple. Sadly installing Linux is a no unless you use some budu.
Earlier quoted context omitted.
There's some weird[1] laws around privacy in Australia, where government departments are blocked from a bunch of things by law. From my perspective as a citizen, this just results in annoyance such as having to fill out forms over and over to give the government data that they already have. I heard a good definition from my dad: "Privacy for me is pedestrians walking past my window not seeing me step out of the showe…
The most famous leak of nude images that ever "happened" was from iCloud Photos.
If I remember correctly, the claim was that M3 is 1.6x faster than M1. M4 is now 1.8x faster than M1. It sounds more exciting than M4 is 12.5% faster than M3.
Earlier quoted context omitted.
This happens whenever I load up one of our PyTorch models on my M1 MBP 16gb too. I also hate the part where if the model (or any other set of programs) uses too much RAM the whole system will sometimes straight up hang and then crash due to kernel watchdog timeout instead of just killing the offender.
There is an API `proc_setpcontrol` which absolutely noone uses which does the thing you want. It definitely gets unstable in those situations, but you probably don't want your scripts randomly OOM killed either.