731–740 of 1001 posts
Earlier quoted context omitted.
Can you characterize the deterioration more specifically? I only ask because every time I run this exercise for myself I end up back on macOS, despite any hiccups.
Not OP, but I have been using an M1 pro Mac Book since release. It's not sluggish in any way whatsoever.
So the idea of networking multiple Mac Minis via RDMA over Thunderbolt 5 to run local LLMs is intriguing, but doesn't really seem reasonable at this price point? What are the more cost-effective alternatives?
Earlier quoted context omitted.
The M6 doubled the neural engine from 16 to 32 cores. I would expect that the M7 doubles that again to 64 from 32? That would make sense. I believe that the CPUs are actually limited by ram bandwidth more than the neural engine right when it comes to LLM processing? Maybe the M7 introduces something new to get around the current ram bandwidth problems on the non-Ultra chips.
Apple's biggest bottleneck for real-world inference is prefill processing. They need a better GPGPU architecture, which is what I'm expecting M7 to reveal.
Apple's biggest bottleneck for real-world inference is prefill processing.
I was blown away by M1 Pro, and used it for 4 years before it became a little sluggish, and replacing it with an Asus S16 running on Ryzen AI 9 HX 370 (an excellent laptop). One of the main reasons was missing my old Linux setup. I've briefly tested M5 Pro in an Apple store and was surprised by how quick it felt and did anything. A tangible and significant difference, and I really feel it would be good getting it, or…
Same, but it's Windows that's been deteriorating fast for me. Linux has it's warts, but it's FAR better than the current commercial offerings.
Earlier quoted context omitted.
There is a youtube channel 'Dank Pods', he was going on about his Framework laptop and was talking about how modern OS's have this ark to their usability. He was arguing that Windows is well past its best years and that OSX is now starting on the downward slope and that is why he was moving to Linux. It was a interesting take on the whole thing about the life times of OS quality. But with a new CEO for Apple, they ha…
Linux has been going down hill, but since you can choose distributions, there is an escape hatch. I’ve been moving all my machines to devuan with xfce (or freebsd with xfce). I have zero issues despite not having to deal with wayland, systemd, snap, etc.
I have stuck with distros that are not trying to chase the latest trends but keep a ethical high ground.
Earlier quoted context omitted.
Can you characterize the deterioration more specifically? I only ask because every time I run this exercise for myself I end up back on macOS, despite any hiccups.
An example of deterioration: Jeff Goldblum's 30 second "Presenting three easy steps to the internet" https://www.youtube.com/watch?v=rjY0xsoozs8 And now when you want to set up a fresh Mac it's a parade of dialogue boxes: Do you want to turn on Siri? No. (the dialogue-choice is probably "maybe later" ugh) Do you want to share app analytics with developers? Yes. Do you want to add Touch ID? No, because I'm setting thi…
Does anyone know if they’re actually at 2nm transistors, or if this is more marketing talk? It’s kinda like when TVs advertised their contrast ratios (do they still do that?) but they all used their own measurement methods, so dynamic contrast ratio became a worthless metric. Do you think that little moniker will just disappear in a decade or so as we reach 0nm advertisements, or do you think they'll just add more de…
It's all marketing talk, sort of. Our transistors are about 30 nm give or take. But we've found new ways of aligning them so that if we had continued using old techniques, the density we get would be "2nm". https://en.wikipedia.org/wiki/2_nm_process
"Our Quarter Pounder may weigh only 1/8 oz, but we figured out how to pack double the flavor in each mouthful, so we're still selling it as a Quarter Pounder."
Earlier quoted context omitted.
Still rocking an M1 Air - 2020 build. 8GB ram. No slowdown or deterioration at all. Battery health reports the battery max capacity at 84%. Best computer I've ever owned, by far.
M1 Pro 2021 16GB RAM Feels as snappy and impressive as the first day I got it. I never need to close apps, or reboot. I record multitrack audio on it without any perceptible latency. I write code on it. It's the best computer I've ever owned by a significant margin.
The battery indicator is starting to show a decrease in performance. It won’t hold a full charge, but even when I’m without a direct power connection, I can still have it running for nearly 4 hours with Wi-Fi, 6+ without.
Rumors say that Apple will only release M6 base variant and skips M6 Pro, M6 Max and M6 Ultra variants to concentrate all efforts to create a good AI capable M7: "According to reports from Bloomberg, Apple will be skipping its M6 Pro, M6 Max, and M6 Ultra chips to accelerate development of the M7 chip. That means the only chip to be released from the M6 family will be the base M6. The reason for this break with tradi…
So could the M7 actually include an AFM 3B model, alongside a generic neural engine?
Earlier quoted context omitted.
Still rocking an M1 Air - 2020 build. 8GB ram. No slowdown or deterioration at all. Battery health reports the battery max capacity at 84%. Best computer I've ever owned, by far.
Also M1 Air 8gb, though not the daily driver. Bought second hand, the machine is still an absolute champ with no slowdown and is my go to machine when I want a calm space for writing.