Earlier quoted context omitted.
153 GB/s is not bad at all for a base model; the Nvidia DGX Spark has only 273 GB/s memory bandwidth despite being billed as a desktop "AI supercomputer". Models like Qwen 3 30B-A3B and GPT-OSS 20B, both quite decent, should be able to run at 30+ tokens/sec at typical (4-bit) quantizations.
Even at 1.8x the base memory bandwidth and 4x the memory capacity Nvidia spent a lot of time talking about how you can pair two DGXs together with the 200G NIC to be able to slowly run quantized versions of the models everyone was actually interested in. Neither product actually qualifies for the task IMO, and that doesn't change just because two companies advertised them as such instead of just one. The absolute hig…
Apple M5 chip
241–250 of 1001 posts
Re: Apple M5 chip
#242It’s unfortunate that this announcement is still unspecific about what they improved in the Neural Engine. Since all we know about the Neural Engine comes from Apple papers or reverse engineering efforts ( https://github.com/hollance/neural-engine ), it’s plausible that they addressed some quirks to enable better transformer performance. They have written quite interesting papers on transformers on the Neural Engine:…
> the main thing limiting Apple Intelligence (in my opinion) will continue to be the 8 GB of unified memory they still insist on. As you said - it won’t help previous generations, though since last year (or two??) all macs start with 16GB of memory. Even entry level macbook airs.
Re: Apple M5 chip
#243The M5 MacBook Pro still gets the Broadcom WiFi chip but the M5 iPad Pros get the N1 and C1X (Sweet). All in all, apple is doing some incredible things with hardware. Software teams at apple really need to get their act together. The M1 itself is so powerful that nobody really needs to upgrade that for most things most people do on their computers. Tahoe however makes my M1 Air feel sluggish doing the exact same task…
> Tahoe however makes my M1 Air feel sluggish doing the exact same tasks ive been last couple of years. I have a work provided M2 Pro with 32GB of RAM. After the Tahoe upgrade it feels like one of the sluggish PCs at the house. It is the only one that I can see the mouse teleporting sometimes when I move it fast. This is after disabling transparency in Accessibility settings mind you, it was even worse before.
Re: Apple M5 chip
#244The M5 MacBook Pro still gets the Broadcom WiFi chip but the M5 iPad Pros get the N1 and C1X (Sweet). All in all, apple is doing some incredible things with hardware. Software teams at apple really need to get their act together. The M1 itself is so powerful that nobody really needs to upgrade that for most things most people do on their computers. Tahoe however makes my M1 Air feel sluggish doing the exact same task…
As a UI/UX nerd, it’s a coin flip on intentionality. I’ve been noticing so many rough edges to Apple’s software when it used to astound. iOS Settings search will flash “No Results” as you begin to type which is comically amateurish. The macOS menu bar control panels can’t be keyboard navigated... It’s just silly. I’ve been debating making a Tumblr-style blog, something like “dumbapple.com,” to catalogue all the dumb…
Re: Apple M5 chip
#245The M5 MacBook Pro still gets the Broadcom WiFi chip but the M5 iPad Pros get the N1 and C1X (Sweet). All in all, apple is doing some incredible things with hardware. Software teams at apple really need to get their act together. The M1 itself is so powerful that nobody really needs to upgrade that for most things most people do on their computers. Tahoe however makes my M1 Air feel sluggish doing the exact same task…
> Tahoe however makes my M1 Air feel sluggish doing the exact same tasks ive been last couple of years. I have a work provided M2 Pro with 32GB of RAM. After the Tahoe upgrade it feels like one of the sluggish PCs at the house. It is the only one that I can see the mouse teleporting sometimes when I move it fast. This is after disabling transparency in Accessibility settings mind you, it was even worse before.
Electron used to override a private function that makes the Mac OS sluggish on Tahoe, and apparently no one uses Electron apps while doing testing at Apple.
Re: Apple M5 chip
#246Re: Apple M5 chip
#247First time seeing Apple using "AI" in their marketing material. It was "Machine Learning" and "Apple Intelligence" before...
Re: Apple M5 chip
#248Earlier quoted context omitted.
As a UI/UX nerd, it’s a coin flip on intentionality. I’ve been noticing so many rough edges to Apple’s software when it used to astound. iOS Settings search will flash “No Results” as you begin to type which is comically amateurish. The macOS menu bar control panels can’t be keyboard navigated... It’s just silly. I’ve been debating making a Tumblr-style blog, something like “dumbapple.com,” to catalogue all the dumb…
iirc, there's a setting to make the menu bar navigatable. you just need to "alt+tab" to it with some weird button combo, like Ctrl + Cmd + 1 or something.
But, like, man - why can't I just use the arrow keys to select my WiFi network anymore? I was able to for a decade.
And the answer, of course, is the same for so much of macOS' present rough edges. Apple took some iPadOS interface elements, rammed them into the macOS UI, and still have yet to sand the welds. For how much we complain on HN about Electron, we really need to be pissed about Catalyst/Marzipan.
Why does the iCloud sign in field have me type on the right side of an input? Why does that field have an iPadOS cursor? Why can't I use Esc to close its help sheet? Why aren't that sheet's buttons focusable?
Why does the Stocks app have a Done button appear when I focus its search field? Why does its focus ring lag behind the search field's animated size?
Where in the HIG does it sign off on unfocusable text-only bolded buttons, like Maps uses? https://imgur.com/a/e7PB5jm
...Anyway.
Re: Apple M5 chip
#249Earlier quoted context omitted.
Sixteen years ago, John Gruber wrote: > Hardware and software both matter, and Apple’s history shows that there’s a good argument to be made for developing integrated hardware and software. But if you asked me which matters more, I wouldn’t hesitate to say software. All things considered I’d much prefer a PC running Mac OS X to a Mac running Windows. https://daringfireball.net/2009/11/the_os_opportunity At the time I…
I bet most people around here would prefer fully supported linux over mac os on their apple silicon.
Re: Apple M5 chip
#250Earlier quoted context omitted.
> Tahoe however makes my M1 Air feel sluggish doing the exact same tasks ive been last couple of years. I have a work provided M2 Pro with 32GB of RAM. After the Tahoe upgrade it feels like one of the sluggish PCs at the house. It is the only one that I can see the mouse teleporting sometimes when I move it fast. This is after disabling transparency in Accessibility settings mind you, it was even worse before.
26.0.1 fixed the sluggishness. 26.0 was pretty unstable - felt like a game dropping frames.
I just got one example while passing the mouse quickly through my dock (I still use the magnify animation) and I can clearly see it dropping a few frames. This never happened in macOS 15.