Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Apple introduces M6 and M5 Ultra

apple.com

Post reply on HN
Print view View original

861–870 of 1001 posts

Re: Apple introduces M6 and M5 Ultra

#861

Post by raizer88 »

givinguflac wrote: post #31
nasaeclipse wrote: post #3

Earlier quoted context omitted.

As someone who works in AI now, I have found it pretty amazing that Apple basically didn't do much with AI software, and focused more on the hardware side. I think this is what the future of AI is going to look like, local models run on your mac for your workflow. It's possible that they're working on their own LLM that's going to work very well on their chips, and possibly outperform anything out there when they do…

|It's possible that they're working on their own LLM Yep, Siri AI; they’re doing it in public.

Didn't they fire half of siri team yesterday?

Re: Apple introduces M6 and M5 Ultra

#862

Post by asimovDev »

manmal wrote: post #414
siavosh wrote: post #399

What's everyones recommendation for one to run a good local LLM model on?

1-2 RTX5090 will be better value than Macs because they have the memory bandwidth for somewhat fast local inference.

and they will become obsolete much slower if at all compared to when the mac will be barely usable once macos stop supporting it in 8 years or so. although maybe by that time there will be local models that you could run straight on the same mac that will reverse engineer it for you and write linux drivers

Re: Apple introduces M6 and M5 Ultra

#863

Post by flux3125 »

alluro2 wrote: post #524

I was blown away by M1 Pro, and used it for 4 years before it became a little sluggish, and replacing it with an Asus S16 running on Ryzen AI 9 HX 370 (an excellent laptop). One of the main reasons was missing my old Linux setup. I've briefly tested M5 Pro in an Apple store and was surprised by how quick it felt and did anything. A tangible and significant difference, and I really feel it would be good getting it, or…

> it would be hard for me to give up my Linux setup and all the stuff I love about it, even for such performance...Linux progressed really nicely, while MacOS deteriorated at the same rate, and it's changing the balance and the decision for me.

I can relate. I'm one of the few people at work using linux, most use MacOS or Windows with WSL. Every single time I share my screen and run build commands, people comment on how fast my computer is, then seem surprised when I say I bought it before COVID.

Re: Apple introduces M6 and M5 Ultra

#864

Post by pttrn »

acroback wrote: post #554
alluro2 wrote: post #524

I was blown away by M1 Pro, and used it for 4 years before it became a little sluggish, and replacing it with an Asus S16 running on Ryzen AI 9 HX 370 (an excellent laptop). One of the main reasons was missing my old Linux setup. I've briefly tested M5 Pro in an Apple store and was surprised by how quick it felt and did anything. A tangible and significant difference, and I really feel it would be good getting it, or…

My 16" M1 Pro MacBook with 32 Gigs of RAM is still going strong. Not going to upgrade till this thing dies. I can ride this puppy for the next 10 years. Say what you will about Apple but their hardware is top notch and it is a great value if you can snag some OG hardware in M series.

I thought so too when I bought a beefy iMac Pro in 2017. But then guess what, new CPU architecture and 10 years down the line it's not supported anymore. Yes I can stay on whatever OS was last supported, but the tools also start ditching support slowly. For example, Rust no longer has tier 1 support for x86_64-apple-darwin so it's a matter of time when things will start breaking.

I am quite sure Apple will think of a reason to deprecate my M1 Macbook Pro (which works great BTW!) in a couple of years, at which point I'm switching back to Linux and will not be coming back. I'm tired of accumulating perfectly good hardware in my house which is nerfed by lack of software updates.

Re: Apple introduces M6 and M5 Ultra

#865

Post by noosphr »

conmod278 wrote: post #375
ericd wrote: post #37

Earlier quoted context omitted.

I think there's some mental inertia around what a computer is and what it's worth. This thing can build custom software for you, mostly autonomously. It can monitor things happening on the internet that are relevant to you, in a holistic and flexible way. We have one crawling the web for local events we'll like, and it judges them based on what it knows about us, and it tells us about the best matches every weekend,…

Nvidia is definitely working on a AI Rack machine fully built for on-prem uses for companies.

Why? They are making wheelbarrows of cash providing compute for datacenters at much higher prices.

Re: Apple introduces M6 and M5 Ultra

#866

Post by gyomu »

Folcon wrote: post #860
teiferer wrote: post #791

Earlier quoted context omitted.

> a little sluggish > surprised by how quick it felt Aren't these properties of the (G)UI rather than of the processor? I've been using systems 20 years ago that were super snappy. The same software would still be snappy today obviously. But the software has become bloated to the point that you need to run the latest generation of CPUs such that things are not sluggish. In principle you don't need 32-core GHz CPUs to…

I keep thinking this and maybe I'm missing something, but I'd love to be able to opt for something in this direction, some old school constraints, I feel like we should be able to do something pretty magical these days For example, is there a version of linux that I'm missing? I've not run a desktop linux box in over a decade, any suggestions would be great, or is everyone happily running ubuntu / fedora?

Just run debian + xfce, that’ll feel super snappy on 4GB of RAM, maybe even 2 (but then of course you’re bound by whatever other apps you use)

Re: Apple introduces M6 and M5 Ultra

#867

Post by EPmoL »

Einenlum wrote: post #644
xiphias2 wrote: post #97

Apple still has the best hardware so I moved to it for the last few years, but the closed software ecosystem is terrible for taking advantage of it. I wasn't able to debug network errors (restartin my Mac worked), Metal was missing low level disassembly / debugging tools (there is some hard to use UI), but the worst thing was the inflexible windowing system. Even getting all the window handles on all screens/desktops…

I don't understand how absolutely basic things are not possible on Mac OS. Switching between two windows easily, displaying hidden files in the finder... These things would be way easier to solve than building the next generation hardware.

You can show hidden files in finder. Do: Command + Shift + . (period)

Re: Apple introduces M6 and M5 Ultra

#868

Post by todotask2 »

alluro2 wrote: post #524

I was blown away by M1 Pro, and used it for 4 years before it became a little sluggish, and replacing it with an Asus S16 running on Ryzen AI 9 HX 370 (an excellent laptop). One of the main reasons was missing my old Linux setup. I've briefly tested M5 Pro in an Apple store and was surprised by how quick it felt and did anything. A tangible and significant difference, and I really feel it would be good getting it, or…

Probably, you have not yet optimised with Mole or other tools, that would have re-gain back some performance.

Re: Apple introduces M6 and M5 Ultra

#869

Post by screamingninja »

Folcon wrote: post #860
teiferer wrote: post #791

Earlier quoted context omitted.

> a little sluggish > surprised by how quick it felt Aren't these properties of the (G)UI rather than of the processor? I've been using systems 20 years ago that were super snappy. The same software would still be snappy today obviously. But the software has become bloated to the point that you need to run the latest generation of CPUs such that things are not sluggish. In principle you don't need 32-core GHz CPUs to…

I keep thinking this and maybe I'm missing something, but I'd love to be able to opt for something in this direction, some old school constraints, I feel like we should be able to do something pretty magical these days For example, is there a version of linux that I'm missing? I've not run a desktop linux box in over a decade, any suggestions would be great, or is everyone happily running ubuntu / fedora?

Atomic OS images. I moved away from individual package management once I discovered the alternates. Currently on Bluefin (Fedora-based) - not affiliated with the project but just a happy user.

https://projectbluefin.io/

Re: Apple introduces M6 and M5 Ultra

#870

Post by d3Xt3r »

Folcon wrote: post #860
teiferer wrote: post #791

Earlier quoted context omitted.

> a little sluggish > surprised by how quick it felt Aren't these properties of the (G)UI rather than of the processor? I've been using systems 20 years ago that were super snappy. The same software would still be snappy today obviously. But the software has become bloated to the point that you need to run the latest generation of CPUs such that things are not sluggish. In principle you don't need 32-core GHz CPUs to…

I keep thinking this and maybe I'm missing something, but I'd love to be able to opt for something in this direction, some old school constraints, I feel like we should be able to do something pretty magical these days For example, is there a version of linux that I'm missing? I've not run a desktop linux box in over a decade, any suggestions would be great, or is everyone happily running ubuntu / fedora?

No one uses Ubuntu any more (besides corporations), it's possibly the worst distro of the whole lot due to several bad decisions from Canonical (snap etc). Fedora is a decent alternative, but if you're really after performance, CachyOS is the way to go as they provide highly optimised (PGO/LTC etc) and CPU-family specific kernel, custom scheduler (BORE) and optimised binary packages (catering to x86-64-v3, x86-64-v4 and znver4+ architectures).

PorteuX is also an interesting performance-optimised distro that takes a different approach - which is that of extreme minimalism (aggressive binary stripping, minimal packages) and its "Copy to RAM" feature (basically the OS runs 100% from RAM, so storage I/O bottlenecks are completely eliminated).

I've tested both on a 128GB Strix Halo laptop and haven't found much of a difference in terms of snappiness, but if you have older, more humble machine, I reckon PorteuX would definitely feel more snappy.

Finally in terms of snappiness, the DE you use also makes a huge difference. The PorteuX guys have just put together an interesting benchmark comparing various DEs and Wayland to X11 which is worth checking out: https://www.phoronix.com/news/Wayland-X11-Performance-Porteu...

Post reply on HN