I run a lot of local models (I am always experimenting) on my 32G M2-Pro MacMini - I would love to upgrade. The financial aspects don’t work however: I can learn and experiment with what I have for local models, and I pay as I go on FireWorks.ai for open model inferencing and no matter how much I use this service my monthly bill is between $10 and $40 and much faster than any reasonable home rig. Hybrid ‘small local’…
Honest question - why are you so stuck on Macs for local inference? A 4 GPU linux box with 3090s, which are $1500 a piece right now, will blow this thing out of the water. Even 2x3090 rig will run most of the good local models like Gemma4:31b at 100+ tok/sec The VRAM of the GPUs are MUCH faster than the unified ram within Apple Silicon. The only difference is the initial model load, which takes longer from disk to VR…
Apple introduces M6 and M5 Ultra
471–480 of 1001 posts
Re: Apple introduces M6 and M5 Ultra
#472Earlier quoted context omitted.
To be fair, the Zune actually was a better media player than the ipod in almost every way. That wasn't a false statement. The issue was the abysmal marketing and "me too" attitude Microsoft had (and still has).
I recall reading this story of some user doing a sync with Zune on their new computer. The computer had no songs on it and the Zune synced with that machine and wiped all the existing music off his Zune without warning him(or something like that its been years). I recall thinking, yep thats Microsoft. And to this day I still encounter dumb ways of thinking in many of their products. The endless negative stories I hea…
Then I got a iPod so I needed to download iTunes. I downloaded iTunes, it told me to import my music. I imported my meticulously organised collection. It duplicated every single file into the iTunes approved format (AAC?) - my meticulous collection was now less meticulous, messy even.
It caused me to swear off Apple products for decades. Though it also led me to some very basic programming in order to delete the duplicates. I was only partially successful.
Programming led me to use Linux, before I eventually moved over to Mac. I like to think this was their plan all along.
Re: Apple introduces M6 and M5 Ultra
#473Re: Apple introduces M6 and M5 Ultra
#474Earlier quoted context omitted.
Considering hard drives were $10k / GB in the Mac SE/30 days, that feels like a bargain too.
Sure, yes, compared to the prices of storage 35 years ago, it's a bargain. Compared to the prices of storage today, when people are presumably buying the product, it's actually a bad price.
Re: Apple introduces M6 and M5 Ultra
#475Re: Apple introduces M6 and M5 Ultra
#476Even w/the pricing spike, inflation adjusted we are back to roughly the prices of a new Mac SE/30 for something that can beat a turing test w/o sweating. I yield the floor to no one when it comes to pessimism, but that's incredible.
Re: Apple introduces M6 and M5 Ultra
#477I run a lot of local models (I am always experimenting) on my 32G M2-Pro MacMini - I would love to upgrade. The financial aspects don’t work however: I can learn and experiment with what I have for local models, and I pay as I go on FireWorks.ai for open model inferencing and no matter how much I use this service my monthly bill is between $10 and $40 and much faster than any reasonable home rig. Hybrid ‘small local’…
Honest question - why are you so stuck on Macs for local inference? A 4 GPU linux box with 3090s, which are $1500 a piece right now, will blow this thing out of the water. Even 2x3090 rig will run most of the good local models like Gemma4:31b at 100+ tok/sec The VRAM of the GPUs are MUCH faster than the unified ram within Apple Silicon. The only difference is the initial model load, which takes longer from disk to VR…
Re: Apple introduces M6 and M5 Ultra
#478>fluid frame rates in demanding games like Mixtape. not getting on that bandwagon but wasn't that not the most demanding game as its a just a nonstop cutscene.
Re: Apple introduces M6 and M5 Ultra
#479I know, this is a bit of a meaningless comment, but it's funny in a way. Feels like late 90s again: - Xiaomi: We have matched Apple in CPU performance. - Apple: *Meep Meep...*
Reading Infinite Games, they tell an anecdote about a Microsoft exec on a flight telling an Apple exec that the Zune was a way better portable music player than the iPod. The Apple exec was just “yup, you’re probably right” and then soon after the iPhone dropped
Re: Apple introduces M6 and M5 Ultra
#480"M6 features a powerful, larger 12-core GPU that provides higher geometry rates and updated Dynamic Caching to deliver stunning visuals and fluid frame rates in demanding games like Mixtape." Why choose the worst game of the year? Just because it's made by the daughter of Larry Ellison?
I've never heard of Mixtape, but I'm surprised to see such a weirdly contemptuous post about a video game get so much traction on HN. At a glance, critical review aggregators are showing 80+ on this game. Is there some drama or culture war issue here that I'm missing?