M5 Pro in a Mac Mini with 64GB RAM and 10Gbit Ethernet seems like the perfect Jellyfin server and Ollama test server. All for just over $3K (I specced with only 1TB local nvme).
Apple introduces M6 and M5 Ultra
81–90 of 1001 posts
Re: Apple introduces M6 and M5 Ultra
#82Cannot believe "moar transistors" is still the only idea they have.
They pionneered unified memory a few years ago.
Re: Apple introduces M6 and M5 Ultra
#83The page says 170G/s memory bandwidth for the NPU and 1.2T/s for the GPU. Why the discrepancy if it's all "unified memory"? The former is nothing to write home about as far as AI compute is. The latter is really nice.
Which one is it you can run local models on? I suppose the NPU only.
Re: Apple introduces M6 and M5 Ultra
#84M5 Pro in a Mac Mini with 64GB RAM and 10Gbit Ethernet seems like the perfect Jellyfin server and Ollama test server. All for just over $3K (I specced with only 1TB local nvme).
Probably worth it for Ollama but you can run Jellyfin off a raspberry pi.
Re: Apple introduces M6 and M5 Ultra
#85The 512GB Ultra is amazing, sure. But who is it for exactly? VC funded big spender founders? In that case why would they need local AI? The ultra rich enthusiast? But there can't be too many of those. So who actually buys these?
I think there's some mental inertia around what a computer is and what it's worth. This thing can build custom software for you, mostly autonomously. It can monitor things happening on the internet that are relevant to you, in a holistic and flexible way. We have one crawling the web for local events we'll like, and it judges them based on what it knows about us, and it tells us about the best matches every weekend,…
I like this train of thought. The inverse is saying that the cost of this computer is the value we give away to AI companies by doing compute on their servers with our data. And to take it another way, is the value to you, the cost of a small used car?
Re: Apple introduces M6 and M5 Ultra
#86Earlier quoted context omitted.
So is downpayment on a house. I would buy the house and just pay for tokens as needed. The house will get more valuable and that wealth would buy a lot of tokens in the future - which will probably get cheaper. EDIT: or buy AAPL. If I had bought Apple stock instead of buying a Mac LC II in 1992, then I would have about $2 million in Apple stock.
With the way RAM prices are going up, you could expect to make 20% profit on any purchase.
I tripled my money on my RAM purchase of three years ago. So, yes, for short-term appreciation that's hard to beat. But I don't think it's something that will continue.
Re: Apple introduces M6 and M5 Ultra
#87Even w/the pricing spike, inflation adjusted we are back to roughly the prices of a new Mac SE/30 for something that can beat a turing test w/o sweating. I yield the floor to no one when it comes to pessimism, but that's incredible.
when was the turing test beaten?
The EU just had to pass a law to force companies to disclose if a customer service agent is AI or Human. It is beaten.
https://commission.europa.eu/news-and-media/news/safer-and-m...
Re: Apple introduces M6 and M5 Ultra
#88Even w/the pricing spike, inflation adjusted we are back to roughly the prices of a new Mac SE/30 for something that can beat a turing test w/o sweating. I yield the floor to no one when it comes to pessimism, but that's incredible.
The DRAM market is cyclical. I don’t think anyone truly knows when, but it will happen.
Fab capacity is being bought online; there’s just lead time.
Noticeably greater intelligence is being achieved at the same number of parameters (see: Qwen3.8).
I think the future will be bright, it might be a matter of time. And for tinkers, a used Epyc + DDR4 server can be great fun and epic value.
Re: Apple introduces M6 and M5 Ultra
#89Even w/the pricing spike, inflation adjusted we are back to roughly the prices of a new Mac SE/30 for something that can beat a turing test w/o sweating. I yield the floor to no one when it comes to pessimism, but that's incredible.
when was the turing test beaten?
According to Psychology today, April this year by GPT 4.5
https://www.psychologytoday.com/ca/blog/the-digital-self/202...
Re: Apple introduces M6 and M5 Ultra
#90Earlier quoted context omitted.
when was the turing test beaten?
I think it was determined that the Turing test is too easy because humans are too easily fooled.
Yes, which is exactly and entirely the point of the whole paper. Somehow missed still -- despite how important AI has become, shockingly few people actually read the short, layperson-accessible paper that started the whole field.
I kinda have to link it now, so uhh here's a random PDF: https://www.hec.edu/sites/default/files/documents/Computing%...