Live data from Hacker News

1.5 TB of VRAM on Mac Studio – RDMA over Thunderbolt 5

jeffgeerling.com

181–190 of 236 posts

Re: 1.5 TB of VRAM on Mac Studio – RDMA over Thunderbolt 5

#181

The next Mac studio is going to be a top seller. I don’t think people want to drop $10k on a few M3s, but I think they will do it for the M6. Just hoping the DRAM shortage doesn’t ruin this plan.

Apple always charges a huge premium for RAM. Maybe it’s enough to buffer their pricing scheme from the supply shock. I have run the numbers though.

Re: 1.5 TB of VRAM on Mac Studio – RDMA over Thunderbolt 5

#182
post #18

I wonder what motivates apple to release features like RDMA which are purely useful for server clusters, while ignoring basic qol stuff like remote management or rack mount hardware. It’s difficult to see it as a cohesive strategy. Makes one wonder what apple uses for their own servers. I guess maybe they have some internal M-series server product they just haven’t bothered to release to the public, and features like…

Blog posts like this one are great marketing.

Re: 1.5 TB of VRAM on Mac Studio – RDMA over Thunderbolt 5

#183
post #176

Earlier quoted context omitted.

One way or the other, it was a cash injection from Microsoft, after all who paid the salaries from Office developers? Also you're forgetting the part that those announcements gave Apple a good marketing for additional credit from banks.

Microsoft had been writing the components of the Office Apps since 1985. Word and Excel were first developed on the Mac and PowerPoint was an original Mac App acquired by Microsoft. At one point, Microsoft was making more money on each Mac sold than Apple. Microsoft wasn’t doing it for charity. If it were, why did it do it before the agreement and continue to support Mac today? Apple got credit from banks before eith…

As someone living in a country, Portugal, where Apple had a single reseller, Interlog.

I could count with my hand fingers how many Macs I have seen being used between being born in the 70's and 2000's, up to 10.

My university graduation project was porting a visualisation framework from NeXTSTEP into Windows, because already there the university could not see a future with NeXT.

The fact that people believe Apple's cash injection, not only from Microsoft, that allowed for a survival plan, including an acquisition, has nothing to with Apple escaping bankruptcy is kind of interesting.

And yes Excel was initially developed for Mac, and once upon a time there was Visual Studio for Mac with MFC.

Still, it was Microsoft paying developers to build such products for a dying platform.

Re: 1.5 TB of VRAM on Mac Studio – RDMA over Thunderbolt 5

#185
post #133

Earlier quoted context omitted.

Yea, I don't understand why people use LLMs for "facts". You can get them from Wikipedia or a book. Use them for something creative, write a short story on spec, generate images. Or the best option: give it tools and let it actually DO something like "read my message history with my wife, find top 5 gift ideas she might have hinted at and search for options to purchase them" - perfect for a local model, there's no wa…

> Yea, I don't understand why people use LLMs for "facts". You can get them from Wikipedia or a book. Because web search is so broken these days, if you want a clean answer instead of wading through pages of SEO nonsense. It's really common (even) amongst non-techy friends that "I'll ask ChatGPT" has replaced "I'll Google it".

Kagi or DDG

Google is useless

Re: 1.5 TB of VRAM on Mac Studio – RDMA over Thunderbolt 5

#186
post #181

The next Mac studio is going to be a top seller. I don’t think people want to drop $10k on a few M3s, but I think they will do it for the M6. Just hoping the DRAM shortage doesn’t ruin this plan.

Apple always charges a huge premium for RAM. Maybe it’s enough to buffer their pricing scheme from the supply shock. I have run the numbers though.

Tim Cook is famous for locking in their prices years in advance.

Re: 1.5 TB of VRAM on Mac Studio – RDMA over Thunderbolt 5

#187
post #183

Earlier quoted context omitted.

Microsoft had been writing the components of the Office Apps since 1985. Word and Excel were first developed on the Mac and PowerPoint was an original Mac App acquired by Microsoft. At one point, Microsoft was making more money on each Mac sold than Apple. Microsoft wasn’t doing it for charity. If it were, why did it do it before the agreement and continue to support Mac today? Apple got credit from banks before eith…

As someone living in a country, Portugal, where Apple had a single reseller, Interlog. I could count with my hand fingers how many Macs I have seen being used between being born in the 70's and 2000's, up to 10. My university graduation project was porting a visualisation framework from NeXTSTEP into Windows, because already there the university could not see a future with NeXT. The fact that people believe Apple's c…

At no point was Microsoft spending more on Office for Mac than they were making on selling the Mac version.

It cost some. But famously Microsoft used byte code for Office that was portable and was dog slow around Office 5.

And it’s not my “believing”, it’s math. Apple lost far more than the net $150 million before it became popular.

This isn’t my reading the history books. My first computer was an Apple //e in 1986 and by 1993, I was following what was going on with Apple real time via Usenet and TidBits (been around since 1990) and I lied to get a free subscription to MacWeek.

Re: 1.5 TB of VRAM on Mac Studio – RDMA over Thunderbolt 5

#188
post #159

Earlier quoted context omitted.

Would you please mind leaving some RAM to remain available for purchase at an affordable price for us mere mortals ? 1Tb for what, like, "Come on AI, make the humankind happy now"? /"s"

AI bubble will do wonders for used RAM prices when it pops.

I'm going to play Minecraft with such a ludicrous shader...

Re: 1.5 TB of VRAM on Mac Studio – RDMA over Thunderbolt 5

#189
post #166

Earlier quoted context omitted.

There is no popping. We cannot have enough compute for the forseeable future.

Look at this guy on his first ram shortage.

I've been in this game so long, seen so many shortages that I'm not even worried. Right now prices are high, manufacturers are switching production, and in 6 months there's going to be a glut of supply.

It's all a long game, folks. Play it long.

Re: 1.5 TB of VRAM on Mac Studio – RDMA over Thunderbolt 5

#190
post #128

Linux already has RDMA support but it cannot yet use Thunderbolt. It's probably quite a bit of work to add everything that's required. Is anyone working on it? It would be great to have this for those cheap Strix Halo boxes with 128GB quad channel DDR5-8000 for using two or three of them with their 2 USB4 ports (which are Thunderbolt capable) to fit larger models.

> Linux already has RDMA support but it cannot yet use Thunderbolt.

Is TB still encumbered by licensing requirements causing this lack of use?

Post reply on HN