Live data from Hacker News

1.5 TB of VRAM on Mac Studio – RDMA over Thunderbolt 5

jeffgeerling.com

171–180 of 236 posts

Re: 1.5 TB of VRAM on Mac Studio – RDMA over Thunderbolt 5

#171
There have a been a couple videos/posts about this from other influencers today

Does anyone remember a guy here posting about linking Mac Studios with Thunderbolt for HPC/clustering? I wasn't able to find it with a quick search.

Edit: I think it was this?

https://www.youtube.com/watch?v=d8yS-2OyJhw

Re: 1.5 TB of VRAM on Mac Studio – RDMA over Thunderbolt 5

#172

Earlier quoted context omitted.

what do you think "ethernet's overhead" is?

Header and FCS, interpacket gap, and preamble. What do you think "Ethernet overhead" is?

I've meant in usec, sorry if that wasn't clear, given that the discussion that I've replied was about rpc latency.

Re: 1.5 TB of VRAM on Mac Studio – RDMA over Thunderbolt 5

#173
post #166
post #159

Earlier quoted context omitted.

AI bubble will do wonders for used RAM prices when it pops.

There is no popping. We cannot have enough compute for the forseeable future.

Look at this guy on his first ram shortage.

Re: 1.5 TB of VRAM on Mac Studio – RDMA over Thunderbolt 5

#174

Earlier quoted context omitted.

> - The ability to overclock the system? I know it probably will never happen, but my expectation of Mac Studio is not the same as a laptop, and I'm TOTALLY okay with it consuming +600W energy. Currently it's capped at ~250W. I don't think the Mac Studio has a thermal design capable of dissipating 650W of heat for anything other than bursty workloads. Need to look at the Mac Pro design for that.

The thermal design is irrelevant, and people saying they want insane power density are, in my personal view, deluded ridiculous individuals who understand very very little. Overclocking long ago was an amazing saintly act, milking a lot of extra performance that was just there waiting, without major downsides to take. But these days, chips are usually already well tuned. You can feed double or tripple the power into…

It's been funny to see people move from overclocking to underclocking. Especially for the older AMD gpus. On the RX480 a slight underclock would cut the power usage almost in half!

Re: 1.5 TB of VRAM on Mac Studio – RDMA over Thunderbolt 5

#176
post #135

Earlier quoted context omitted.

Macs survived because Apple got a cash injection, survived long enough to come out with colorful iMacs with an hockey puck mouse, still running on Mac OS 8, and the iPod. Requiring one for doing iOS development they were already back into the green.

It’s a myth that the “cash injection” from Microsoft saved Apple. Microsoft gave Apple $250 million. The next quarter Apple turned around and spent $100 million on PowerComputing’s Mac assets. Apple lost over a billion more before it became profitable. The $150 Net wouldn’t have been make or break. Now Microsoft promising to keep Office on the Mac was a big deal

One way or the other, it was a cash injection from Microsoft, after all who paid the salaries from Office developers?

Also you're forgetting the part that those announcements gave Apple a good marketing for additional credit from banks.

Re: 1.5 TB of VRAM on Mac Studio – RDMA over Thunderbolt 5

#177
post #176

Earlier quoted context omitted.

It’s a myth that the “cash injection” from Microsoft saved Apple. Microsoft gave Apple $250 million. The next quarter Apple turned around and spent $100 million on PowerComputing’s Mac assets. Apple lost over a billion more before it became profitable. The $150 Net wouldn’t have been make or break. Now Microsoft promising to keep Office on the Mac was a big deal

One way or the other, it was a cash injection from Microsoft, after all who paid the salaries from Office developers? Also you're forgetting the part that those announcements gave Apple a good marketing for additional credit from banks.

Microsoft had been writing the components of the Office Apps since 1985. Word and Excel were first developed on the Mac and PowerPoint was an original Mac App acquired by Microsoft.

At one point, Microsoft was making more money on each Mac sold than Apple. Microsoft wasn’t doing it for charity. If it were, why did it do it before the agreement and continue to support Mac today?

Apple got credit from banks before either the announcement or Steve Jobs return.

Re: 1.5 TB of VRAM on Mac Studio – RDMA over Thunderbolt 5

#179

Earlier quoted context omitted.

The thermal design is irrelevant, and people saying they want insane power density are, in my personal view, deluded ridiculous individuals who understand very very little. Overclocking long ago was an amazing saintly act, milking a lot of extra performance that was just there waiting, without major downsides to take. But these days, chips are usually already well tuned. You can feed double or tripple the power into…

>> people saying they want insane power density are, in my personal view, deluded ridiculous individuals who understand very very little. Or they are simply not-rich people who cannot afford to purchase extra hardware to run in parallel. Electricity is cheap. GPUs are not. So i want to get every ounce of power out of the precious few GPUs i can afford to own. (And dont point at clouds. Running AI on someone else's cl…

> Electricity is cheap.

American :)

Re: 1.5 TB of VRAM on Mac Studio – RDMA over Thunderbolt 5

#180
post #165

Earlier quoted context omitted.

> Overclocking long ago was an amazing saintly act, milking a lot of extra performance that was just there waiting, without major downsides to take. Back when you bought a 233 Mhz chip with ram at 66 Mhz, ran the bus at 100 Mhz which also increased your ram speed if it could handle it, and everything was faster. > But these days, chips are usually already well tuned. You can feed double or tripple the power into the…

Initially, thermal throttling was a safety valve for a failure condition. A way to cripple performance briefly so as not to let the magic blue smoke out. Only a terrible PC would be thermal throttling out of the box; Only neglectful owners who failed to clean filters, had thermal throttling happening routinely. That's not how it works any more. Many of these CPUs both at the high end and even a few tiers down from th…

I've set the cpu in my desktop to throttle at 65 C in the bios :)

Too lazy to figure out which cryptic setting is exact watts.

One of these days I'll configure the video card too.

Post reply on HN