Live data from Hacker News

1.5 TB of VRAM on Mac Studio – RDMA over Thunderbolt 5

jeffgeerling.com

191–200 of 236 posts

Re: 1.5 TB of VRAM on Mac Studio – RDMA over Thunderbolt 5

#191

Earlier quoted context omitted.

Header and FCS, interpacket gap, and preamble. What do you think "Ethernet overhead" is?

I've meant in usec, sorry if that wasn't clear, given that the discussion that I've replied was about rpc latency.

That's a very nebulous metric. Usec of overhead depends on a lot of runtime things and a lot of hardware options and design that I'm just not privy to

Re: 1.5 TB of VRAM on Mac Studio – RDMA over Thunderbolt 5

#192
post #189

Earlier quoted context omitted.

Look at this guy on his first ram shortage.

I've been in this game so long, seen so many shortages that I'm not even worried. Right now prices are high, manufacturers are switching production, and in 6 months there's going to be a glut of supply. It's all a long game, folks. Play it long.

Long game is fine for optional upgrades. “I really wish my game system had 20% better graphics”. Less good when your system crashes and you need something new to work on Monday.

Re: 1.5 TB of VRAM on Mac Studio – RDMA over Thunderbolt 5

#193
post #166

Earlier quoted context omitted.

There is no popping. We cannot have enough compute for the forseeable future.

Look at this guy on his first ram shortage.

Back in the day when 1mb memory sticks ruled the earth there was apparently a memory shortage because some fab burned down or something. Any day now, they’ll fix their shit and ram will be dirt cheap. At least according to my high school buddy.

We have always had a ram shortage. We’ve also always been at war with eastasia.

Re: 1.5 TB of VRAM on Mac Studio – RDMA over Thunderbolt 5

#194
post #70

Earlier quoted context omitted.

last I heard for the private compute features they were racking and stacking m2 mac pros

I honestly forgot they still made the Mac Pro. Amazing that they have these ready to ship on their website. But at a 50% premium over similar but faster Mac Studio models, what is the point? You can't usefully put GPUs in them as far as I know. You'd have to have a different PCIe need to make it make sense.

all PCIe lanes combined in that machine can do over 1 terabit. Would be quite the networking beast.

Re: 1.5 TB of VRAM on Mac Studio – RDMA over Thunderbolt 5

#198
post #189

Earlier quoted context omitted.

Look at this guy on his first ram shortage.

I've been in this game so long, seen so many shortages that I'm not even worried. Right now prices are high, manufacturers are switching production, and in 6 months there's going to be a glut of supply. It's all a long game, folks. Play it long.

> manufacturers are switching production

In what ways? The only switching I've seen is away from desktop memory.

Re: 1.5 TB of VRAM on Mac Studio – RDMA over Thunderbolt 5

#199
> For example: did you know there's no way to run a system upgrade (like to 26.2) via SSH

I did not know this. I thought the `softwareupdate` command was built for this use case, and thought it worked over ssh. It sure looks like it should work, but I don’t have a mac I can try it on right now.

Re: 1.5 TB of VRAM on Mac Studio – RDMA over Thunderbolt 5

#200

Earlier quoted context omitted.

>> people saying they want insane power density are, in my personal view, deluded ridiculous individuals who understand very very little. Or they are simply not-rich people who cannot afford to purchase extra hardware to run in parallel. Electricity is cheap. GPUs are not. So i want to get every ounce of power out of the precious few GPUs i can afford to own. (And dont point at clouds. Running AI on someone else's cl…

> Electricity is cheap. American :)

Or Canadian... off peak in Ontario is <$0.03 US if you prioritize off peak...
Post reply on HN