Earlier quoted context omitted.
Header and FCS, interpacket gap, and preamble. What do you think "Ethernet overhead" is?
I've meant in usec, sorry if that wasn't clear, given that the discussion that I've replied was about rpc latency.
1.5 TB of VRAM on Mac Studio – RDMA over Thunderbolt 5
191–200 of 236 posts
Re: 1.5 TB of VRAM on Mac Studio – RDMA over Thunderbolt 5
#192Earlier quoted context omitted.
Look at this guy on his first ram shortage.
I've been in this game so long, seen so many shortages that I'm not even worried. Right now prices are high, manufacturers are switching production, and in 6 months there's going to be a glut of supply. It's all a long game, folks. Play it long.
Re: 1.5 TB of VRAM on Mac Studio – RDMA over Thunderbolt 5
#193Earlier quoted context omitted.
There is no popping. We cannot have enough compute for the forseeable future.
Look at this guy on his first ram shortage.
We have always had a ram shortage. We’ve also always been at war with eastasia.
Re: 1.5 TB of VRAM on Mac Studio – RDMA over Thunderbolt 5
#194Earlier quoted context omitted.
last I heard for the private compute features they were racking and stacking m2 mac pros
I honestly forgot they still made the Mac Pro. Amazing that they have these ready to ship on their website. But at a 50% premium over similar but faster Mac Studio models, what is the point? You can't usefully put GPUs in them as far as I know. You'd have to have a different PCIe need to make it make sense.
Re: 1.5 TB of VRAM on Mac Studio – RDMA over Thunderbolt 5
#195Re: 1.5 TB of VRAM on Mac Studio – RDMA over Thunderbolt 5
#196Re: 1.5 TB of VRAM on Mac Studio – RDMA over Thunderbolt 5
#197TL1 mount, where 1.5 TB allocate mac-mini server.
Re: 1.5 TB of VRAM on Mac Studio – RDMA over Thunderbolt 5
#198Earlier quoted context omitted.
Look at this guy on his first ram shortage.
I've been in this game so long, seen so many shortages that I'm not even worried. Right now prices are high, manufacturers are switching production, and in 6 months there's going to be a glut of supply. It's all a long game, folks. Play it long.
In what ways? The only switching I've seen is away from desktop memory.
Re: 1.5 TB of VRAM on Mac Studio – RDMA over Thunderbolt 5
#199I did not know this. I thought the `softwareupdate` command was built for this use case, and thought it worked over ssh. It sure looks like it should work, but I don’t have a mac I can try it on right now.
Re: 1.5 TB of VRAM on Mac Studio – RDMA over Thunderbolt 5
#200Earlier quoted context omitted.
>> people saying they want insane power density are, in my personal view, deluded ridiculous individuals who understand very very little. Or they are simply not-rich people who cannot afford to purchase extra hardware to run in parallel. Electricity is cheap. GPUs are not. So i want to get every ounce of power out of the precious few GPUs i can afford to own. (And dont point at clouds. Running AI on someone else's cl…
> Electricity is cheap. American :)