Earlier quoted context omitted.
[flagged]
> same PyTorch/CUDA calls, just intercepted by a stub library that forwards them over the local network. At that point you're making more work for yourself than debugging over SSH.
[dead]
Apple approves driver that lets Nvidia eGPUs work with Arm Macs
201–210 of 262 posts
Re: Apple approves driver that lets Nvidia eGPUs work with Arm Macs
#202[flagged]
[dead]
Re: Apple approves driver that lets Nvidia eGPUs work with Arm Macs
#203Woah, this is exciting. I'm traveling but I have a 5090 lying around at home. I'm eager to give it a go. Docs are here: https://docs.tinygrad.org/tinygpu/ I hope it'll work on an M4 Mac Mini. Does anyone know what hardware to get? You'll need a full ATX PSU to supply power, right? And then tinygrad can do LLM inference on it?
“Lying around”. I’ve got an unopened 5090 in a box that I know will suffer the same fate, so I’m sending it back. So privileged to have the money to impulse buy a 5090 and yet no time to actually do anything with it.
You should see his ferrari.
Re: Apple approves driver that lets Nvidia eGPUs work with Arm Macs
#204Idk why this doesn't link to the original source instead of this proxy source: https://x.com/__tinygrad__/status/2039213719155310736
How else will they earn ad revenue? /s
Re: Apple approves driver that lets Nvidia eGPUs work with Arm Macs
#205Idk why this doesn't link to the original source instead of this proxy source: https://x.com/__tinygrad__/status/2039213719155310736
And why is there no link to the actual driver?
Re: Apple approves driver that lets Nvidia eGPUs work with Arm Macs
#206I think that metal isn’t double precision; so that limits some serious physics simming; but if you’re doing that I guess you just rent a gpu somewhere.
I would definitely be into this if adding an egpu was first class supported.
Re: Apple approves driver that lets Nvidia eGPUs work with Arm Macs
#207These tinyboxes are so expensive (starting at $12,000), why don't they just put a CPU inside and allow users to ssh into them?
Re: Apple approves driver that lets Nvidia eGPUs work with Arm Macs
#208Re: Apple approves driver that lets Nvidia eGPUs work with Arm Macs
#209A good technical project, but honestly useless in like 90% of scenarios. You want to use an NVidia GPU for LLM ? just buy a basic PC on second hand (the GPU is the primary cost anyway), you want to use Mac for good amount of VRAM ? Buy a Mac. With this proposed solution you have an half-backed system, the GPU is limited by the Thunderbolt port and you don’t have access to all of NVidia tool and library, and on other…
Even with running ML experiments you'd mostly want to run them on rented out clusters anyway
Re: Apple approves driver that lets Nvidia eGPUs work with Arm Macs
#210> If you have a Thunderbolt or USB4 eGPU and a Mac, today is the day you've been waiting for!
I got an eGPU back in 2018 and could never get it to work. To the point that it soured me from doing it again.
These days for heavy duty work I just offload to the cloud. This all feels like NVidia trying to be relevant versus ARM.