Bringing PyTorch Monarch to AMD GPUs
pytorch.org
Bringing PyTorch Monarch to AMD GPUs
1–9 of 9 posts
Re: Bringing PyTorch Monarch to AMD GPUs
#2So are we at a point where we can’t train llms for fun at home on less expensive AMD cards ?
Re: Bringing PyTorch Monarch to AMD GPUs
#3So are we at a point where we can’t train llms for fun at home on less expensive AMD cards ?
can't or can?
Re: Bringing PyTorch Monarch to AMD GPUs
#4Love monarch, amazing primitives and feels so much lighter than Ray.
Another awesome add on their part
Re: Bringing PyTorch Monarch to AMD GPUs
#5So are we at a point where we can’t train llms for fun at home on less expensive AMD cards ?
Who was training LLMs on residential AMD GPUs?
Re: Bringing PyTorch Monarch to AMD GPUs
#6benchmqarks?
Re: Bringing PyTorch Monarch to AMD GPUs
#7So are we at a point where we can’t train llms for fun at home on less expensive AMD cards ?
Who was training LLMs on residential AMD GPUs?
I am. Most models that can be run locally have extraordinarily out of date training data for certain frameworks that predate breaking changes and important features, so their docs and API schemas need to be put into LoRAs.
Re: Bringing PyTorch Monarch to AMD GPUs
#8[flagged]