Earlier quoted context omitted.
Crazy to me that as soon as one GPU wave is dying (crypto), another one is picking up slack.
For most part of the 20th, a bulk of the energy humanity was able to extract was used for industrialization. Now it seems that a vast bulk of the energy being extracted will go towards computation.
Fork of Facebook’s LLaMa model to run on CPU
81–90 of 178 posts
Re: Fork of Facebook’s LLaMa model to run on CPU
#82Earlier quoted context omitted.
What we will get are specialized hardware, with not so open APIs anyway. With a bunch of people trailling behind with "it kind of works" open alternatives.
It sounds like you are complaining about capitalism :-) It's not so bad. Nvidia could come and say, "hey, I'm going to lock down your GPU so that you can only use it to render polygons in my whitelisted list of video-games, and then you pay us $$$$$$ to buy our 'datacenter' thingy for anything else." But if they do it, people will go and buy the competitor's product. And yes, probably their 4090 are being bought by s…
You just described gaming consoles.
Re: Fork of Facebook’s LLaMa model to run on CPU
#83Re: Fork of Facebook’s LLaMa model to run on CPU
#84Re: Fork of Facebook’s LLaMa model to run on CPU
#85Earlier quoted context omitted.
Which is a good thing. So glad all that GPU compute is being used on cool stuff rather than running SHA-256 18 quintillion times
They can’t both be cool?
Re: Fork of Facebook’s LLaMa model to run on CPU
#86Earlier quoted context omitted.
What we will get are specialized hardware, with not so open APIs anyway. With a bunch of people trailling behind with "it kind of works" open alternatives.
It sounds like you are complaining about capitalism :-) It's not so bad. Nvidia could come and say, "hey, I'm going to lock down your GPU so that you can only use it to render polygons in my whitelisted list of video-games, and then you pay us $$$$$$ to buy our 'datacenter' thingy for anything else." But if they do it, people will go and buy the competitor's product. And yes, probably their 4090 are being bought by s…
Good luck with AMD.
Re: Fork of Facebook’s LLaMa model to run on CPU
#87Re: Fork of Facebook’s LLaMa model to run on CPU
#88Earlier quoted context omitted.
Why is it a bad start? It could be venv as well, I suppose, I haven't used conda.
Conda is gonna work much, much, much better for these kinds of applications, as that's what it's mostly used for, i.e. scientific/numerical computing with C/C++ dependencies.
Use it in a container or a VM unless you enjoy re-installing your system from scratch.
Or better still, don't use it al all and let it wither away: these kind of braindead projects need to be put down with extreme prejudice.
Re: Fork of Facebook’s LLaMa model to run on CPU
#89Earlier quoted context omitted.
Crazy to me that as soon as one GPU wave is dying (crypto), another one is picking up slack.
For most part of the 20th, a bulk of the energy humanity was able to extract was used for industrialization. Now it seems that a vast bulk of the energy being extracted will go towards computation.
https://ourworldindata.org/grapher/per-capita-energy-use
That's like the average person running 27 NVIDIA A100s at max capacity at all times!