Seeing those gigantic models it makes me sad that even the 4090 is supposed to stay at 24GB of RAM max. I really would like to be able to run/experiment on larger models at home.
YaLM-100B: Pretrained language model with 100B parameters
21–30 of 666 posts
Re: YaLM-100B: Pretrained language model with 100B parameters
#22I hope one day it will be possible to run this kind of models at home.
When it will be possible to run this at home, the big companies will have models way bigger than this...
Re: YaLM-100B: Pretrained language model with 100B parameters
#23Earlier quoted context omitted.
Coming from Russia doesn't mean you agree with government policy. If you saw people get arrested as soon as they start protesting, what would you do?
Doesn't mean you can't be punished for the actions of the government though. See: Western companies and government pulling out of Russia or issuing sanctions on private individuals. I think it's even worse to say "we don't think you're guilty, but we do think you should be punished."
"We want to punish you" and "We don't want to make business with you" are two very different things IMHO.
Re: YaLM-100B: Pretrained language model with 100B parameters
#24I have huge respect for developers at Yandex. It's kind of sad that achievements like these are tainted by the fact that they come from Russia (and I speak as a Ukrainian). I wonder if the permissive license is able to mitigate that.
The achievements aren’t in any way tainted by their nationality, citizenship, sex, sexual orientation, age, etc.
the age old question if the art should be linked or disconnected from the artist
Re: YaLM-100B: Pretrained language model with 100B parameters
#25I have huge respect for developers at Yandex. It's kind of sad that achievements like these are tainted by the fact that they come from Russia (and I speak as a Ukrainian). I wonder if the permissive license is able to mitigate that.
The achievements cannot be tainted.
Kolmogorov complexity is (I hope) untainted.
Also, Hilbert’s problems are not untainted (and he never flew Nazi Germany!).
Re: YaLM-100B: Pretrained language model with 100B parameters
#26I have huge respect for developers at Yandex. It's kind of sad that achievements like these are tainted by the fact that they come from Russia (and I speak as a Ukrainian). I wonder if the permissive license is able to mitigate that.
Coming from Russia doesn't mean you agree with government policy. If you saw people get arrested as soon as they start protesting, what would you do?
They might as well agree with it. Or agree with some of it. It just strikes me how everyone wants to put everyone else into these well-defined black-and-white boxes. I get that it’s simpler, but it’s often at odds with reality.
Re: YaLM-100B: Pretrained language model with 100B parameters
#27well, I can call this "the real open ai".
Re: YaLM-100B: Pretrained language model with 100B parameters
#28Earlier quoted context omitted.
What about 250gb of ram and use a cpu ?
Way too slow on CPU unfortunately But this does make me wonder if there's any way to allow a graphics card to use regular RAM in a fast way? AFAIK built-in GPU's inside CPU's can but those GPU's are not powerful enough
I thought cuda had a unified memory system? Maybe I misunderstood
Re: YaLM-100B: Pretrained language model with 100B parameters
#29Earlier quoted context omitted.
Doesn't mean you can't be punished for the actions of the government though. See: Western companies and government pulling out of Russia or issuing sanctions on private individuals. I think it's even worse to say "we don't think you're guilty, but we do think you should be punished."
"We want to punish you" and "We don't want to make business with you" are two very different things IMHO.
If you go out of your way to not do business with someone, in order to cripple them economically, then it is a punishment.
Re: YaLM-100B: Pretrained language model with 100B parameters
#30Earlier quoted context omitted.
But as a company, they do. They are filtering alternative media from their search.
They're just following the law of their host country, like DuckDuckGo and Google have to... What's the alternative? Open rebellion against the state?
They've started to do so before the law was adjusted