Live data from Hacker News

YaLM-100B: Pretrained language model with 100B parameters

github.com

11–20 of 666 posts

Re: YaLM-100B: Pretrained language model with 100B parameters

#11
post #6

I have huge respect for developers at Yandex. It's kind of sad that achievements like these are tainted by the fact that they come from Russia (and I speak as a Ukrainian). I wonder if the permissive license is able to mitigate that.

https://github.com/yandex/YaLM-100B/blob/main/LICENSE

apache license

>The model is published under the Apache 2.0 license that permits both research and commercial use

you should be fine

Re: YaLM-100B: Pretrained language model with 100B parameters

#12
post #9
post #6

I have huge respect for developers at Yandex. It's kind of sad that achievements like these are tainted by the fact that they come from Russia (and I speak as a Ukrainian). I wonder if the permissive license is able to mitigate that.

Coming from Russia doesn't mean you agree with government policy. If you saw people get arrested as soon as they start protesting, what would you do?

But as a company, they do. They are filtering alternative media from their search.

Re: YaLM-100B: Pretrained language model with 100B parameters

#13
I have to wonder if 10 years down the line, everyone will be able to run models like this on their own computers. Have to wonder what the knock-on effects of that will be, especially if the models improve drastically. With so much of our social lives being moved online, if we have the easy ability to create fake lives of fake people one has to wonder what's real and what isn't.

Maybe the dead internet theory will really come true; at least, in some sense of it. https://www.theatlantic.com/technology/archive/2021/08/dead-...

Re: YaLM-100B: Pretrained language model with 100B parameters

#14

For those of us without 200GB of GPU RAM available... How possible is it to do inference loading it from SSD? Would you have to scan through all 200GB of data once per character generated? That doesn't actually sound too painful - 1 minute per character seems kinda okay. And I guess you can easily do lots of data parallelism, so you can get 1 minute per character on lots of inputs and outputs at the same time.

What about 250gb of ram and use a cpu ?

Re: YaLM-100B: Pretrained language model with 100B parameters

#15
post #9

Earlier quoted context omitted.

Coming from Russia doesn't mean you agree with government policy. If you saw people get arrested as soon as they start protesting, what would you do?

But as a company, they do. They are filtering alternative media from their search.

Not much they can do if the alternative is go to jail.

Re: YaLM-100B: Pretrained language model with 100B parameters

#16

For those of us without 200GB of GPU RAM available... How possible is it to do inference loading it from SSD? Would you have to scan through all 200GB of data once per character generated? That doesn't actually sound too painful - 1 minute per character seems kinda okay. And I guess you can easily do lots of data parallelism, so you can get 1 minute per character on lots of inputs and outputs at the same time.

[deleted]

Re: YaLM-100B: Pretrained language model with 100B parameters

#17

For those of us without 200GB of GPU RAM available... How possible is it to do inference loading it from SSD? Would you have to scan through all 200GB of data once per character generated? That doesn't actually sound too painful - 1 minute per character seems kinda okay. And I guess you can easily do lots of data parallelism, so you can get 1 minute per character on lots of inputs and outputs at the same time.

What about 250gb of ram and use a cpu ?

    $ dd if=/dev/zero of=/swapfile bs=1G count=250 status=progress
    $ chmod 600 /swapfile
    $ mkswap -U clear /swapfile
    $ swapon /swapfile

Re: YaLM-100B: Pretrained language model with 100B parameters

#18
post #9

Earlier quoted context omitted.

Coming from Russia doesn't mean you agree with government policy. If you saw people get arrested as soon as they start protesting, what would you do?

But as a company, they do. They are filtering alternative media from their search.

They're just following the law of their host country, like DuckDuckGo and Google have to... What's the alternative? Open rebellion against the state?

Re: YaLM-100B: Pretrained language model with 100B parameters

#19
post #9
post #6

I have huge respect for developers at Yandex. It's kind of sad that achievements like these are tainted by the fact that they come from Russia (and I speak as a Ukrainian). I wonder if the permissive license is able to mitigate that.

Coming from Russia doesn't mean you agree with government policy. If you saw people get arrested as soon as they start protesting, what would you do?

Doesn't mean you can't be punished for the actions of the government though. See: Western companies and government pulling out of Russia or issuing sanctions on private individuals. I think it's even worse to say "we don't think you're guilty, but we do think you should be punished."

Re: YaLM-100B: Pretrained language model with 100B parameters

#20

For those of us without 200GB of GPU RAM available... How possible is it to do inference loading it from SSD? Would you have to scan through all 200GB of data once per character generated? That doesn't actually sound too painful - 1 minute per character seems kinda okay. And I guess you can easily do lots of data parallelism, so you can get 1 minute per character on lots of inputs and outputs at the same time.

What about 250gb of ram and use a cpu ?

Way too slow on CPU unfortunately

But this does make me wonder if there's any way to allow a graphics card to use regular RAM in a fast way? AFAIK built-in GPU's inside CPU's can but those GPU's are not powerful enough

Post reply on HN