Live data from Hacker News

YaLM-100B: Pretrained language model with 100B parameters

github.com

111–120 of 666 posts

Re: YaLM-100B: Pretrained language model with 100B parameters

#111

[flagged]

I don't want to defend them, but I'm genuinely curious: aren't they maybe doing it because the opposite will cause them huge legal issues?

They will simply have their company taken away from them.

Nevertheless, they had many years before the war to start marking their news as 'Official'. Or sell the news service. They certainly could have done so. This would have solved their image problems.

Re: YaLM-100B: Pretrained language model with 100B parameters

#112
post #88
post #74

Earlier quoted context omitted.

Indeed. What "everyone" can use is a ~$200 smartphone, so there's a ~300x gap to be bridged.

log(300) / log(2) = only 8.2 doublings away. That's near future material.

Maybe at 90s hardware growth rates, but not now.

Re: YaLM-100B: Pretrained language model with 100B parameters

#113
post #13

I have to wonder if 10 years down the line, everyone will be able to run models like this on their own computers. Have to wonder what the knock-on effects of that will be, especially if the models improve drastically. With so much of our social lives being moved online, if we have the easy ability to create fake lives of fake people one has to wonder what's real and what isn't. Maybe the dead internet theory will rea…

The Move to the Edge is one of the strongest trends in technology. So, yes. I would never best against it.

(applies to computing and other technologies like power production and agriculture)

Re: YaLM-100B: Pretrained language model with 100B parameters

#114
post #13

I have to wonder if 10 years down the line, everyone will be able to run models like this on their own computers. Have to wonder what the knock-on effects of that will be, especially if the models improve drastically. With so much of our social lives being moved online, if we have the easy ability to create fake lives of fake people one has to wonder what's real and what isn't. Maybe the dead internet theory will rea…

Yes, the vision is that everyone has an AI cube in their house.

Re: YaLM-100B: Pretrained language model with 100B parameters

#115
post #113
post #13

I have to wonder if 10 years down the line, everyone will be able to run models like this on their own computers. Have to wonder what the knock-on effects of that will be, especially if the models improve drastically. With so much of our social lives being moved online, if we have the easy ability to create fake lives of fake people one has to wonder what's real and what isn't. Maybe the dead internet theory will rea…

The Move to the Edge is one of the strongest trends in technology. So, yes. I would never best against it. (applies to computing and other technologies like power production and agriculture)

When I see AWS, cloud, and server side rendering frameworks it seems like we’re moving the other way in some sense.

Re: YaLM-100B: Pretrained language model with 100B parameters

#116

Earlier quoted context omitted.

I don't want to defend them, but I'm genuinely curious: aren't they maybe doing it because the opposite will cause them huge legal issues?

They can protest, they can boycott, they can disagree, they can tell the truth. But... They chose to obey. It's the choice that matters.

From what I've seen, telling the truth in authoritian countries doesn't end up well.

To the best of my knowledge, they are a Russian company - it's not like they can just tell the truth and move away from Russia that easily, so I think (and hope?) they're just playing a political game.

What would Google do in their position? Idk

Re: YaLM-100B: Pretrained language model with 100B parameters

#117
post #45
post #8

Earlier quoted context omitted.

The achievements aren’t in any way tainted by their nationality, citizenship, sex, sexual orientation, age, etc.

Well... I'm sorry if I reach for the reductio at Hitlerum, but any achievements Nazi scientists might have reached in concentration camps are definitely tainted. Similarly, achievements in the field of online consumer analysis in a country where consumer-privacy protections are nonexistent, surely should be considered tainted...?

That is why the US imported Nazi scientists in bulk to work in their labs. Starting with Wernher von Braun who had become the heart of the US space program. Soviets did the same at the time.

If you are so conscious about consuming tainted fruits the only way to escape is to be living on some deserted island catching your own food.

Re: YaLM-100B: Pretrained language model with 100B parameters

#118
post #9
post #6

I have huge respect for developers at Yandex. It's kind of sad that achievements like these are tainted by the fact that they come from Russia (and I speak as a Ukrainian). I wonder if the permissive license is able to mitigate that.

Coming from Russia doesn't mean you agree with government policy. If you saw people get arrested as soon as they start protesting, what would you do?

Yandex is arguably the biggest censoring and propaganda machine in Russia.

Yandex News is IIRC the biggest news media in Russia.

It filtered all results on protests and opposition resources leaving only government propaganda. Same with war. Filtering not meaning downranking. Just straight up not showing.

Editors were fired for not staying in line until it was completely sterilized and filled with pro-war propaganda.

Working in Yandex is being complicit with it.

Re: YaLM-100B: Pretrained language model with 100B parameters

#120
post #24
post #8

Earlier quoted context omitted.

The achievements aren’t in any way tainted by their nationality, citizenship, sex, sexual orientation, age, etc.

the age old question if the art should be linked or disconnected from the artist

This is nothing like that, because the question is not one of their own personal actions - but of their nationality or ethnicity. That, until about 4 months ago, would have been widely acknowledged as racism.

The difference between holding values, and holding values when convenient rather sums up the entirety of human history in one phrase.

Post reply on HN