Live data from Hacker News

YaLM-100B: Pretrained language model with 100B parameters

github.com

151–160 of 666 posts

Re: YaLM-100B: Pretrained language model with 100B parameters

#151

Earlier quoted context omitted.

I don't want to defend them, but I'm genuinely curious: aren't they maybe doing it because the opposite will cause them huge legal issues?

They will simply have their company taken away from them. Nevertheless, they had many years before the war to start marking their news as 'Official'. Or sell the news service. They certainly could have done so. This would have solved their image problems.

It's already taken away.

Re: YaLM-100B: Pretrained language model with 100B parameters

#152
post #38

Earlier quoted context omitted.

If you go out of your way to not do business with someone, in order to cripple them economically, then it is a punishment.

If you want to define punishment like that, it is your call. In my opinion it is not punishment to stop a relationship if the basis of that relationship was destroyed deliberately by one side.

I don't define it, it's exactly the official definition, like it or not:

> punishment: the infliction or imposition of a penalty as retribution for an offence.

Then you can play all you want with language to make it say what you'd like but it's pointless.

Re: YaLM-100B: Pretrained language model with 100B parameters

#154
post #79

Earlier quoted context omitted.

If you go out of your way to not do business with someone, in order to cripple them economically, then it is a punishment.

The purpose is deterrence, not punishment.

And yet sanctions never work as a deterrent. Cuba is still socialist after 60 years of sanctions. Great deterrent! No, sanctions just punish generation after generation of innocent people and serve no other purpose.

If you still mantain that the purpose is deterrence, then you must be a fool or worse, since it never works! Can't you learn from the past?

Edit:

Before you even dig out some article like this: https://www.washingtonpost.com/news/worldviews/wp/2014/04/28...

I will make an important point: sanctions CAN work only to prevent something from happening. Once that happened, e.g. the war started, there's no sanction that can stop it and that's exactly when sanctions stop being a deterrent and start being a punishment.

Re: YaLM-100B: Pretrained language model with 100B parameters

#155
post #139

I agree, yandex is a great search engine

no it's not. they straight up serve kremlin, promoting kremlin fake news and silencing russian opposition (not much to silence but still). they can have whatever functionality they like, I still won't use it in billion years.

Re: YaLM-100B: Pretrained language model with 100B parameters

#156
post #139

I agree, yandex is a great search engine

no it's not. they straight up serve kremlin, promoting kremlin fake news and silencing russian opposition (not much to silence but still). they can have whatever functionality they like, I still won't use it in billion years.

No post body was provided.

Re: YaLM-100B: Pretrained language model with 100B parameters

#157
post #13

I have to wonder if 10 years down the line, everyone will be able to run models like this on their own computers. Have to wonder what the knock-on effects of that will be, especially if the models improve drastically. With so much of our social lives being moved online, if we have the easy ability to create fake lives of fake people one has to wonder what's real and what isn't. Maybe the dead internet theory will rea…

That's definitely the future, personalized entertainment and social interactions will be big. I could watch a movie made for me, and discuss it with a bunch of chat bots. The future will be bubbly as hell, people will be decaying in their safe places as the hellscape rages on outside.

You really dont want to live in Mindwarp (1992 Bruce Campbell movie) or in this !114! year old short story https://en.wikipedia.org/wiki/The_Machine_Stops

Re: YaLM-100B: Pretrained language model with 100B parameters

#158
post #129

Earlier quoted context omitted.

> I have to wonder if 10 years down the line, everyone will be able to run models like this on their own computers. Isn’t that already the case? Sure, it costs $60K, but that is accessible to a surprisingly large minority, considering the potency of this software.

You could just run this on a desktop CPU, there's nothing stopping you in principle, you just need enough RAM. A big memory (256GB) machine is definitely doable at home. It's going to cost 1-2k on the DIMMs alone, less if you use 8x32GB, but that'll come down. You could definitely do it for less than $5k all in. Inference latency is a lot higher in relative terms, but even for things like image processing running a C…

From the readme, it looks like you need that RAM on your GPU.

Re: YaLM-100B: Pretrained language model with 100B parameters

#159

Earlier quoted context omitted.

> I have to wonder if 10 years down the line, everyone will be able to run models like this on their own computers. Isn’t that already the case? Sure, it costs $60K, but that is accessible to a surprisingly large minority, considering the potency of this software.

Nitpick: This uses 8x A100 which are at least $10k a piece to my knowledge. Add in the computer and you're closer to $100k.

And also, NVIDIA does not sell them to the consumer market whatsoever. Linus Tech Tips could only show one because someone in the audience sent theirs over for review.

Re: YaLM-100B: Pretrained language model with 100B parameters

#160
post #132

Earlier quoted context omitted.

Maybe at 90s hardware growth rates, but not now.

The dream of the 90s is alive in the GPU market: https://aiimpacts.org/2019-recent-trends-in-gpu-price-per-fl... Moore's law didn't stop, just Dennard scaling. Expect graphics and AI to continue to improve radically in performance/price, while more ordinary workloads see only modest improvements.

GPU TDP seems on the verge of going exponential, cost per transistor isn't really decreasing so much at the very latest nodes, and even that article seems to suggest it'd likely be decades before 300x flops/$
Post reply on HN