Live data from Hacker News

YaLM-100B: Pretrained language model with 100B parameters

github.com

121–130 of 666 posts

Re: YaLM-100B: Pretrained language model with 100B parameters

#121

Earlier quoted context omitted.

They've started to do so before the law was adjusted

Like Facebook, Twitter and every other forum did? I wonder if there were any consequences if they didn't.

No, they just removed all but pro-Putin or state media out of Yandex News. It's just only pro-war Kremlin propaganda now.

Re: YaLM-100B: Pretrained language model with 100B parameters

#122
post #110
post #9

Earlier quoted context omitted.

Coming from Russia doesn't mean you agree with government policy. If you saw people get arrested as soon as they start protesting, what would you do?

> If you saw people get arrested as soon as they start protesting, what would you do? Probably move if that's anywhere near a possibility, and if not, cowardly stay as unnoticeable as possible. I know that at least in Finland Russian refugees are mostly welcome (although the border might be closed right now), even if they probably will face a lot of scrutiny from various authorities for obvious reasons. Most certainl…

It would probably fit better to compare "small actions" to the people of the DDR which were protesting against their regime and ultimately helped to bring it down.

Re: YaLM-100B: Pretrained language model with 100B parameters

#123
post #87

Earlier quoted context omitted.

Yandex has a news block right in the middle of its front page. Only "approved" news sources could be shown there. For people not specifically searching for recent updates on a topic or particular media outlets it represents the news. As far as I remember they wanted to remove this block instead of completely instead of censoring, but they were not allowed to. I think it was described in one of the documentaries about…

I know, but the OP meant Search, not News. Google and even DDG can downrank certain news sources and I wouldn't be very surprized if Yandex did too, but I'd really like to see examples.

[deleted]

Re: YaLM-100B: Pretrained language model with 100B parameters

#124
post #13

I have to wonder if 10 years down the line, everyone will be able to run models like this on their own computers. Have to wonder what the knock-on effects of that will be, especially if the models improve drastically. With so much of our social lives being moved online, if we have the easy ability to create fake lives of fake people one has to wonder what's real and what isn't. Maybe the dead internet theory will rea…

That's definitely the future, personalized entertainment and social interactions will be big. I could watch a movie made for me, and discuss it with a bunch of chat bots. The future will be bubbly as hell, people will be decaying in their safe places as the hellscape rages on outside.

I get the feeling that creative sci fi used to kind of help inoculate us against these kinds of future but it seems like there's much less of it than there used to be.

"Black mirror" was good but it's not nearly enough.

Re: YaLM-100B: Pretrained language model with 100B parameters

#125
post #26
post #9

Earlier quoted context omitted.

Coming from Russia doesn't mean you agree with government policy. If you saw people get arrested as soon as they start protesting, what would you do?

They might as well agree with it. Or agree with some of it. It just strikes me how everyone wants to put everyone else into these well-defined black-and-white boxes. I get that it’s simpler, but it’s often at odds with reality.

>"It just strikes me how everyone ..."

Because most of those "everyone's" are not facing the choices themselves and are basically keyboard warriors. Let's see what they say when they'll be asked to sacrifice their own well being to be on a "high moral ground".

Re: YaLM-100B: Pretrained language model with 100B parameters

#126
post #9
post #6

I have huge respect for developers at Yandex. It's kind of sad that achievements like these are tainted by the fact that they come from Russia (and I speak as a Ukrainian). I wonder if the permissive license is able to mitigate that.

Coming from Russia doesn't mean you agree with government policy. If you saw people get arrested as soon as they start protesting, what would you do?

This is a stupid argument. Ukrainians are being killed and you compare that to fear of being arrested? It's a nice excuse. "Oh yes I don't support my government, but you know these arrests, I'd rather stay in my cosy home and enjoy my tea. Now could you please lift the sanctions? I already said I don't support my government, why normal people like me should suffer?" etc etc

Re: YaLM-100B: Pretrained language model with 100B parameters

#127

Earlier quoted context omitted.

But as a company, they do. They are filtering alternative media from their search.

Yandex is under full control of Russian government. Pretty sure FSB can access anything.

Yes, similar to VK where low-level police can retrieve all of your location, messaging, IP data and sell it to mafia or thugs.

Russian police is notorious for selling logs, private data or access and also selling databases on a black market.

Re: YaLM-100B: Pretrained language model with 100B parameters

#128
post #113

Earlier quoted context omitted.

The Move to the Edge is one of the strongest trends in technology. So, yes. I would never best against it. (applies to computing and other technologies like power production and agriculture)

When I see AWS, cloud, and server side rendering frameworks it seems like we’re moving the other way in some sense.

There's a strong trend to push to the edge of the cloud though -- cloudfront workers, deno.deploy, etc

Re: YaLM-100B: Pretrained language model with 100B parameters

#129
post #13

I have to wonder if 10 years down the line, everyone will be able to run models like this on their own computers. Have to wonder what the knock-on effects of that will be, especially if the models improve drastically. With so much of our social lives being moved online, if we have the easy ability to create fake lives of fake people one has to wonder what's real and what isn't. Maybe the dead internet theory will rea…

> I have to wonder if 10 years down the line, everyone will be able to run models like this on their own computers. Isn’t that already the case? Sure, it costs $60K, but that is accessible to a surprisingly large minority, considering the potency of this software.

You could just run this on a desktop CPU, there's nothing stopping you in principle, you just need enough RAM. A big memory (256GB) machine is definitely doable at home. It's going to cost 1-2k on the DIMMs alone, less if you use 8x32GB, but that'll come down. You could definitely do it for less than $5k all in.

Inference latency is a lot higher in relative terms, but even for things like image processing running a CNN on a CPU isn't particularly bad if you're experimenting, or even for low load production work.

But for really transient loads you're better off just renting seconds-minutes on a VM.

Re: YaLM-100B: Pretrained language model with 100B parameters

#130
post #6

I have huge respect for developers at Yandex. It's kind of sad that achievements like these are tainted by the fact that they come from Russia (and I speak as a Ukrainian). I wonder if the permissive license is able to mitigate that.

Are American developers’ achievement tainted by the fact they come from the United States?

Yeah. US developers might create great software but due to the Cloud Act, Patriot Act and whatnot you don't want to use it for anything that's not public data at first. It's just not protected against unauthorized access.
Post reply on HN