Live data from Hacker News

YaLM-100B: Pretrained language model with 100B parameters

github.com

81–90 of 666 posts

Re: YaLM-100B: Pretrained language model with 100B parameters

#81
post #45
post #8

Earlier quoted context omitted.

The achievements aren’t in any way tainted by their nationality, citizenship, sex, sexual orientation, age, etc.

Well... I'm sorry if I reach for the reductio at Hitlerum, but any achievements Nazi scientists might have reached in concentration camps are definitely tainted. Similarly, achievements in the field of online consumer analysis in a country where consumer-privacy protections are nonexistent, surely should be considered tainted...?

Wernher von Braun would disagree

Re: YaLM-100B: Pretrained language model with 100B parameters

#83
post #60

Earlier quoted context omitted.

> I have to wonder if 10 years down the line, everyone will be able to run models like this on their own computers. Isn’t that already the case? Sure, it costs $60K, but that is accessible to a surprisingly large minority, considering the potency of this software.

...what? 60 thousand dollars for a dedicated computer that you can't use is not everyone, not on their own computers, and is also a crazy large amount of money for nearly everyone. Sure there are some that could, but that's not what I said.

Plus, that's the energy costs involved when running a computer now worth 60k, I'm pretty sure that in the current socio-economic climate those power costs will surpass the initial acquisition cost (those 60k, that is) pretty easily.

Re: YaLM-100B: Pretrained language model with 100B parameters

#84
post #43

Earlier quoted context omitted.

But as a company, they do. They are filtering alternative media from their search.

Genuinely curious: which media outlets are banned from Yandex Search? I just tried Meduza for example, comes up in search just fine.

Yandex has a news block right in the middle of its front page. Only "approved" news sources could be shown there. For people not specifically searching for recent updates on a topic or particular media outlets it represents the news. As far as I remember they wanted to remove this block instead of completely instead of censoring, but they were not allowed to. I think it was described in one of the documentaries about Yandex, but my memories are vague now.

Re: YaLM-100B: Pretrained language model with 100B parameters

#85
post #22
post #2

I hope one day it will be possible to run this kind of models at home.

When it will be possible to run this at home, the big companies will have models way bigger than this...

Or maybe the AI will own big companies that build bigger models for it. /s

Re: YaLM-100B: Pretrained language model with 100B parameters

#86
post #13

I have to wonder if 10 years down the line, everyone will be able to run models like this on their own computers. Have to wonder what the knock-on effects of that will be, especially if the models improve drastically. With so much of our social lives being moved online, if we have the easy ability to create fake lives of fake people one has to wonder what's real and what isn't. Maybe the dead internet theory will rea…

I don’t know for you, but most of my online interactions are text based. Context of interpretation matter far much than the form of the content. If you know it’s easy to fake text exchanges, you might be more careful about text origin, and other contextual hints. Even it’s the syntax imitate your children verbal oddities, you may not necessarily run to comply thoughtlessly to an unusual demand you just receive by SMS from their phone number. Trust and check.

Re: YaLM-100B: Pretrained language model with 100B parameters

#87
post #43

Earlier quoted context omitted.

Genuinely curious: which media outlets are banned from Yandex Search? I just tried Meduza for example, comes up in search just fine.

Yandex has a news block right in the middle of its front page. Only "approved" news sources could be shown there. For people not specifically searching for recent updates on a topic or particular media outlets it represents the news. As far as I remember they wanted to remove this block instead of completely instead of censoring, but they were not allowed to. I think it was described in one of the documentaries about…

I know, but the OP meant Search, not News. Google and even DDG can downrank certain news sources and I wouldn't be very surprized if Yandex did too, but I'd really like to see examples.

Re: YaLM-100B: Pretrained language model with 100B parameters

#88
post #74
post #60

Earlier quoted context omitted.

...what? 60 thousand dollars for a dedicated computer that you can't use is not everyone, not on their own computers, and is also a crazy large amount of money for nearly everyone. Sure there are some that could, but that's not what I said.

Indeed. What "everyone" can use is a ~$200 smartphone, so there's a ~300x gap to be bridged.

log(300) / log(2) = only 8.2 doublings away. That's near future material.

Re: YaLM-100B: Pretrained language model with 100B parameters

#89
post #8
post #6

I have huge respect for developers at Yandex. It's kind of sad that achievements like these are tainted by the fact that they come from Russia (and I speak as a Ukrainian). I wonder if the permissive license is able to mitigate that.

The achievements aren’t in any way tainted by their nationality, citizenship, sex, sexual orientation, age, etc.

[deleted]

Re: YaLM-100B: Pretrained language model with 100B parameters

#90
The download fails because the vocab file link returns HTTP 403... :-(

https://yalm-100b.s3.yandex.net/vocab/voc_100b.sp

EDIT: It seems fine if you download with a browser useragent not CURL... I guess I just got hit by some anti-bot thing they have accidentally have turned on.

Post reply on HN