Live data from Hacker News

YaLM-100B: Pretrained language model with 100B parameters

github.com

271–280 of 666 posts

Re: YaLM-100B: Pretrained language model with 100B parameters

#271

Earlier quoted context omitted.

no it's not. they straight up serve kremlin, promoting kremlin fake news and silencing russian opposition (not much to silence but still). they can have whatever functionality they like, I still won't use it in billion years.

Literally what google doing in favor of USA.

Huge difference. Google does it for money. Yandex does it to enable an autocracy and to maintain their ability to operate.

Re: YaLM-100B: Pretrained language model with 100B parameters

#272
post #249

Earlier quoted context omitted.

What does it have to do with OpenAI branding? Their "moral" reasoning behind not publishing models is simply laughtable because they do sell API access to them to anyone who can pay. And "bad guys" generally have money.

They can (and do) revoke API access from bad guys. They can't do that to downloaded models. Look, I don't like what OpenAI does, but "API access, but no model download" makes sense if you are worried about misuses.

Bad actors still can get access to such models. It even makes them more dangerous than it would if everyone had access to them.

Here's an alternative: progressively release better and better models (like 3B params, 10B, 50B, 100B) and let people figure out the best way to fight against bad actors using them.

Re: YaLM-100B: Pretrained language model with 100B parameters

#273
post #249

Earlier quoted context omitted.

What does it have to do with OpenAI branding? Their "moral" reasoning behind not publishing models is simply laughtable because they do sell API access to them to anyone who can pay. And "bad guys" generally have money.

They can (and do) revoke API access from bad guys. They can't do that to downloaded models. Look, I don't like what OpenAI does, but "API access, but no model download" makes sense if you are worried about misuses.

Every company out there says it will "revoke API access for misuse", but do they have transparency reports? Who do they even consider bad guys and what do they consider as misuse?

I would be totally on their side if their reasoning was that they dont publish models to compete with FAANG more efficiently and get more income for their research, but this moral reasoning just sounds completely fake because bad actors do have funding to train their own models.

Re: YaLM-100B: Pretrained language model with 100B parameters

#274
post #242

Earlier quoted context omitted.

Many people consider all of Israel to be an illegitimate Western colonial settler state in the Middle East.

Then they have some explaining to do. As they are very wrong, from a historical/archaeological point view [1]. [1] https://en.wikipedia.org/wiki/History_of_the_Jews_and_Judais...

The relevant Wikipedia page is https://en.wikipedia.org/wiki/Khazars

Re: YaLM-100B: Pretrained language model with 100B parameters

#275
post #150
post #13

I have to wonder if 10 years down the line, everyone will be able to run models like this on their own computers. Have to wonder what the knock-on effects of that will be, especially if the models improve drastically. With so much of our social lives being moved online, if we have the easy ability to create fake lives of fake people one has to wonder what's real and what isn't. Maybe the dead internet theory will rea…

The bots/machine vs human reminds me of that famous experiment from the 30s in which Winthrop Kellogg[0], a comparative psychologist, and his wife decided to raise their human baby (Donald) simultaneously with a chimpanzee baby (Gua) in an effort to "humanize the ape". It was set out to last 5 years but was relatively quickly abrupted after only 9 months. The explicit reason wasn't stated only that it successfully pr…

Wow this is such a mind bending perspective. Thanks for sharing it.

Re: YaLM-100B: Pretrained language model with 100B parameters

#276

Earlier quoted context omitted.

Just want to point out the mass rape claims were fabricated. Ukraine even fired Lyudmila Denisova over the ordeal: https://greekcitytimes.com/2022/06/01/ukrainian-official-fir...

No, there are credible and quite horrifying reports[1]. Also some of the actual rapists were found out and victimes stepped forward. Please don't spew Russian propaganda. [1] https://meduza.io/en/feature/2022/04/18/i-can-do-whatever-i-...

How is it Russian propaganda? It's been widely reported by western sources that Denisova was fired by Ukrainian officials for lying specifically about the mass rape claims.

I'm not suggesting there have been no rapes or that Russians are the good guys. Just that the reports of mass rapes were fabricated (Denisova admitted she thought it would help Ukraine obtain more sympathy and weapons from the west).

Re: YaLM-100B: Pretrained language model with 100B parameters

#277
post #169

> It was tested on 4 (A100 80g) and 8 (V100 32g) GPUs, but is able to work with different configurations with ≈200GB of GPU memory in total which divide weight dimensions correctly (e.g. 16, 64, 128). so we looking at crazy prices just for inference. RIP to the first guy's cloud billing account who makes this public

so err the cheapest A100 i could find was EUR 10.579,79 .

Suddenly that 3090 i wanted to get, does not seem so expensive....

Re: YaLM-100B: Pretrained language model with 100B parameters

#278
post #139

I agree, yandex is a great search engine

no it's not. they straight up serve kremlin, promoting kremlin fake news and silencing russian opposition (not much to silence but still). they can have whatever functionality they like, I still won't use it in billion years.

You know that some people use search engines for other things than news right?

Re: YaLM-100B: Pretrained language model with 100B parameters

#279

Earlier quoted context omitted.

How do you feel about western-owned web services?

People in Russia felt much safer using iCloud, Gmail or Google Drive. Of course they comply to some requests by Kremlin or police. But Yandex or VK just give information straight away often times without much procedure.

the same way I feel much comfortable using Yandex in united states. Google and Facebook feed their data to NSA.

Re: YaLM-100B: Pretrained language model with 100B parameters

#280
post #83
post #60

Earlier quoted context omitted.

...what? 60 thousand dollars for a dedicated computer that you can't use is not everyone, not on their own computers, and is also a crazy large amount of money for nearly everyone. Sure there are some that could, but that's not what I said.

Plus, that's the energy costs involved when running a computer now worth 60k, I'm pretty sure that in the current socio-economic climate those power costs will surpass the initial acquisition cost (those 60k, that is) pretty easily.

An 80GB nvidia A100 goes for $20k and uses 300 watts, the energy costs of using one (or three) isn’t going to surpass the hardware costs for… a while.
Post reply on HN