Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

YaLM-100B: Pretrained language model with 100B parameters

github.com

Post reply on HN
Print view View original

161–170 of 666 posts

Re: YaLM-100B: Pretrained language model with 100B parameters

#161

Post by whywhywhywhy »

pembrook wrote: post #138

Side note: Yandex search is awesome, and I really hope they stay alive forever. It's the only functional image search nowadays, after our Google overlords neutered their own product out of fear over lawyers/regulation and a disdain for power users. You can't even search for images "before:date" in Google anymore.

Yandex Image Search is today is what Google Image Search should have been.

End of the day I’ll use what actually gets the job done.

Same goes for OpenAI and Google AI. If you don’t actually ever release and let others use your stuff and end paralyzed in fear at what your models may do then someone else is gonna release the same tech, and at this rate it seems like that’ll be Chinese or Russian companies who don’t share your sensibilities at all, and their models will be the ones that end up productized.

Re: YaLM-100B: Pretrained language model with 100B parameters

#162

Post by alexpotato »

Hendrikto wrote: post #3
schizo89 wrote: post #2

I hope one day it will be possible to run this kind of models at home.

If you live in a datacenter, it already is!

You already have access to thousands of machine now from your home computer.

Naval Ravikant put it best here: https://twitter.com/naval/status/1002106977273565184

Re: YaLM-100B: Pretrained language model with 100B parameters

#165

Post by pastacacioepepe »

toyg wrote: post #45
f6v wrote: post #8

Earlier quoted context omitted.

The achievements aren’t in any way tainted by their nationality, citizenship, sex, sexual orientation, age, etc.

Well... I'm sorry if I reach for the reductio at Hitlerum, but any achievements Nazi scientists might have reached in concentration camps are definitely tainted. Similarly, achievements in the field of online consumer analysis in a country where consumer-privacy protections are nonexistent, surely should be considered tainted...?

Wow. Yes you should have refrained from this. You are comparing Nazi scientists who killed many innocents to some software engineers working on a cool project and releasing it for free to the world.

What is your problem?

Re: YaLM-100B: Pretrained language model with 100B parameters

#166

Post by dmpk2k »

lotusmars wrote: post #145
FpUser wrote: post #141

Earlier quoted context omitted.

>""Oh yes I don't support my government, but you know these arrests, I'd rather stay in my cosy home and enjoy my tea." Why are you so surprised? This is exactly how most of the population behaves everywhere. People go about their business and "support" criminal actions of their governments all the time. This includes the West. Our governments have no problems exterminating, starving and displacing people (as long as…

> Our governments have no problems exterminating, starving and displacing people It's high time to bring "but US bombed Iraq". Classic playbook.

And yet it is still true.

Re: YaLM-100B: Pretrained language model with 100B parameters

#167

Post by SXX »

First of all regardless for political situation this is great step in making ML research actually open. So huge thanks for those developers who pushed to make it public. Still...

Yandex is in fact share responsibility for Russian government actions. While it impossible to fight censorship they could certainly shut down their News service completely.

Yandex could also certainly move more of their company and staff out of country. It was their deliberate choice stay in Russia and getting advantages on local market by using their political weight.

Re: YaLM-100B: Pretrained language model with 100B parameters

#169

Post by htrp »

> It was tested on 4 (A100 80g) and 8 (V100 32g) GPUs, but is able to work with different configurations with ≈200GB of GPU memory in total which divide weight dimensions correctly (e.g. 16, 64, 128).

so we looking at crazy prices just for inference. RIP to the first guy's cloud billing account who makes this public

Re: YaLM-100B: Pretrained language model with 100B parameters

#170

Post by lotusmars »

dmpk2k wrote: post #166
lotusmars wrote: post #145

Earlier quoted context omitted.

> Our governments have no problems exterminating, starving and displacing people It's high time to bring "but US bombed Iraq". Classic playbook.

And yet it is still true.

Americans just love to talk about themselves. Who cares about Russians under Putin's oppression or Ukrainians being exterminated. Let's talk about your government, Bush, Trump and Google.
Post reply on HN