Live data from Hacker News

YaLM-100B: Pretrained language model with 100B parameters

github.com

241–250 of 666 posts

Re: YaLM-100B: Pretrained language model with 100B parameters

#241
post #21

Seeing those gigantic models it makes me sad that even the 4090 is supposed to stay at 24GB of RAM max. I really would like to be able to run/experiment on larger models at home.

Take a look at Apple's M1 Max, a lot of fast unified memory. No idea how useful though

Unified memory is and always has been a cost cutting tactic. Its not a feature not matter how much manufacturers who use it try to claim it is.

Re: YaLM-100B: Pretrained language model with 100B parameters

#242
post #173

Earlier quoted context omitted.

Bad comment. First, can you please name the founder? Because according to wiki Ilya Segalovich never lived in Israel and Arkady_Volozh lives in Tel Aviv (Not a settlement). Both Jewish, so why present it as some "must-be-hidden-cause" connection with Israel? Also, nothing shady from Israel side in term of sanctions. They have a large Jewish community in both Russia and Ukraine and need to be on good term with both to…

Many people consider all of Israel to be an illegitimate Western colonial settler state in the Middle East.

Then they have some explaining to do. As they are very wrong, from a historical/archaeological point view [1].

[1] https://en.wikipedia.org/wiki/History_of_the_Jews_and_Judais...

Re: YaLM-100B: Pretrained language model with 100B parameters

#243
post #202

Earlier quoted context omitted.

Yandex Image Search is today is what Google Image Search should have been. End of the day I’ll use what actually gets the job done. Same goes for OpenAI and Google AI. If you don’t actually ever release and let others use your stuff and end paralyzed in fear at what your models may do then someone else is gonna release the same tech, and at this rate it seems like that’ll be Chinese or Russian companies who don’t sha…

OpenAI should just rebrand since nothing they do is actually open.

You know 100 years ago you could just buy uranium openly? Leo Szílard hustled up 200 kilograms, pleted, in the 30's.

Re: YaLM-100B: Pretrained language model with 100B parameters

#244
post #173

Quoted post unavailable.

Bad comment. First, can you please name the founder? Because according to wiki Ilya Segalovich never lived in Israel and Arkady_Volozh lives in Tel Aviv (Not a settlement). Both Jewish, so why present it as some "must-be-hidden-cause" connection with Israel? Also, nothing shady from Israel side in term of sanctions. They have a large Jewish community in both Russia and Ukraine and need to be on good term with both to…

> Bad comment.

>> Be kind. Don't be snarky. Have curious conversation; don't cross-examine. Please don't fulminate. Please don't sneer, including at the rest of the community.

Re: YaLM-100B: Pretrained language model with 100B parameters

#245

Earlier quoted context omitted.

Settling land that was recently taken from Palestinian families by force, often (literally) knocking the existing houses over with a bulldozer. In my opinion, that's a moral red flag to participate in such an atrocity.

Have you seen what America has done in the Middle East the last 20 years? If you want to make a moral point then you should start there instead of trying to grind whatever axe you have against Israel.

Why does it have to be mutually exclusive? The thread is about Israel, so they're pointing out Israel's crimes. You can be critical of multiple governments simultaneously.

Re: YaLM-100B: Pretrained language model with 100B parameters

#246
post #174

Earlier quoted context omitted.

Yeah we definitely shouldn't worry about the political sympathies/vulnerabilities of the web services we use as the foundations of our shared knowledge...

Do you have the same level of concern about the leverage Five-Eyes intelligence agencies have over Facebook and Google?

There's a world of difference between Five-Eyes and being harrassed, mobbed, jailed, having a "Z" and "traitor" spray painted on your apartment door or being murdered.

By conflating those two clearly means you don't understand what's going on Russia and its Putin-controlled satellites like Belarus.

Re: YaLM-100B: Pretrained language model with 100B parameters

#247
post #13

I have to wonder if 10 years down the line, everyone will be able to run models like this on their own computers. Have to wonder what the knock-on effects of that will be, especially if the models improve drastically. With so much of our social lives being moved online, if we have the easy ability to create fake lives of fake people one has to wonder what's real and what isn't. Maybe the dead internet theory will rea…

There’s a very simple solution, of course: turn off the computer and physically interact with real people.

Re: YaLM-100B: Pretrained language model with 100B parameters

#248
post #174

Earlier quoted context omitted.

Yeah we definitely shouldn't worry about the political sympathies/vulnerabilities of the web services we use as the foundations of our shared knowledge...

How do you feel about western-owned web services?

People in Russia felt much safer using iCloud, Gmail or Google Drive. Of course they comply to some requests by Kremlin or police. But Yandex or VK just give information straight away often times without much procedure.

Re: YaLM-100B: Pretrained language model with 100B parameters

#249
post #202

Earlier quoted context omitted.

OpenAI should just rebrand since nothing they do is actually open.

You know 100 years ago you could just buy uranium openly? Leo Szílard hustled up 200 kilograms, pleted, in the 30's.

What does it have to do with OpenAI branding?

Their "moral" reasoning behind not publishing models is simply laughtable because they do sell API access to them to anyone who can pay. And "bad guys" generally have money.

Re: YaLM-100B: Pretrained language model with 100B parameters

#250
post #38

Earlier quoted context omitted.

If you want to define punishment like that, it is your call. In my opinion it is not punishment to stop a relationship if the basis of that relationship was destroyed deliberately by one side.

I don't define it, it's exactly the official definition, like it or not: > punishment: the infliction or imposition of a penalty as retribution for an offence. Then you can play all you want with language to make it say what you'd like but it's pointless.

An "offence" as defined in a criminal code? Two countries don't share a criminal code AFAIK.
Post reply on HN