Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

YaLM-100B: Pretrained language model with 100B parameters

github.com

Post reply on HN
Print view View original

381–390 of 666 posts

Re: YaLM-100B: Pretrained language model with 100B parameters

#381

Post by ma2rten »

I am one of the people who worked on Google's PaLM model.

Having skimmed the GitHub readme and medium article, this announcement seems to be very focused on the number of parameters and engineering challenges scaling the model, but it does not contain any details about the model, training (learning rate schedules, etc.), or data composition.

It is great that more models are getting released publicly, but I would not get excited about it before some evaluations have been published. Having a lot of parameters should not be a goal in and of itself. For all we know this model is not well trained and worse than Eleuther AI's 20B parameter model, while also being inconveniently large.

Re: YaLM-100B: Pretrained language model with 100B parameters

#384

Post by joshsyn »

bgandrew wrote: post #155
kome wrote: post #139

I agree, yandex is a great search engine

no it's not. they straight up serve kremlin, promoting kremlin fake news and silencing russian opposition (not much to silence but still). they can have whatever functionality they like, I still won't use it in billion years.

What a hyperbolic emotional liar incapable of reasoning...

Re: YaLM-100B: Pretrained language model with 100B parameters

#385

Post by javajosh »

ma2rten wrote: post #381

I am one of the people who worked on Google's PaLM model. Having skimmed the GitHub readme and medium article, this announcement seems to be very focused on the number of parameters and engineering challenges scaling the model, but it does not contain any details about the model, training (learning rate schedules, etc.), or data composition. It is great that more models are getting released publicly, but I would not…

> this announcement seems to very focused on number of parameters

And yet your own project headline is "Pathways Language Model (PaLM): Scaling to 540 Billion Parameters for Breakthrough Performance"[0].

0-https://ai.googleblog.com/2022/04/pathways-language-model-pa...

Re: YaLM-100B: Pretrained language model with 100B parameters

#386

Post by ginjas »

bpodgursky wrote: post #373
waffleiron wrote: post #337

Earlier quoted context omitted.

> you don't have FBI agents knocking on your door threatening you with prison. Correct, it's DHS. https://twitter.com/_secondthought/status/133274617257067725...

You know people online can just say things, right?

No post body was provided.

Re: YaLM-100B: Pretrained language model with 100B parameters

#387

Post by joshsyn »

lotusmars wrote: post #208
ushakov wrote: post #198

Earlier quoted context omitted.

can you name any Russian company that doesn't? obeying to Kremlin is just an aspect of running business in Russia the only option would be not to operate in Russia at all. Yandex can't do this, because their audience is primarily in Russia

Well they've made their choice and silenced our protest and opposition, and later spewed pro-war anti-Ukrainian propaganda using country's largest media (Yandex News). If you're profiteering from our suffering and choose Kremlin's needs over ours, don't be suprised then when we tell you to shove your AI models and your search.

Who's we? I am not in this together. So change it to "I". I don't care about you lot... lmao

Re: YaLM-100B: Pretrained language model with 100B parameters

#388

Post by yoyopa »

alephxyz wrote: post #336
boplicity wrote: post #314

Earlier quoted context omitted.

Case in point: recently, I've noticed that I'm getting more and more emails with the sign off "Warm regards." This is not a coincidence. It is an autosuggestion from Google. If you start signing off an email, it will automatically suggest "Warm regards." It just appears there -- probably an idea generated from an AI network. There are more and more of these algorithmic "suggestions" appearing every day, in more and m…

Those suggestions appear in Google chat too and even if you don't click on them, the simple fact of reading the suggestion makes you much more likely to type it yourself. There's clearly a priming effect to it.

depends on your personality
Post reply on HN