YaLM-100B: Pretrained language model with 100B parameters

Post by wellthisisgreat » Thu, Jun 23, 2022, 1:50 PM UTC

espadrine wrote: post #50

alexb_ wrote: post #13

I have to wonder if 10 years down the line, everyone will be able to run models like this on their own computers. Have to wonder what the knock-on effects of that will be, especially if the models improve drastically. With so much of our social lives being moved online, if we have the easy ability to create fake lives of fake people one has to wonder what's real and what isn't. Maybe the dead internet theory will rea…

> I have to wonder if 10 years down the line, everyone will be able to run models like this on their own computers. Isn’t that already the case? Sure, it costs $60K, but that is accessible to a surprisingly large minority, considering the potency of this software.

Post by obituary_latte » Thu, Jun 23, 2022, 1:50 PM UTC

Post by theblazehen » Thu, Jun 23, 2022, 1:52 PM UTC

wongarsu wrote: post #75

jstimpfle wrote: post #42

Earlier quoted context omitted.

Is there a reason why it is required to fill the swapfile with zeroes here? Normally you'd see something like "dd of=/swapfile bs=1G seek=3 count=0", creating a file of size 3G but with no space allocated (yet). It's much quicker to complete the setup this way.

I assume if you force the file system to allocate inodes you are likely to have a less fragmented file than if you create a sparse file that gets inodes assigned over time when each part is used.

Post by pfortuny » Thu, Jun 23, 2022, 1:54 PM UTC

ask_b123 wrote: post #180

pfortuny wrote: post #25

Earlier quoted context omitted.

The achievements cannot be tainted. Kolmogorov complexity is (I hope) untainted. Also, Hilbert’s problems are not untainted (and he never flew Nazi Germany!).

I think the correct word might be fled -> he never fled.

Post by tomp » Thu, Jun 23, 2022, 1:56 PM UTC

SXX wrote: post #167

First of all regardless for political situation this is great step in making ML research actually open. So huge thanks for those developers who pushed to make it public. Still... Yandex is in fact share responsibility for Russian government actions. While it impossible to fight censorship they could certainly shut down their News service completely. Yandex could also certainly move more of their company and staff out…