YaLM-100B: Pretrained language model with 100B parameters • Hacker News Board

Re: YaLM-100B: Pretrained language model with 100B parameters

#451

Post by [deleted] » Thu, Jun 23, 2022, 4:25 PM UTC

dav_Oz wrote: post #150

alexb_ wrote: post #13

I have to wonder if 10 years down the line, everyone will be able to run models like this on their own computers. Have to wonder what the knock-on effects of that will be, especially if the models improve drastically. With so much of our social lives being moved online, if we have the easy ability to create fake lives of fake people one has to wonder what's real and what isn't. Maybe the dead internet theory will rea…

The bots/machine vs human reminds me of that famous experiment from the 30s in which Winthrop Kellogg[0], a comparative psychologist, and his wife decided to raise their human baby (Donald) simultaneously with a chimpanzee baby (Gua) in an effort to "humanize the ape". It was set out to last 5 years but was relatively quickly abrupted after only 9 months. The explicit reason wasn't stated only that it successfully pr…

[deleted]

Re: YaLM-100B: Pretrained language model with 100B parameters

#452

Post by jcelerier » Thu, Jun 23, 2022, 4:26 PM UTC

yoyopa wrote: post #388

alephxyz wrote: post #336

Earlier quoted context omitted.

Those suggestions appear in Google chat too and even if you don't click on them, the simple fact of reading the suggestion makes you much more likely to type it yourself. There's clearly a priming effect to it.

depends on your personality

nope, just being exposed to text influences you whether you want it or not

Re: YaLM-100B: Pretrained language model with 100B parameters

#453

Post by alcover » Thu, Jun 23, 2022, 4:26 PM UTC

dav_Oz wrote: post #150

alexb_ wrote: post #13

I have to wonder if 10 years down the line, everyone will be able to run models like this on their own computers. Have to wonder what the knock-on effects of that will be, especially if the models improve drastically. With so much of our social lives being moved online, if we have the easy ability to create fake lives of fake people one has to wonder what's real and what isn't. Maybe the dead internet theory will rea…

The bots/machine vs human reminds me of that famous experiment from the 30s in which Winthrop Kellogg[0], a comparative psychologist, and his wife decided to raise their human baby (Donald) simultaneously with a chimpanzee baby (Gua) in an effort to "humanize the ape". It was set out to last 5 years but was relatively quickly abrupted after only 9 months. The explicit reason wasn't stated only that it successfully pr…

Nice post! But to me your analogy does not really stand : bots are the ones catching up with human conversation in an "accelerated way", feeding on a corpus that predates them. Bots are not an invariant nature that netizens imitate.

Re: YaLM-100B: Pretrained language model with 100B parameters

#454

Post by marshray » Thu, Jun 23, 2022, 4:28 PM UTC

capdeck wrote: post #374

nosianu wrote: post #322

Earlier quoted context omitted.

I doubt that anything like this happend to Google execs in the US: "Putin's agents reportedly threatened a top Google executive in Moscow with a 24-hour ultimatum – Take down Russia protest vote app or go to prison" -- https://www.businessinsider.com/russia-agents-threatened-goo... Not yet at least, the political climate may deteriorate to that point, especially when it's about elections, given recent revelations. St…

> Take down Russia protest vote app or go to prison What about Canadian truckers? Didn't Trudeau call them terrorists, took their trucks, donations, bank accounts and driver licenses... There is no right to protest anywhere, don't kid yourself.

The Canadian truck protesters were allowed to shut down the center of the city, blast their horns 24 hours a day, and shut down a major international trade route. They were permitted to do this for weeks before the citizens got sick of it and demanded action from their government.

They gave protest a bad name.

Your conclusion that "There is no right to protest anywhere" is simply ridiculous.

Re: YaLM-100B: Pretrained language model with 100B parameters

#455

Post by marshray » Thu, Jun 23, 2022, 4:30 PM UTC

colordrops wrote: post #367

lotusmars wrote: post #246

Earlier quoted context omitted.

There's a world of difference between Five-Eyes and being harrassed, mobbed, jailed, having a "Z" and "traitor" spray painted on your apartment door or being murdered. By conflating those two clearly means you don't understand what's going on Russia and its Putin-controlled satellites like Belarus.

Julian Assange anyone? Gary Webb? Michael Hastings? And you've got Abby Martin and Chris Hedges who've had much of their content removed by YouTube. Chris Hedges is even a Pulitzer prize winner.

You've named three people, and some YouTube videos.

On the other side, the FSB has deported 1.3 million innocent Ukrainian civilians to concentration camps. (number is from official Russian sources)

Re: YaLM-100B: Pretrained language model with 100B parameters

#456

Post by lumost » Thu, Jun 23, 2022, 4:31 PM UTC

To add a voice of skepticism. The recent rush to open source these models may be indicative that the tens of millions that’s spent training these things has relatively poor roi. There may be a hope that someone else figures out how to make these commercially useful.

Re: YaLM-100B: Pretrained language model with 100B parameters

#457

Post by Izkata » Thu, Jun 23, 2022, 4:37 PM UTC

jcelerier wrote: post #452

yoyopa wrote: post #388

Earlier quoted context omitted.

depends on your personality

nope, just being exposed to text influences you whether you want it or not

They're saying it might influence you to type something different. Some of us are just contrary.

Re: YaLM-100B: Pretrained language model with 100B parameters

#458

Post by bgroat » Thu, Jun 23, 2022, 4:42 PM UTC

AlecSchueler wrote: post #416

yoyopa wrote: post #388

Earlier quoted context omitted.

depends on your personality

On average, it doesn't. This is why advertising and magic work.

I'm a magician and a developer by training.

Now primarily employed in a marketing capacity.

Over my career I've worked with: - Doctors - Lawyers - Engineers - Fund managers - Academics (hard and soft sciences) - Mentalists/Hypnotists

All of them believed that they're specific training and temperament made them immune from simple persuasion techniques and that they were purely rational actors.

None of them struck me as any more rational/more independent thinkers than anyone else off the street

Re: YaLM-100B: Pretrained language model with 100B parameters

#459

Post by bgroat » Thu, Jun 23, 2022, 4:43 PM UTC

rexpop wrote: post #446

freewizard wrote: post #285

Earlier quoted context omitted.

So maybe the Turing Test is not about AI are smart enough, but about how stupid humans become?

Not stupid; imaginative and agreeable.

These are also the elements that make a good hypnosis subject.

I can't put a dumb person under.

I need someone with an active imagination who wants to work with me (for best results)

Re: YaLM-100B: Pretrained language model with 100B parameters

#460

Post by mumblemumble » Thu, Jun 23, 2022, 4:44 PM UTC

lumost wrote: post #456

To add a voice of skepticism. The recent rush to open source these models may be indicative that the tens of millions that’s spent training these things has relatively poor roi. There may be a hope that someone else figures out how to make these commercially useful.

From what I've seen, using these huge models for inference at any kind of scale is expensive enough that it's difficult to find a business case that justifies the compute cost.