Live data from Hacker News

YaLM-100B: Pretrained language model with 100B parameters

github.com

511–520 of 666 posts

Re: YaLM-100B: Pretrained language model with 100B parameters

#511

Earlier quoted context omitted.

Basically they've taken a step further with censorship of all media not controlled by government which at the time (2014) couldn't been penalized whatsoever.

And what if they hadn't?

"Couldn't be penalized whatsoever" wasn't enough? In broader view, government could start taking hostages like they did with Google last December, but that wouldn't help reaching the goal even a small bit back then since there was no leverage on technical side of things.

Re: YaLM-100B: Pretrained language model with 100B parameters

#512
post #368

Earlier quoted context omitted.

Case in point: recently, I've noticed that I'm getting more and more emails with the sign off "Warm regards." This is not a coincidence. It is an autosuggestion from Google. If you start signing off an email, it will automatically suggest "Warm regards." It just appears there -- probably an idea generated from an AI network. There are more and more of these algorithmic "suggestions" appearing every day, in more and m…

Those suggestions are very few so I suspect they were hand-picked.

Doesn't GMail collect the data in some form of federated learning nowadays, like GBoard does? Federated learning does seem to be able to create the unintended positive feedback loop, converging on a single phrase and causing the users to lock themselves in a bubble.

Re: YaLM-100B: Pretrained language model with 100B parameters

#513
post #490
post #2

I hope one day it will be possible to run this kind of models at home.

Speaking of which... I built a gaming PC a few years ago but I never use it these days. I want to install Linux on it and start playing around with machine learning. Can anyone recommend any open source machine learning project that would be a good starting point? I want one that does something interesting (whether using text, images, whatever), but simple/efficient enough to run on a gaming PC and see some kind of r…

I would recommend auditing Stanford courses in following order:

1. CS231n Machine Vision https://www.youtube.com/playlist?list=PLkt2uSq6rBVctENoVBg1T...

2. CS234 Reinforcement Learning https://www.youtube.com/watch?v=FgzM3zpZ55o&list=PLoROMvodv4...

3. CS330 Meta Learning https://www.youtube.com/watch?v=0rZtSwNOTQo&list=PLoROMvodv4...

Those will get you on track with general concepts about reasoning, AI engineering and concepts of learning itself

Language models for me a bit of headache because there're in different domain on intersection with linguistics and humanities but here's a good course

https://www.youtube.com/watch?v=rha64cQRLs8&list=PLoROMvodv4...

Those are all free and high-quality but require a lot of brain power

Re: YaLM-100B: Pretrained language model with 100B parameters

#514
post #456

To add a voice of skepticism. The recent rush to open source these models may be indicative that the tens of millions that’s spent training these things has relatively poor roi. There may be a hope that someone else figures out how to make these commercially useful.

We're using these at where I work (large retail site) to help make filler text on generated articles. Think the summary blurb no one reads at the top. As for why we're writing these articles (we have a paid team that writes them too), the answer is SEO. This is probably the only thing I've seen done with a text model in production usage. I'm not 100% sure what model they're using.

I hate this so much. These tools are getting better, so often you realise only half way through that you are reading AI text. Then you have to flush your brain and take a mental note, to never visit that site again.

Re: YaLM-100B: Pretrained language model with 100B parameters

#515
post #98

Earlier quoted context omitted.

Care to elaborate?

There is lots of content Google bans/hides. Copyrighted content, Adult content, child pornography, official secrets, etc. I don't think thats so different from other countries which also have a (partially overlapping) list of whats not allowed. Normally, when people think about that they say "well pictures of naked children are morally wrong, whereas talking about LGBTQ stuff is fine". But people in other parts of th…

[deleted]

Re: YaLM-100B: Pretrained language model with 100B parameters

#516
post #433

Earlier quoted context omitted.

Unmasked as a shill for saying that great powers engage in propaganda, false flagging and dissent crushing. I have no skin in the game. War, no war, it doesn't matter to me the outcome of this war to be honest. EDIT: But if you are all moral highground, answer me this: Why did the US goad Ukraine into taking a hostile stance against a neighbouring (and somewhat rival) great power? Whas this to the interest of Ukrania…

I don't accept that you can make this case: "Why did you, W, goad X into expressing their sovereignty against Y? Didn't you know that Y would react with violence? That makes W the bad guy" No, Y is always on the wrong side; you can't use the threat of violence and then claim via realpolitik that the other side was in the wrong. "Moral high ground" means you act out of principle, not political convenience. In this cas…

what I meant for the goading part was this:

Ukraine has self interests. Everyone has. But not everyone can actualize those, due to reality. The reality is that Ukraine neighbours a powerful hegemon.

Since international relations are anarchistic (due to not being a supra-entity that has authority over states [authority!=international courts bullsh*]), Ukraine hasn't any right (to its sovereign, that does not exist) to be sovereign. It has to go out and look for itself.

Ukraine thought that had the US/NATO back, that made it act in a more reckless way (kind of when you rely on your big brother type stuff). It escalated 'till it decided it wanted to join NATO. It was goaded.

>you can't use the threat of violence and then claim via realpolitik that the other side was in the wrong.

who says? That's your problem. You lack the 'anarchistic' framework of geopolitics.

Now, realpolitik-wise, Ukraine's self-interests (of being more independent of Russia thru NATO) did clash with Russia's self-interests of being safe (and probably made Russia have a expansionary Casus Belli).

I feel that the US triggered and amplified the war, thru regime change in Ukraine (yep, maidan was a coup), recognizing aspirations of UA to NATO, making Zeleskyy too comfy to be more harsh in negotiations (where he had no leverage, cuz Ukraine's power small vs Rus.), ultimately resulted in unnecessary deaths, just for the purpose of sphere of influence expansion.

>so we supported them.

Even if it's reckless and could trigger something like this?

Also, I will play the 'reversed roles card' again. This time with a REAL example. Cuba. Was. The. Same. Thing.

That's why this https://en.wikipedia.org/wiki/Operation_Northwoods and this https://en.wikipedia.org/wiki/Monroe_Doctrine.

US has the same pattern as Russia. It's actually incredible how close these are.

Re: YaLM-100B: Pretrained language model with 100B parameters

#517

Earlier quoted context omitted.

> Take down Russia protest vote app or go to prison What about Canadian truckers? Didn't Trudeau call them terrorists, took their trucks, donations, bank accounts and driver licenses... There is no right to protest anywhere, don't kid yourself.

The Canadian truck protesters were allowed to shut down the center of the city, blast their horns 24 hours a day, and shut down a major international trade route. They were permitted to do this for weeks before the citizens got sick of it and demanded action from their government. They gave protest a bad name. Your conclusion that "There is no right to protest anywhere" is simply ridiculous.

>Your conclusion that "There is no right to protest anywhere" is simply ridiculous.

BLM rioters did this, and more. Violence + Property damage + Corporate Backing + gov backing. They didn't had their donation money seized,and almost no resistance to establish order.

Re: YaLM-100B: Pretrained language model with 100B parameters

#518

Earlier quoted context omitted.

We're using these at where I work (large retail site) to help make filler text on generated articles. Think the summary blurb no one reads at the top. As for why we're writing these articles (we have a paid team that writes them too), the answer is SEO. This is probably the only thing I've seen done with a text model in production usage. I'm not 100% sure what model they're using.

Content made for machines. Probably a billion dollar industry.

Content made for machines serving humans made by machines pretending to be human

Re: YaLM-100B: Pretrained language model with 100B parameters

#519
post #447

Earlier quoted context omitted.

Literally what google doing in favor of USA.

I would assume this could go unsaid, but apparently it needs to be said somewhere in this thread: there is zero comparison between the US and an autocratic dictator who attempts to kill and then jails his opposition, runs fraudulent elections, kills journalists, and invades sovereign countries. Zero. None. Zero. Zero. Get it? None. Zero.

I mean, if your only criteria is the intensity of the quality, then kinda.

But... :

(persecuted journalist)

>https://www.bbc.com/news/uk-61839256

>https://www.amnesty.org/en/latest/news/2013/07/usa-must-not-...

(jails its opposition)

>https://eu.usatoday.com/storytelling/capitol-riot-mob-arrest...

>"hatespeech" (newspeak)

>fraudulent elections: funny how the concerns that 'half' of the US had with elections were dismissed. Especially when conditions were different, by using a method usually agreed (until now, cuz narrative) prone to tampering. So much for free and fair elections.

So _Zero_ huh?

Re: YaLM-100B: Pretrained language model with 100B parameters

#520
post #273

Earlier quoted context omitted.

Every company out there says it will "revoke API access for misuse", but do they have transparency reports? Who do they even consider bad guys and what do they consider as misuse? I would be totally on their side if their reasoning was that they dont publish models to compete with FAANG more efficiently and get more income for their research, but this moral reasoning just sounds completely fake because bad actors do…

OpenAI published "Lessons Learned on Language Model Safety and Misuse" in March. https://openai.com/blog/language-model-safety-and-misuse/ It also promised "forthcoming publication". Examples of "real cases of misuse encountered in the wild" include "spam promotions for dubious medical products and roleplaying of racist fantasies". Yes, some bad actors can train their own models, but OpenAI can't do much about that e…

It would be better for misuse to be criminalized and taken care of by national governments, rather than leave it to for-profit companies to decide what is or isn't "misuse".

Personally, I think using AI to manufacture advertisements on demand is misuse... but will Google agree with me?

Post reply on HN