Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

YaLM-100B: Pretrained language model with 100B parameters

github.com

Post reply on HN
Print view View original

371–380 of 666 posts

Re: YaLM-100B: Pretrained language model with 100B parameters

#371

Post by omniglottal »

thereddaikon wrote: post #228
hdjjhhvvhga wrote: post #175

Earlier quoted context omitted.

> Google overlords neutered their own product out of fear over lawyers/regulation What kind of lawyers/regulation do you have in mind? If anything, I'd find the opposite: lawyers and copyright holders should be grateful for such a tool that - when it was still working - allowed you to trace websites using your images illegally. Now they all use Yandex for this purpose, with relatively good results.

IIRC it was mostly from groups like Getty images. They and other image licensing companies didn't want google showing their images in search results. They claimed it was copyright infringement and given the absolute state of IP law in the US they could have made Google's life very difficult.

Couldn't compliance with a robots.txt file have prevented all of this?

Re: YaLM-100B: Pretrained language model with 100B parameters

#372

Post by roenxi »

nosianu wrote: post #322
afroboy wrote: post #265

Earlier quoted context omitted.

Literally what google doing in favor of USA.

I doubt that anything like this happend to Google execs in the US: "Putin's agents reportedly threatened a top Google executive in Moscow with a 24-hour ultimatum – Take down Russia protest vote app or go to prison" -- https://www.businessinsider.com/russia-agents-threatened-goo... Not yet at least, the political climate may deteriorate to that point, especially when it's about elections, given recent revelations. St…

> I doubt that anything like this happend to Google execs in the US:

It seems plausible; we don't know what gets done under the FISA court but it would presumably involve companies like Google. Some suited agent of the US government turning up at Google HQ and threatening jail time under some FISA warrant if some pro-Trump something doesn't disappear off Google.

That'd be a scandal but not the worst abuse of the secret court system. It hasn't exactly covered itself with glory since inception. They already spy on basically everyone and that is a lot worse than some light censorship.

Re: YaLM-100B: Pretrained language model with 100B parameters

#373

Post by bpodgursky »

waffleiron wrote: post #337
nosianu wrote: post #322

Earlier quoted context omitted.

I doubt that anything like this happend to Google execs in the US: "Putin's agents reportedly threatened a top Google executive in Moscow with a 24-hour ultimatum – Take down Russia protest vote app or go to prison" -- https://www.businessinsider.com/russia-agents-threatened-goo... Not yet at least, the political climate may deteriorate to that point, especially when it's about elections, given recent revelations. St…

> you don't have FBI agents knocking on your door threatening you with prison. Correct, it's DHS. https://twitter.com/_secondthought/status/133274617257067725...

You know people online can just say things, right?

Re: YaLM-100B: Pretrained language model with 100B parameters

#374

Post by capdeck »

nosianu wrote: post #322
afroboy wrote: post #265

Earlier quoted context omitted.

Literally what google doing in favor of USA.

I doubt that anything like this happend to Google execs in the US: "Putin's agents reportedly threatened a top Google executive in Moscow with a 24-hour ultimatum – Take down Russia protest vote app or go to prison" -- https://www.businessinsider.com/russia-agents-threatened-goo... Not yet at least, the political climate may deteriorate to that point, especially when it's about elections, given recent revelations. St…

> Take down Russia protest vote app or go to prison

What about Canadian truckers? Didn't Trudeau call them terrorists, took their trucks, donations, bank accounts and driver licenses... There is no right to protest anywhere, don't kid yourself.

Re: YaLM-100B: Pretrained language model with 100B parameters

#375

Post by colechristensen »

paganel wrote: post #352
colechristensen wrote: post #280

Earlier quoted context omitted.

An 80GB nvidia A100 goes for $20k and uses 300 watts, the energy costs of using one (or three) isn’t going to surpass the hardware costs for… a while.

I wanted to add that I was writing it metaphorically in a way, as in, seeing as how high those energy bills will be they might as well all add up to 60k. Not sure about most of the people in here, but I would get really nervous at the thought of running something that eats up 3x300 watts per hour, for 24/7, just as part of a personal/hobby project. The incoming power bills would be too high, you have to be in the wag…

At full power 3 of those would cost me ~$3.50 per day ($0.15 per kWh is what I paid for last month's electricity, though I could pay less if I made some difference choices), I occasionally have a more expensive coffee order, or have a cocktail worth three times as much.

Things are getting more expensive here but nothing like the situation in Europe (essentially none of our energy was imported from Russia, historically ~10% of oil imports but that was mostly to refine and re-export, we have all the natural gas locally that we need) The US crossed the line into being a net hyrdocarbon energy exporter a while ago (unsure what the case is recently but it is at worst about at parity)

Re: YaLM-100B: Pretrained language model with 100B parameters

#376

Post by JacobThreeThree »

remram wrote: post #316
daniel-cussen wrote: post #243

Earlier quoted context omitted.

You know 100 years ago you could just buy uranium openly? Leo Szílard hustled up 200 kilograms, pleted, in the 30's.

Maybe they should rename to SafeAI, if their concern is controlling access.

Good point. The issue is not the policy per se, it's the fact that their name is not accurate.

Re: YaLM-100B: Pretrained language model with 100B parameters

#377

Post by visarga »

tablespoon wrote: post #330
323 wrote: post #235

Earlier quoted context omitted.

You misunderstood parent post. It's about Google not being sued for discrimination. https://www.washingtonpost.com/news/the-intersect/wp/2016/08... https://www.theguardian.com/technology/2016/apr/08/does-goog... https://www.bloomberg.com/news/articles/2021-10-19/google-qu... https://theconversation.com/googles-algorithms-discriminate-...

> You misunderstood parent post. It's about Google not being sued for discrimination. Who's suing them and on what grounds? If they made changes, it's probably for PR reasons, not legal ones. Also not all of these seem "fixed" e.g.: > https://www.theguardian.com/technology/2016/apr/08/does-goog... Article from 2016, but results look very similar today: https://www.google.com/search?q=unprofessional+hair&source=l...

They used to have in their AI ethics department some of the most anti-AI progressives. They picked on everything - biased training data, discriminatory usage, consuming too much energy to train, models are just stochastic parrots, etc. while forgetting to mention any effort to mitigate the problems (of course these are real concerns and being under intense research) Now these critics are fired, but Google must have learned to fear them.

If they let everyone use the latest models, critics could uncover ugly biases in 10 minutes. Then Google would have to do damage control. These models are very suggestible. You can induce them to make fools of themselves.

Re: YaLM-100B: Pretrained language model with 100B parameters

#378

Post by prometheus76 »

sanxiyn wrote: post #315
ggktk wrote: post #272

Earlier quoted context omitted.

Bad actors still can get access to such models. It even makes them more dangerous than it would if everyone had access to them. Here's an alternative: progressively release better and better models (like 3B params, 10B, 50B, 100B) and let people figure out the best way to fight against bad actors using them.

> It even makes them more dangerous than it would if everyone had access to them. This is the sort of argument that proves guns would be less dangerous if everyone had access to them.

"An armed society is a polite society" - Robert Heinlein

Re: YaLM-100B: Pretrained language model with 100B parameters

#379

Post by turdit »

honkler wrote: post #281
relaunched wrote: post #271

Earlier quoted context omitted.

Huge difference. Google does it for money. Yandex does it to enable an autocracy and to maintain their ability to operate.

and how do you know google does not do it to maintain their ability to operate? That's the whole point of deep state, no?

No post body was provided.

Re: YaLM-100B: Pretrained language model with 100B parameters

#380

Post by waffleiron »

bpodgursky wrote: post #373
waffleiron wrote: post #337

Earlier quoted context omitted.

> you don't have FBI agents knocking on your door threatening you with prison. Correct, it's DHS. https://twitter.com/_secondthought/status/133274617257067725...

You know people online can just say things, right?

I don’t think it’s that far fetched that DHS shows up to someone who is opposed to the US government and is a self identifying communist.

The same DHS who bans immigrants that are or have been members of a communist party [1].

[1] https://www.uscis.gov/sites/default/files/document/policy-ma...

Post reply on HN