Live data from Hacker News

YaLM-100B: Pretrained language model with 100B parameters

github.com

331–340 of 666 posts

Re: YaLM-100B: Pretrained language model with 100B parameters

#331
post #309

Earlier quoted context omitted.

How much responsibility does Google share for US wrecking Afghanistan, Iraq, Libya and Syria?

Google doesn't censor antiwar propaganda.

There's no laws in US which punish for spreading antiwar propaganda which Google needs to comply with.

Re: YaLM-100B: Pretrained language model with 100B parameters

#332
post #235

Earlier quoted context omitted.

You misunderstood parent post. It's about Google not being sued for discrimination. https://www.washingtonpost.com/news/the-intersect/wp/2016/08... https://www.theguardian.com/technology/2016/apr/08/does-goog... https://www.bloomberg.com/news/articles/2021-10-19/google-qu... https://theconversation.com/googles-algorithms-discriminate-...

Oh I see. What I'm looking for is the reason why they broke the reverse image search. It was working well many years ago but some time after that they switched it to some strange image classifier (I upload an image of an apple to find exactly the same image to track its license of origin, and it says "possibly an image of an apple" - oh thank you Google I didn't know that.)

Tineye works reasonably well, for finding exactly the same image (including different resolutions, crops, etc.)

https://tineye.com/

Re: YaLM-100B: Pretrained language model with 100B parameters

#333

is this the first GPT-like models which is fully opensource ? none of the others are right ?

Aren't eleutherai's model so?

doesnt seem the code is there - pretrained models are there. https://github.com/kingoflolz/mesh-transformer-jax/#gpt-j-6b

https://huggingface.co/EleutherAI/gpt-j-6B

isnt that so ?

Re: YaLM-100B: Pretrained language model with 100B parameters

#334
post #150
post #13

I have to wonder if 10 years down the line, everyone will be able to run models like this on their own computers. Have to wonder what the knock-on effects of that will be, especially if the models improve drastically. With so much of our social lives being moved online, if we have the easy ability to create fake lives of fake people one has to wonder what's real and what isn't. Maybe the dead internet theory will rea…

The bots/machine vs human reminds me of that famous experiment from the 30s in which Winthrop Kellogg[0], a comparative psychologist, and his wife decided to raise their human baby (Donald) simultaneously with a chimpanzee baby (Gua) in an effort to "humanize the ape". It was set out to last 5 years but was relatively quickly abrupted after only 9 months. The explicit reason wasn't stated only that it successfully pr…

A tangentially related thought:

Actors attempt to imitate humans. “Good acting” is convincing; the audience believes the actor is giving a reasonable response to the portrayed situation.

But the audience is also trying to imitate the actors to some degree. Like you point out, humans imitate. For some subset of the population, I’d imagine the majority of social situations they are exposed to, and the responses to situations they observe, are portrayed by actors.

At what point are actors defining the social responses that they then try to imitate? In other words, at what point does acting beget acting and how much of our daily social interactions actually are driven by actors? And is this world of actors creating artificial social responses substantially different than bots doing the same?

Re: YaLM-100B: Pretrained language model with 100B parameters

#335

Earlier quoted context omitted.

There is no clarity on these slides if collection happened proactively or it was a way to transfer information for FISA warrants.

You asked for proof of the following: > Google and Facebook feed their data to NSA. We know that at least some companies were ordered to handover all data, continuously [1]. edit: I think we have enough evidence that I would assume that it's valid for the other companies on the slides, and if it's not true you'll have to provide some proof of that. edit 2: [2] > It searches that database and lets them listen to the c…

You brought two links on:

- phone calls surveillance in Venezuella: no Google no FB mentioned

- plain words of some reporter without any evidence provided, no Google no FB mentioned

Re: YaLM-100B: Pretrained language model with 100B parameters

#336
post #150

Earlier quoted context omitted.

The bots/machine vs human reminds me of that famous experiment from the 30s in which Winthrop Kellogg[0], a comparative psychologist, and his wife decided to raise their human baby (Donald) simultaneously with a chimpanzee baby (Gua) in an effort to "humanize the ape". It was set out to last 5 years but was relatively quickly abrupted after only 9 months. The explicit reason wasn't stated only that it successfully pr…

Case in point: recently, I've noticed that I'm getting more and more emails with the sign off "Warm regards." This is not a coincidence. It is an autosuggestion from Google. If you start signing off an email, it will automatically suggest "Warm regards." It just appears there -- probably an idea generated from an AI network. There are more and more of these algorithmic "suggestions" appearing every day, in more and m…

Those suggestions appear in Google chat too and even if you don't click on them, the simple fact of reading the suggestion makes you much more likely to type it yourself. There's clearly a priming effect to it.

Re: YaLM-100B: Pretrained language model with 100B parameters

#337

Earlier quoted context omitted.

Literally what google doing in favor of USA.

I doubt that anything like this happend to Google execs in the US: "Putin's agents reportedly threatened a top Google executive in Moscow with a 24-hour ultimatum – Take down Russia protest vote app or go to prison" -- https://www.businessinsider.com/russia-agents-threatened-goo... Not yet at least, the political climate may deteriorate to that point, especially when it's about elections, given recent revelations. St…

> you don't have FBI agents knocking on your door threatening you with prison.

Correct, it's DHS.

https://twitter.com/_secondthought/status/133274617257067725...

Re: YaLM-100B: Pretrained language model with 100B parameters

#339
post #167

First of all regardless for political situation this is great step in making ML research actually open. So huge thanks for those developers who pushed to make it public. Still... Yandex is in fact share responsibility for Russian government actions. While it impossible to fight censorship they could certainly shut down their News service completely. Yandex could also certainly move more of their company and staff out…

If that would make you happier, Yandex is selling its News service to Mail.ru.

Re: YaLM-100B: Pretrained language model with 100B parameters

#340

Earlier quoted context omitted.

What proof Snowden provided about Google and FB feeding data to NSA exactly?

https://en.wikipedia.org/wiki/PRISM#The_slides

You misunderstand. The NSA went out of their way to tap Google's lines outside of the US, which made the leadership at Google furious. It accelerated the work to encrypt international fiber (I think many people were really bothered by the tcpdump of a bigtable RPC containing a user ID). I was at a conference shortly after an saw a SVP rip an NSA rep to pieces.

If Google is doing anything that is required of them legally as a US corp, I don't have a problem with that.

Post reply on HN