Live data from Hacker News

Geoffrey Hinton leaves Google and warns of danger ahead

nytimes.com

31–40 of 1001 posts

Re: Geoffrey Hinton leaves Google and warns of danger ahead

#31
post #6
post #3

Hinton responded on Twitter: https://twitter.com/geoffreyhinton/status/165299357072121037...

Cade Metz is the same hack who tried to smear Scott Alexander. This guy is the personification of journalistic malpractice.

Yeah, I was confused because I felt like the article didnt do a good job of clearly stating Hilton's beliefs - it was meandering around. Felt off.

Then I saw the Cade Metz byline at the end and became instantly sceptical of everything I had just read.

Metz is more interested in pushing a nerative than reporting the truth. He doesn't outright lie, just heavily implys things and frames his articles in a misleading way.

Re: Geoffrey Hinton leaves Google and warns of danger ahead

#32

> the average person will not be able to know what is true anymore We barely held things together as society without AI unleashing cognitive noise at industrial scale. Somehow we must find ways to re-channel the potential of digital technology for the betterment of society, not its annihilation.

Ending the internet would probably do it. Noise goes way down when you only have x amount of news sources and outlets. We could still have things like maps, messages, etc. that are all very beneficial.

Yes, there was no ignorance or error before the Internet. Everyone operated with perfect information at all times.

Re: Geoffrey Hinton leaves Google and warns of danger ahead

#33

> the average person will not be able to know what is true anymore We barely held things together as society without AI unleashing cognitive noise at industrial scale. Somehow we must find ways to re-channel the potential of digital technology for the betterment of society, not its annihilation.

Ending the internet would probably do it. Noise goes way down when you only have x amount of news sources and outlets. We could still have things like maps, messages, etc. that are all very beneficial.

Great! Then people could go back to be fed only lies through TV, so we don't have to make the effort of thinking what is true or not.

Re: Geoffrey Hinton leaves Google and warns of danger ahead

#34
post #3

Hinton responded on Twitter: https://twitter.com/geoffreyhinton/status/165299357072121037...

Saving a click, because this basically invalidates the NYT headline:

> In the NYT today, Cade Metz implies that I left Google so that I could criticize Google. Actually, I left so that I could talk about the dangers of AI without considering how this impacts Google. Google has acted very responsibly.

Re: Geoffrey Hinton leaves Google and warns of danger ahead

#35

> the average person will not be able to know what is true anymore We barely held things together as society without AI unleashing cognitive noise at industrial scale. Somehow we must find ways to re-channel the potential of digital technology for the betterment of society, not its annihilation.

I don't think it will be so bad. All Internet comment sections, pictures, video, and really anything on electronic screens will become assumed false by default. Therefore the only use of the Internet and most technology capable of generating audio and video will be entertainment. I already distrust-by-default most of what is online that isn't hard reference material, even if not AI generated.

Three men make a tiger.

- 龐蔥, some time c. 350 BC

https://en.wikipedia.org/wiki/Three_men_make_a_tiger

Re: Geoffrey Hinton leaves Google and warns of danger ahead

#36
There is part of me that thinks that this A.I. fear-mongering is some kind of tactic by Google to get everybody to pause training their A.I.s so they can secretly catch up in the background. If I was to do some quick game theory in my mind this would be the result.

Imagine being Google, leading the way in A.I. for years, create the frameworks (tensorflow), create custom hardware for A.I. (TPUs), fund a ton of research about A.I., have access to all the data in the world, hype up your LLM as being sentient (it was in the news a lot last year thanks to Blake Lemoine) and then out of nowhere OpenAI releases chatGPT and everyone is losing their minds over it. You as Google think you are ready for this moment, all those years of research and preparation was leading to this point, it is your time to shine like never before.

You release Bard and it is an embarrassing disaster, a critical fail leading to an almost 50% reduction of Google's stock price and for the first time and to the surprise of literally everybody people are talking about Bing but in a positive light and google is starting to look a lot like Alta Vista. Suddenly in the news we start hearing how openAI needs to stop training for 6 months for safety of the human race (and more importantly so Google can catch up!).

I have been playing with and using chatGPT to build tools and I don't feel like it will take over the world or pose any real danger. It has no agency, no long term memory, no will, no motivations nor goals. It needs to have it's hands held by a human every step of the way. Yes I have seen AutoGPT but that still needs a ton of hand holding.

I find the current LLM very impressive but like any tool they are as dangerous as the human in the drivers seat and I find the current fear-mongering a bit inorganic and insincere.

Re: Geoffrey Hinton leaves Google and warns of danger ahead

#37
post #14
post #2

What little consolation I had that maybe the experts of AI who continued to insist we needn’t worry too much know better, evaporates with this news. I am reminded that even a year back the experts were absolutely confident (as is mentioned in this article, including Hinton) that really intelligent AI is 30 years ahead. Anyone still trying to argue that we needn’t worry about AI, better have a mathematical proof of th…

The experts have been confident that AI is 30 years out for about 70 years now.

My introduction to the field of "AI" was articles bemoaning the "AI Winter" and wondering if the idea could survive, as an academic pursuit, because of the over hype and failures from the 1970s.

Re: Geoffrey Hinton leaves Google and warns of danger ahead

#38
post #34
post #3

Hinton responded on Twitter: https://twitter.com/geoffreyhinton/status/165299357072121037...

Saving a click, because this basically invalidates the NYT headline: > In the NYT today, Cade Metz implies that I left Google so that I could criticize Google. Actually, I left so that I could talk about the dangers of AI without considering how this impacts Google. Google has acted very responsibly.

This seems roughly in line with the article. He left to talk about the dangers.

Re: Geoffrey Hinton leaves Google and warns of danger ahead

#39

The first step is state-issued public-key cryptographic identification cards. I have been making this argument for years with regards to human actors but perhaps with enough fear of the machines sentiment coursing through society the argument will now be considered. Authentically Human in a World of ChatGPT https://www.williamcotton.com/articles/authentically-human-i... And the article from years ago: The Tyranny of…

Sure, all the governments would LOVE this! I'll take my chances with AI fake posts. At least I can just ignore them.

Public policy is a little more nuanced than shooting from the hip with Tweet-sized morsels.

Please, read the second article, it addresses your concerns. It’s maybe a 5 minute read. I spent a lot of time making it concise.

Re: Geoffrey Hinton leaves Google and warns of danger ahead

#40
post #15

The first step is state-issued public-key cryptographic identification cards. I have been making this argument for years with regards to human actors but perhaps with enough fear of the machines sentiment coursing through society the argument will now be considered. Authentically Human in a World of ChatGPT https://www.williamcotton.com/articles/authentically-human-i... And the article from years ago: The Tyranny of…

> The first step is state-issued public-key cryptographic identification cards. Governments totally love this antidote. I wonder who could be selling this sort of snake-oil to them whilst also being on the other side selling the poison... ...No-one else but Sam Altman's World Coin scam. [0] [0] https://worldcoin.org/blog/engineering/humanness-in-the-age-...

https://www.theguardian.com/world/2009/sep/16/india-populati...
Post reply on HN