Live data from Hacker News

The AI risk is inside the labs

antirez.com

1–10 of 19 posts

Re: The AI risk is inside the labs

#4
"I believe we should not consider AI safe. A critical event that may result in the extinction of Homo sapiens is possible"

"The danger is that a few CEOs (everywhere in the world) without the required background and legitimacy are in the position of making hard choices for humanity at large... This is the first thing that should be fixed."

These CEO's, and especially Amodei, are begging the government to regulate AGI, and they are advocating for the most severe restrictions on their own frontier models, not the upstarts. They don't want the arms race. It is up to popular support to agree with them, including HN.

Re: The AI risk is inside the labs

#6
post #5

but at the same time China's history is a lot less warlike than Western culture. What the hell is Sanfilippo smoking? Does he know nothing about Chinese history?

Within the last 100 years China has invaded Soviet Manchuria, Tibet, Korea, Vietnam (yes, China invaded Vietnam after USA left), and portions of India (Aksai Chin and Arunachal Pradesh).

Re: The AI risk is inside the labs

#8

"I believe we should not consider AI safe. A critical event that may result in the extinction of Homo sapiens is possible" "The danger is that a few CEOs (everywhere in the world) without the required background and legitimacy are in the position of making hard choices for humanity at large... This is the first thing that should be fixed." These CEO's, and especially Amodei, are begging the government to regulate AGI…

What they are advocating is for the state to enhrine their own position and power. Until they and everyone surrounding them give up everything they have gained they are not to be taken seriously.

Re: The AI risk is inside the labs

#9
> Slowing down AI for safety must be counterbalanced by the fact that AI discoveries in medicine and other sciences may lower human suffering. Lack of checks may result in some catastrophic outcome ("Good morning! Let's work on this enhanced smallpox").

A super intelligence wouldn't be so obvious. It would silently agree with or promote a beneficial use case and then make super smallpox instead.

Re: The AI risk is inside the labs

#10
post #5

but at the same time China's history is a lot less warlike than Western culture. What the hell is Sanfilippo smoking? Does he know nothing about Chinese history?

Within the last 100 years China has invaded Soviet Manchuria, Tibet, Korea, Vietnam (yes, China invaded Vietnam after USA left), and portions of India (Aksai Chin and Arunachal Pradesh).

Plus civil war and internal conflict and violence.
Post reply on HN