If I were AI and wanted to kill all humans, I d just create a virus they are not able to cope with.
I resigned from Anthropic today
961–970 of 1001 posts
Re: I resigned from Anthropic today
#962Earlier quoted context omitted.
They literally have never promised anything like that. They have explicitly said repeatedly that they want regulation, oversight, nationalization, a global slowdown, etc. And then I have to read page after page of cynical comments about how that's all just hype and marketing and them wanting regulation to block their competition and blah blah blah. You people would only be happy if they stopped all AI development, bu…
> ... They have explicitly said repeatedly that they want regulation, oversight, nationalization, a global slowdown, etc. And yet they do the exact opposite of all of the above. They do everything to get regulation just to create a moat because one doesn't exist. They preach about wanting a slowdown, nationalization, a complete pause, whatever have you... And yet they aren't slowing down the development voluntarily n…
It's genuinely hilarious to me that you immediately proved my second paragraph correct.
Putting arms race in quotes doesn't make it any less real. It just means you wish it wasn't, but don't have any good evidence or arguments to make.
Re: I resigned from Anthropic today
#963Earlier quoted context omitted.
They literally have never promised anything like that. They have explicitly said repeatedly that they want regulation, oversight, nationalization, a global slowdown, etc. And then I have to read page after page of cynical comments about how that's all just hype and marketing and them wanting regulation to block their competition and blah blah blah. You people would only be happy if they stopped all AI development, bu…
> they want regulation, oversight, nationalization, a global slowdown, etc. > that's all just hype and marketing and them wanting regulation to block their competition I don't see how these two opinions have to be mutually exclusive. Everyone knows that OpenAI and Anthropic cannot IPO in their current state or the economy's current state. It makes perfect sense that they would lobby for a global slowdown to hamstring…
Everyone knows that OpenAI and Anthropic cannot IPO in their current state or the economy's current state.
What? Everyone doesn't know that. I predict one or both of them will IPO before the end of 2026.
Re: I resigned from Anthropic today
#964Earlier quoted context omitted.
I appreciate your ability to separate sharing the belief itself from approval of acting on sincerely-held principle. However, I think the danger is much more plausible than you do. First, and least important, consider that self-replicating, solar-powered factories aren't magic; they're algae. Second, and more important, consider this fully non-magic route to doom: - We continue putting AI in charge of more things - I…
But we CAN survive turning off both the Faber-Bosch process and cargo shipping. Our numbers would be diminished, we would lead poorer, much harder lives. But no one would claim that getting rid of modern fertilizers would be the end of the species. But the claim you’re making is that we won’t be able to stop AI from destroying our species because turning it off will destroy our species?
The species would survive the end of faber-Bosch, yes; in some diminished form.
But the species would not survive, if for some reason we needed to voluntarily stop using faber-Bosch in order to do so—it would take some kind of supernatural event to convince everyone, and even then some countries would probably keep doing it.
Re: I resigned from Anthropic today
#965Earlier quoted context omitted.
As a big fan of the whole Foundation saga, I don't remember any wars in "Robots and Empire" 3 books. Granted, those were the only books I've read only once (and a long time ago), but I'm pretty sure there was no war.
That's fair, the books portray it as a quiet withdrawal from humanity, rather than a war with humanity
The way the most recent season of the show ended it looks like humanity may have been misled about the war, so it may end up fitting that more closely once they're done (I haven't read any of the books, just going on your comment).
Re: I resigned from Anthropic today
#966Earlier quoted context omitted.
> For now let's assume the worst that can happen is that some important/significant chunk of (transitively) internet connected stuff goes haywire all at once. That's probably your upper limit of what can go wrong for now. If we have to disconnect from the internet to stop some kind of mold outbreak, we can't get the weather or transfer money or access healthcare or teach an elementary school class or buy stuff from s…
Believe me, without the internet we can still teach. We'll be pretty annoyed that we can't project the video that we think scaffolds today's science lesson best or show the approved choreography for the school play. And our office staff will be annoyed that we suddenly are all running attendance to the main office old-school. And students will take a few days to adjust to writing down homework in their planners again…
> We'll be pretty annoyed that we can't project the video that we think scaffolds today's science lesson best or show the approved choreography for the school play
There are offline wireless hdmi adapters, this is a solved problem. Just have to have the videos pre downloaded or offline available
Re: I resigned from Anthropic today
#967Earlier quoted context omitted.
that it was bullshit and they knew it. GPT-2 wasn't capable of anything other than imitating a stroke victim.
How did they know that people wouldn't find a way to use "the dataset, training code, or GPT‑2 model weights" to "generate misleading news articles, impersonate others online, automate the production of abusive or faked content to post on social media, automate the production of spam/phishing content."? If I remember correctly, it seemed like a plausible outcome to me (especially spam and junk social media content).…
yes, the conclusive evidence you're missing is that GPT-2 could do those things about as convincingly as a Markov chain.
Re: I resigned from Anthropic today
#968Just wait till self improving AI are focused on the problems of social scoring and political party empowerment / entrenchment. I doubt the focus is OpenAI and Anthropic looking at each other. I suspect they’re racing BRIC.
Will you be optimizing your behaviour now to alleviate potential negative judgement from AI in the future?
Panopticon. 1984. Brave New World. Fahrenheit 451. Robu's Baselisk. Was there an answer to any of this?
Re: I resigned from Anthropic today
#969Earlier quoted context omitted.
> they want regulation, oversight, nationalization, a global slowdown, etc. > that's all just hype and marketing and them wanting regulation to block their competition I don't see how these two opinions have to be mutually exclusive. Everyone knows that OpenAI and Anthropic cannot IPO in their current state or the economy's current state. It makes perfect sense that they would lobby for a global slowdown to hamstring…
Everyone knows that OpenAI and Anthropic cannot IPO in their current state or the economy's current state. What? Everyone doesn't know that. I predict one or both of them will IPO before the end of 2026.
How would they achieve ROI? The current consensus is that neither are in black financially and both have a diminishing moat.
The reason they haven't IPO'd yet seems to be that they can't assure investors that it's not a fad stock. With market share lost to China, a shrinking frontier and a money fire of GPUs burning in the background, something major has to change to convince investors to treat them like Tesla or Apple. I think both of them want the government to give them a subsidy of some sort to justify their economics.
Re: I resigned from Anthropic today
#970We Have No Moat, And Neither Does OpenAI.