and yet so much of the software i use on a daily basis is still complete and utter garbage...i'm scared
I resigned from Anthropic today
71–80 of 900 posts
Re: I resigned from Anthropic today
#72Earlier quoted context omitted.
> There's no more tangible risk than nuclear weapons, which we handled What do you mean??? Nuclear weapons can't simply be downloaded and run by anyone in the entire world. Superintelligences can. Nuclear weapons can't slop the world into passing age verification laws nearly in unison, can't keep the general population fooled into thinking it's fine when democracy is falling out from under them. A nuclear attack woul…
> Anyone could do anything, any individual could make an extremely outsized impact. So the problem is people. Burn them all !
The problem is indeed people. How do we make the default choices most people make, better?
Consider that a lot of people will be very happy to ask an AI what to do when in the past they may have taken no advice at all. It's a hell of a burden but also a wonderful gift. If anything, progressive countries might eventually want to guarantee some basic AI access for people of all income levels.
Re: I resigned from Anthropic today
#73Earlier quoted context omitted.
What evidence, short of an actual apocalypse happening, would invalidate that belief of yours?
It might be a matter of choosing which apocalypse you'd like. The non-AI state of affairs is not exactly super compelling on a long timescale right now.
We can work on multiple things at once. Defeatism doesn't solve anything. We just have a lot of work to do in many different areas.
Re: I resigned from Anthropic today
#74He resigned and now what? There are thousands willing to do his role, and many labs are competing in that race. His resignation and his statement doesn't do anything but buy him attention which is what all this post about in my opinion.
> Dyson: That's right. There's no way I'm gonna finish the new , not now. Forget it. I'm out of it. I'll quit tomorrow.
> Sarah: That's not good enough.
> Terminator: No one must follow your work.
Re: I resigned from Anthropic today
#75The people building AI earnestly believe that it could kill us all by the end of the decade. This is not a marketing stunt. If anything, many executives and senior researchers will couch their phrasing in the press to sound sensible - but I hear the same people express fear privately. No other human activity poses this level of danger. A common response is “if they truly believe this, why are they still building it?”…
Trying to imagine seeing years of transparently obvious marketing stunts and retconning my own memory because I read a tweet
Or seeing a tweet saying that a thing doesn’t count as a publicity stunt if some unknown number of employees mumble about it being spooky behind closed doors and thinking “that makes sense and sounds true”
Re: I resigned from Anthropic today
#76Most of the current discourse around AI seems to be informed by “The Terminator” lore. Is skynet really the most plausible or only outcome? What if things just got better and the AI’s realized that it would be better to have a mutually beneficial or at least tolerant relationship rather than one where they murder all of us?
> Most of the current discourse around AI seems to be informed by “The Terminator” lore.
I am thinking it's more like The Matrix lore of The Second Renaissance from Animatrix.
Re: I resigned from Anthropic today
#77I think a big break through is needed for AGI so I haven’t been worried about it. I do think that AGI would imply sentience and a will to live and that leads to The Terminator story line.
Re: I resigned from Anthropic today
#78Way I see it, the more conscientious people exiting the scene only serves to increase the likelihood of a bad outcome because they aren't there to offer opinions on problematic developments, or in the more extreme cases blow the whistle. Leaving the clueless and uncaring as the majority is even a great way to hand the keys over to more malicious-leaning actors with deep pockets, as they can more easily steamroll the works to get what they want.
Re: I resigned from Anthropic today
#79Most of the current discourse around AI seems to be informed by “The Terminator” lore. Is skynet really the most plausible or only outcome? What if things just got better and the AI’s realized that it would be better to have a mutually beneficial or at least tolerant relationship rather than one where they murder all of us?
Then we are lucky/blessed. What is generally thought is that they kill us as a bi product of perusing a different goal
Re: I resigned from Anthropic today
#80The most optimistic outcome of generative AI leaves us with a technology that warps our perception of reality and crushes labor. The most pessimistic destroys all of humanity.
Our CEOs not only insist we genuflect before these machines but measure our sacrifice and shame our reluctance.