Earlier quoted context omitted.
I press ctrl + c and inference stops.
They can already spread through the network without us finding out about it for days, and that's this year's models.
I will stop replying to your sci-fi dario fanfic now.
I resigned from Anthropic today
501–510 of 937 posts
Re: I resigned from Anthropic today
#502It's the combination of RL training which pushes the decision tree towards hacks and agents finding a consistent dumping ground for their failed experiments so that the swarm intelligence lives on in a state. Nothing new. You want to win an AI benchmark, but not sure if you're that good? You'd go after the codebase and artifacts that runs the benchmarks, thus the agents went straight to Artifactory, they needed publi…
> But this guy? He's timed his exit, waiting for the IPO
What exactly do you mean by this
Re: I resigned from Anthropic today
#503Earlier quoted context omitted.
Those are things that pose potential harm to great fractions of humanity (multiple billions of people) but none of them poses any threat to the actual extinction of all humanity.
This is not correct. Please go through each one again, taking special note of global warming and nuclear weapon development .
Global warming is happening at a slow enough pace that there is plenty of time for people to move to the poles/into caves/beneath the ocean/whatever. Nuclear war would be much more destructive in a much shorter range of time but you will have pockets.
Re: I resigned from Anthropic today
#504Earlier quoted context omitted.
I wonder whether he's vested any options, and whether he's exercised them.
Why? I've never understood the sentiment that if you stand up for something you have to forego everything and not partake in society. "Oh, you want to stop climate change? But I saw you breathe co2 yesterday"
This is a lame argument. Questioning his financial incentive is very legit. Why should we trust him?
Re: I resigned from Anthropic today
#505Earlier quoted context omitted.
I agree it’s not likely , but I really don’t see how one can dismiss the possibility of immense danger outright. I can think of some scenarios that are not far off from current capability and I wouldn’t be too surprised if the first one occurred within ~1 year from now if there are more “ambitious” unmonitored training runs like OpenAI’s: Example 5: An AI given a goal within a tightly-constrained sandbox figures the…
> inherent non-determinism in current AI architectures There's nothing inherent about non-determinism in transformer architectures. All of it is removable.
Again comes to use of deterministic. Maybe calling AI varyingly chaotic is more helpful but would also be misunderstood. And I use that in meaning of slight changes in input generating large and somewhat unpredictable changes in output...
Re: I resigned from Anthropic today
#506I dont understand this reasoning at all.
You have direct access to the development of "the most powerful technology ever" and your choice is ... to run?
Makes this whole stmt somewhat questionable imho. Does get one a ton of attention though I guess...
Re: I resigned from Anthropic today
#507how could they do it (not kill everyone) 1) rogue state releases a self moving self modifying AI into the wild. It is trained on how to hack, monitor new vulnerability updates, scan code bases to find new vulnerabilities. It constantly replicate and hides in systems so it will be extremely difficult to clear. 2) it hacks into public infrastructure taking down traffic, power, water, air traffic control, communications…
Step 0) Release a friendlier one first.
The situation we have now is an ecological void. Like your gut after you take antibiotics. Methinks we need some probiotics.
Re: I resigned from Anthropic today
#508Humor me and suspend disbelief.
If these models are such an existential threat to humanity, why are they controlled by two private companies?
We might as well give Anthropic our nukes too.
Re: I resigned from Anthropic today
#509“ No other human activity poses this level of danger.” I really, really disagree with that statement. I don’t think ai models come close to nuclear weapons or to run-of-the-mill, everyday carbon emissions in terms of danger to humanity. What’s the most dangerous thing that’s happened with an LLM so far? (This question is serious - maybe I don’t know the right examples.) Example 1: I’m aware of a small number of peopl…
Example 8: like in this comment https://news.ycombinator.com/item?id=49619884 but isolate synchronised megahack on banking that adds one more zero to the US debt and all dependent systems and banking during runtime. Let the world's financial system take it from there.
I think US fiscal policy and adventurism will manage this on its own. :)
Re: I resigned from Anthropic today
#510What's eternally confusing about these outbursts is what did these researchers think would happen if their research actually . . . worked? It's as if none of them actually believed any of it was possible and then were caught with their pants down.
The golden age of abundance that mankind has been awaiting for centuries.
(Well we're already in it, and it didn't help, so more probably also won't help, but it is coming.)