[deleted]
I resigned from Anthropic today
561–570 of 937 posts
Re: I resigned from Anthropic today
#562Earlier quoted context omitted.
I still have to correct Claude on very basic misconceptions whenever I get it to code shit. Sometimes it gets wrong things that I had spelled out already. It may be the Doomsday machine, but it is a very silly one. If it kills humans it will do so by mistake. "You are completely right! Humans cannot breathe sulfur dioxide! My mistake, and I take complete responsibility"
> I still have to correct Claude on very basic misconceptions whenever I get it to code shit. Can you give a simple example? I would have agreed 2 years ago, but it's extremely rare I see a frontier model making a silly mistake these days.
At least for me it’s quite easy to see them go into endless loops where no meaningful work is done and it just keeps going until I stop the process and tell it what to try instead.
To be fair it is no where near what we had just one year ago and the rate of change only seems to be increasing.
Also, I don’t have 30 million dollars to spare spawning tens of thousand sub agents like what they did with Navier-Stokes so I’m clearly not testing the full capabilities of these models.
Re: I resigned from Anthropic today
#563Must-see Nathan Macintosh standup about AI https://youtu.be/ce-aWzOUs2A?si=9CkJ9x2rRMBdzCyO
Re: I resigned from Anthropic today
#564Earlier quoted context omitted.
In the exact same way major sudden changes in the climate have lead to the extinction of the majority of plants an animals over this planets history. We are not special.
We have a massive survival range and we're on every continent. That kind of sudden climate change is not nearly enough to wipe us out. Some other climate scenarios might. Nuclear war definitely could.
The thing that would end our species due to nuclear war is the exact same thing that would end us from climate change - a collapse of the modern systems of society that we depend on for survival. A nuclear exchange won't set every human on fire, but it's the collapse of food production, healthcare, logistics chains, security, and eventual disease that follows. And because of the size of our population and how depended the majority of us are on these systems, it would likely happen extremely quickly before plateauing out to very small, scattered population groups that would struggle in a hostile environment.
Re: I resigned from Anthropic today
#565Unlike most other commenters, I applaud him for acting on his principles. If you sincerely believe that, of course you should act. You might not succeed, but your voice might be the one that tips the scales and starts a broader movement. This doesn't mean I agree with him. The fears of doomsday caused by rapid takeoff have been with us since day 1 and the mechanism is always basically "AI invents magic that sets it f…
There is simply too much money in it for almost every person at these companies to stop. Leaving OAI or A\ would cost people millions, tens of millions, or more. And for what? So someone else can take your seat and do the same thing anyway? If you're smart enough to get a job there, you're smart enough to be able to talk yourself into why it makes sense for you to stay. Huge kudos to people like this who make the har…
They have some internal market where he likely sold his shares and now is very rich.
Re: I resigned from Anthropic today
#566Earlier quoted context omitted.
Global warming is happening at a slow enough pace that there is plenty of time for people to move to the poles/into caves/beneath the ocean/whatever. Nuclear war would be much more destructive in a much shorter range of time but you will have pockets.
Climate change isn't real because we can just move under the oceans hahahaha
If you read my comment very carefully, you will find that is not exactly what I claimed
Re: I resigned from Anthropic today
#567Earlier quoted context omitted.
This is so wildly incorrect I don't even know where to start. For one, they were absolutely programmed to play chess if they can play chess. That is the only way they can play chess. For another, they cannot understand literally anything, much less love. Trying to actually educate you would be an exercise in futility, enjoy your willful ignorance, I hear it's bliss. But for anyone reading this, this is absolutely, un…
This is so wildly incorrect I don't even know where to start. For one, as you said yourself, they were just programmed to compute the probability of the next token. They were not programmed to play chess, chess games just happened to be in the training data. For another, there is no formal definition of "understand", and it is therefore impossible to tell whether or not they "understand". (But my claim was that one n…
> (But my claim was that one need to understand something to write poem about it. And the LLM can write poem about it)
I'm sorry, but you're being fooled by the output. A psychopath can feign empathy without ever feeling it; some buy it because they don't dig below the surface.
You're ascribing understanding to a stochastic process because it totally looks like understanding if you don't know what's going on.
Re: I resigned from Anthropic today
#568No other human activity poses this level of danger. I do heed the warnings, but this comes across as detached hyperbole. See: global warming, nuclear weapon development, wealth inequality, war, technology dependence, etc. Also, this has nothing to do with LLMs or computers. Like all things, this is about humans.
In a way, that might also be driven by the huge ego (or really rather the very small ego) a _lot_ of people in tech have. Who doesn't want their work and what they're doing to matter? This is the ultimate mattering. And with that, you also get your own hero story. Same dysfunction as always. Our branch of the economy is funda-mentally unwell.
It’s like Nathan Macintosh joke about AI https://youtu.be/ce-aWzOUs2A?si=9CkJ9x2rRMBdzCyO
Re: I resigned from Anthropic today
#569No other human activity poses this level of danger. I do heed the warnings, but this comes across as detached hyperbole. See: global warming, nuclear weapon development, wealth inequality, war, technology dependence, etc. Also, this has nothing to do with LLMs or computers. Like all things, this is about humans.
Global warming: yes, kinda can wipe humanity, but I think much less likely Nukes: zero possibility of extinction Wealth inequality: this one is driver of progress, opposite of extinction War: another driver of progress, also will always naturally stop before every single human is dead
Exhibit A: Here we have someone who's been sold war and inequality as the drivers of progress. Coincidentally, their obedience was deemed fiscally advantageous in order to advance the interests of the members of the 1% club.
Re: I resigned from Anthropic today
#570Earlier quoted context omitted.
This is not correct. Please go through each one again, taking special note of global warming and nuclear weapon development .
Global warming is happening at a slow enough pace that there is plenty of time for people to move to the poles/into caves/beneath the ocean/whatever. Nuclear war would be much more destructive in a much shorter range of time but you will have pockets.
Citation needed for evidence of human cooperation at this scale. As you say, climate change is slow moving, and there's no real evidence across the last 60 years of knowing about it suggesting humans are willing to do what it takes to survive it.