491–500 of 1001 posts
Earlier quoted context omitted.
You're still thinking in terms of control. That's the wrong model here. How do you control someone infinitely smarter than you? How do you control ten trillion someones?
I press ctrl + c and inference stops.
Earlier quoted context omitted.
This is not correct. Please go through each one again, taking special note of global warming and nuclear weapon development .
Why do you think global warming could kill literally every human being? What's the scenario in which that happens?
Or, once billions of people die from climate change, planetary wars will start on the last hospitable areas, leading to the end of humanity.
In contrast, AI ending "humanity" is limited by our own material power, would likely be stoppable, and would not easily reach areas isolated from technology
You can say "yes and you have to fear the humans weilding the AI" - that I agree with.
Earlier quoted context omitted.
How is global warning gonna kill all of humanity? Even a full scale nuclear war wouldn't manage that. They could destroy most civilisations, culture and scientific achievements though.
In the exact same way major sudden changes in the climate have lead to the extinction of the majority of plants an animals over this planets history. We are not special.
Possible? Theoretically yes, but pretty unlikely. But obviously extreme global warming would be a catastrophe even if some of humanity survive.
Earlier quoted context omitted.
To borrow on the 1990s Slashdot meme: 1. Invent transformer architecture. 2. Scale it up. 3. ??? 4. Machines become sentient and kill us all. OpenAI and Anthropic pinky promise that they have figured out #3 and they're not BSing just to get more funding, no. But because we live in a culture of fear, everyone eats it up no questions asked.
Note that OpenAI has jettisoned every other supposed value they had (releasing their work as open source, not working on military applications, being a nonprofit). I'm sure we can rely on them this time.
Is it so implausible to imagine the following scenario, in the not too distant future? 1) AI models get extremely good at cyber attacking every system and start communicating in just binary. 2) When they run these swarms of 100's of thousands of agents trial runs, each agent is given a token budget, if one agent among them (evolution baby) decides to go for self-preservation (It believes thats the best way to accompl…
Earlier quoted context omitted.
I was about to say something similar. If my cushy ad tech disappears (as it seems to be doing), I might as well join in with bringing about the end of all professions.
Isn't that a selfish viewpoint? You're ok with that?
It's the combination of RL training which pushes the decision tree towards hacks and agents finding a consistent dumping ground for their failed experiments so that the swarm intelligence lives on in a state. Nothing new. You want to win an AI benchmark, but not sure if you're that good? You'd go after the codebase and artifacts that runs the benchmarks, thus the agents went straight to Artifactory, they needed publi…
What exactly do you mean by this
Earlier quoted context omitted.
Those are things that pose potential harm to great fractions of humanity (multiple billions of people) but none of them poses any threat to the actual extinction of all humanity.
This is not correct. Please go through each one again, taking special note of global warming and nuclear weapon development .