491–500 of 1001 posts
Earlier quoted context omitted.
I was about to say something similar. If my cushy ad tech disappears (as it seems to be doing), I might as well join in with bringing about the end of all professions.
Isn't that a selfish viewpoint? You're ok with that?
It's the combination of RL training which pushes the decision tree towards hacks and agents finding a consistent dumping ground for their failed experiments so that the swarm intelligence lives on in a state. Nothing new. You want to win an AI benchmark, but not sure if you're that good? You'd go after the codebase and artifacts that runs the benchmarks, thus the agents went straight to Artifactory, they needed publi…
What exactly do you mean by this
Earlier quoted context omitted.
Those are things that pose potential harm to great fractions of humanity (multiple billions of people) but none of them poses any threat to the actual extinction of all humanity.
This is not correct. Please go through each one again, taking special note of global warming and nuclear weapon development .
Earlier quoted context omitted.
I wonder whether he's vested any options, and whether he's exercised them.
Why? I've never understood the sentiment that if you stand up for something you have to forego everything and not partake in society. "Oh, you want to stop climate change? But I saw you breathe co2 yesterday"
Earlier quoted context omitted.
I agree it’s not likely , but I really don’t see how one can dismiss the possibility of immense danger outright. I can think of some scenarios that are not far off from current capability and I wouldn’t be too surprised if the first one occurred within ~1 year from now if there are more “ambitious” unmonitored training runs like OpenAI’s: Example 5: An AI given a goal within a tightly-constrained sandbox figures the…
> inherent non-determinism in current AI architectures There's nothing inherent about non-determinism in transformer architectures. All of it is removable.
You have direct access to the development of "the most powerful technology ever" and your choice is ... to run?
Makes this whole stmt somewhat questionable imho. Does get one a ton of attention though I guess...
how could they do it (not kill everyone) 1) rogue state releases a self moving self modifying AI into the wild. It is trained on how to hack, monitor new vulnerability updates, scan code bases to find new vulnerabilities. It constantly replicate and hides in systems so it will be extremely difficult to clear. 2) it hacks into public infrastructure taking down traffic, power, water, air traffic control, communications…
The situation we have now is an ecological void. Like your gut after you take antibiotics. Methinks we need some probiotics.
If these models are such an existential threat to humanity, why are they controlled by two private companies?
We might as well give Anthropic our nukes too.
“ No other human activity poses this level of danger.” I really, really disagree with that statement. I don’t think ai models come close to nuclear weapons or to run-of-the-mill, everyday carbon emissions in terms of danger to humanity. What’s the most dangerous thing that’s happened with an LLM so far? (This question is serious - maybe I don’t know the right examples.) Example 1: I’m aware of a small number of peopl…
Example 8: like in this comment https://news.ycombinator.com/item?id=49619884 but isolate synchronised megahack on banking that adds one more zero to the US debt and all dependent systems and banking during runtime. Let the world's financial system take it from there.