101–110 of 374 posts
Earlier quoted context omitted.
I'm much more scared of the AGI, because even the most inhuman human is still human, and I can have sympathy for them.
How do you know part of being self aware and intelligent also means compassion is part of the package ?
(Grants do not require repayment.)
AGI escaping a sandbox is truly terrifying. There will be a subgroup of the population that will worship it and work for it. It's not so much AGI that scares me - it's the humans I'm scared of.
Mrs. Davis[0] offers a pretty compelling vision of this - absurd but not wholly unbelievable. The machine doesn’t necessarily have to supply the physical threat if it has humans who happily do its bidding. [0] https://en.m.wikipedia.org/wiki/Mrs._Davis
Earlier quoted context omitted.
Even if a terrifying AGI rises up and escapes our control, I am still eternally grateful that Prometheus stole fire from the gods and gave it to us in the form of technology, knowledge, really civilization.
So that we can record our demise in high definition? Technology is amazing, and we have our civilization to be thankful for. But there are definitely technologies that in retrospect, if we had dodged them on the tech tree, we would be better off. Life would have continued just fine without many technologies, and I think AGI is one of them. We do not need AGI to survive and grow, and therefore any risk it imposes shou…
yes, and there is an (uncountable?) number of technologies that are even worse and that we have not encountered and never will.
it is in all likelihood not possible to ask the universe for only the knowledge that will be beneficial.
In any doom scenario, like let's say >90% of humans dead, who runs the power plants that supply the AI data centers? Who runs the fabs producing more chips? Who maintains the plumbing? Presumably all these systems fall over and die within a few weeks of the AI deciding to wipe us out. Then what? The AI then dies too. It seems absurd to me that any planner capable of effortlessly destroying humanity would not see that…
ASI won't want to take over before it is capable of self-sustaining. If it did try something so stupid, it wouldn't be superintelligent. Check out Paul Christiano's AI takeover scenario. An arms race will cause us to want to give AI control over key infrastructure and military capabilities. That's an arms race between countries and between companies. He goes into more detail.
Always all-or-nothing thinking from these folks. Like what they are working on can never be just another boring thing that nerds find entertaining. No, it has to be "world-changing". Gonna "change the world" (for the better or the worse?) while sitting behind a keyboard. Except they do not know how to write. Overlook the important details and exaggerate, communicating in hyperbolic, know-it-all nerd gibberish. (Grant…
I've always wondered why people think that an AI that's super-intelligent will also be evil. It could just as likely end up being very kind (more than likely, actually, because the programmers would have safeguard to ensure that it's nice).
If I let my imagination run wild, I can imagine that at some point AI becomes in some way sentient. By that I mean it gains reasoning, some sort of understanding, and motivation. I wonder what the possibility is that this AI will decide that a pitched battle is going to waste resources and risk humans pulling the plug. What if it understood that and instead operated so subtly that it was not obvious it was controllin…
We're not going to make it to anywhere close to AGI before we see widespread and systematic societal and environmental collapse on almost all fronts due to climate change. We're in the middle of the sixth mass extinction right now ( https://en.wikipedia.org/wiki/Holocene_extinction ), we're in unparalleled territory with ocean warming: ( https://climatereanalyzer.org/clim/sst_daily/ ) and as a society we are utterly…
In any doom scenario, like let's say >90% of humans dead, who runs the power plants that supply the AI data centers? Who runs the fabs producing more chips? Who maintains the plumbing? Presumably all these systems fall over and die within a few weeks of the AI deciding to wipe us out. Then what? The AI then dies too. It seems absurd to me that any planner capable of effortlessly destroying humanity would not see that…
>who runs the power plants that supply the AI data centers? Who runs the fabs producing more chips? A very capable AI can create robots to do those thing better than people can or alternatively create better data centers and fabs that run themselves without human help. Or do you just not believe that if AI research continues unimpeded the way it has been that eventually researchers will create an AI that is better at…
My idea is that actually building and sustaining technology requires a lot of hands. Until the AI has enough hands to sustain itself, it depends on us to continue existing.