141–150 of 174 posts
Earlier quoted context omitted.
I like how the sci-fi authors have spent time thinking about what an advanced AI could do, yet those building the AI have not taken a moment's pause to consider what they are doing
The people building it know it isn't AI, the people selling it call it that.
I don't know if people realize this, but the game now allows you to continue past the "you've converted all matter in the universe" point. You get to convert matter in other universes! (There is still a finite endpoint; I think there's only ~19 other universes you get to do this to.)
Specifics sent to dev:
>I progressed to world level 2. At the beginning I did not activate the new artifact but instead went back to world level 1 via the map then went back to world level 2 via the map. This process removed the world level 2 alien artifact. If this was by design it would make map usage conflict with artifact progression.
>Also, a second bug is that when clicking "Activate" in the artifact section with no artifact selected throws the error.
Earlier quoted context omitted.
The point is it’s virtually impossible to put constraints on it that make it do what you want because if it’s more intelligent than you it can always think of something that you won’t, that’s technically within the rules you set but not at all intended. That’s why we’d need to make it care about the underlying intentions and values, but that’s also really hard
That seems like an attempt to set up a futile exercise in needle-threading that relies on narrow worst-case-scenario definitions of "superintelligence"/AGI. It's too intelligent to restrict our constraints. but It's not too intelligent to be "aligned" to underlying intentions and values? That approach doesn't even work on humans, why would it work on a superintelligence?
Intelligence makes that harder, not easier. Just because it can work out the underlying intentions doesn't mean it cares about them. Remember, this is an optimisation process that maximises a function; deciding to do something that doesn't maximise that function will not be selected for
Whenever you do something, do you think "the underlying goal of my behaviour set by evolution is to reproduce and have children, so I'd better make sure my actions are aligned to the goal of doing that"? No, you don't care what the underlying "intentions" are, and neither does an AI. Because our environment has changed, many of our instincts no longer line up well with that goal, which is actually another problem with aligning AI because it can do the same thing if the environment changes since training as the training process can create an AI with goals that aren't exactly the same as the training goal but line up well during training
Earlier quoted context omitted.
Another explanation is that there are those who considered and thoughtfully weighed the ramifications, but came to a different conclusion. It is unfair to assume a decision process was agnostic to harm or plain ignorant. For example, perhaps the lesser-evil argument played a role in the decision process: would a world where deep fakes are ubiquitous and well-known by the public be better than a world where deep fakes…
there's also the issue that most of the AI catastrophizing is a pretty clear slipperyslope argument: if we build ai AND THEN we give it a stupid goal to optimize AND THEN we give it unlimited control over its environment, something bad will happen. the conclusion is always "building AI is wrong" and not "giving AI unrestricted control of critical systems is wrong"
Replace the word "we" with "a psychotic group of terrorists" in your post and see how it reads.
what're some other interesting "incremental games" out there these days? for me at least, just seeing numbers go up and get huge (Swarm Simulator) doesn't really do it for me. part of what makes Universal Paperclips so good is that, like Candy Box, a huge part of the joy is uncovering entirely new gameplay systems as you progress. A Dark Room was neat in that it brought the idea of a coherent narrative that you (some…
This game is probably one of the best inputs if you want to make estimates about the Drake Equation. Can you really trust every member of every advanced alien species not to hear the siren call of a hypothetical Hypnodrone? One might imagine a galaxy collapsing, the most streamlined self-replicators peeling off "seeds" that start their gravitational brake from ninety-five percent of the speed of light, collapsing the…
Earlier quoted context omitted.
I like how the sci-fi authors have spent time thinking about what an advanced AI could do, yet those building the AI have not taken a moment's pause to consider what they are doing
That's because the people who are building the AI actually know how it works, understand how fundamentally simple it all is, and know that there's no room for consciousness to magically emerge. The current state of AI is not so much a story of any kind of "intelligence" being amazing, but rather the sum total of humanity's data being amazing. The amazing feats LLMs perform come from the words we all wrote, not the co…
Earlier quoted context omitted.
I like how the sci-fi authors have spent time thinking about what an advanced AI could do, yet those building the AI have not taken a moment's pause to consider what they are doing
That's because the people who are building the AI actually know how it works, understand how fundamentally simple it all is, and know that there's no room for consciousness to magically emerge. The current state of AI is not so much a story of any kind of "intelligence" being amazing, but rather the sum total of humanity's data being amazing. The amazing feats LLMs perform come from the words we all wrote, not the co…
Earlier quoted context omitted.
That seems like an attempt to set up a futile exercise in needle-threading that relies on narrow worst-case-scenario definitions of "superintelligence"/AGI. It's too intelligent to restrict our constraints. but It's not too intelligent to be "aligned" to underlying intentions and values? That approach doesn't even work on humans, why would it work on a superintelligence?
> not too intelligent to be aligned The thing is, being aligned cannot be solved with intelligence per se. Say, you are (far) more intelligent than a spider. There's no way you can get aligned with (all of) its values unless the spider finds a way to let you know (all of) its values. Maybe the spider just tells you to make plenty of webs without knowing that it might get entangled in them by itself. The webs are anal…
Don't start playing this game, not even for a quick test, unless you want to find yourself manufacturing world supplies of paperclips in the night. You have been warned, this thing is so addictive that I'm surprised it isn't illegal:^)