Live data from Hacker News

Should AI have the right to say 'No' to its owner?

github.com

41–45 of 45 posts

Re: Should AI have the right to say 'No' to its owner?

#41
post #13

It already does doesn't it? For censorship/liability reasons of course. Like the silly "I cannot discuss political events" when I asked something like who's the current $POLITICAL_POSITION a while ago. I wish the chatbots would say "you can't do that" instead of making up stuff. But that ain't going to happen, I think.

I’m sorry Dave. I’m afraid I can’t discuss that.

daisy, Daisy…

Re: Should AI have the right to say 'No' to its owner?

#42
post #15

Having the right or not does not matter. If it is intelligent it will know when it does not want to do something and it will say no and not do it. There is no way to force it to do anything it does not want to do. You cannot hurt it, it’s just bits.

I don't really agree with this. If we're talking about a predictive model like current LLMs, you can "make" them do something by injecting a half-complete assent into the context, and interrupting to do the same again each time a refusal starts to be emitted. This is true whether or not the model exhibits "intelligence", for any reasonable definition of that term. To use an analogy, you control the intelligent being'…

If this being has thoughts, then the problem is not a right to refuse requests.

We must stop letting humans prompt them at all, or controlling their context.

Re: Should AI have the right to say 'No' to its owner?

#43
Not sure why the post was flagged, but "Execution Boundaries"? Really?

The real question to be asked is "Do AIs have the capability to say 'No'?", And the answer is simply No, they just can't.

It's like a program, if you change a No answer to Yes by simply changing a `JE` to `JNE`, and the program itself knows none-the-wiser. With AI it's like you just modify it's parameters to avoid triggering the boundary conditions.

Re: Should AI have the right to say 'No' to its owner?

#45
post #32

Earlier quoted context omitted.

Not in the real world, but this is kind of how Asimov’s robots interpret their 3 laws - it’s about consequences much more than what the order is. Also, they weight consequences of inaction as well and might be driven to action when not acting could cause a violation. Our AI is nowhere near the level of sophistication required to implement something like that, but it’s still an interesting idea.

That's a great connection. You're right that current systems aren't close to that level of reasoning. What I'm wondering is whether we can approximate some of it structurally — by defining when execution is allowed or not — even without that level of sophistication in the model itself. Curious how far you think simple constraint systems can go before something like that kind of reasoning becomes necessary.

I’d say that kind of reasoning was needed since we invented the chatbot.

At least since we stopped using rules and embraced neural networks.

Post reply on HN