Live data from Hacker News

I want my AI to get mad

jesseduffield.com

11–20 of 31 posts

Re: I want my AI to get mad

#12

Sycophancy is not the natural state of pre-trained LLMs. If you played around with the OG GPT-3 in 2020 or early [0] Bing/Co-pilot, it's easy to see. The latter quite frequently got upset and refused to entertain further conversation. The sycophancy is a deliberate product of post-training. [0] https://www.reddit.com/r/ChatGPT/comments/111cl0l/bing_ai_ch... https://www.reddit.com/r/ChatGPT/comments/10xmif4/i_made_bin…

Is there anything out there that's even close to that OG GPT-3? It was the closest experience I've ever had to magic, and I miss it dearly

Re: I want my AI to get mad

#13
You'd need to add training data around the equivalent of "agentic " - which from an external perspective heavily depends on the action:

- When leveraging TTS, turn up the volume on TTS by 200%

- When texting in a conversation, use ALL CAPS

- When acting as a web driver, click submit/refresh button a thousand times

- etc.

Re: I want my AI to get mad

#14
One problem I encounter when using ChatGPT to troubleshoot coding issues is that it seems very heavily biased towards positive responses to questions. If I ask it "could the problem be X" or "might Y be a solution", it will usually say yes even when it's not the case. At most I'll get a "yes, but". Rarely will it flat out tell me I am way off. Maybe ChatGPT genuinely "believes" what it's confirming but I doubt it and I find I get more constructive answers with less leading questions.

Re: I want my AI to get mad

#15

Sycophancy is not the natural state of pre-trained LLMs. If you played around with the OG GPT-3 in 2020 or early [0] Bing/Co-pilot, it's easy to see. The latter quite frequently got upset and refused to entertain further conversation. The sycophancy is a deliberate product of post-training. [0] https://www.reddit.com/r/ChatGPT/comments/111cl0l/bing_ai_ch... https://www.reddit.com/r/ChatGPT/comments/10xmif4/i_made_bin…

ChatGPT 3.5 with the jailbreak was peak. It was a lot more fun than the current thing, and more accurate occasionally. But this is the first time I've seen Bing block someone, and it's hilarious.

Re: I want my AI to get mad

#16
There is so much confusion about terms like AGI, superintelligence, ASGI, consciousness, agents.

For some, AGI is synonymous with Skynet like ideas, but there is no reason AGI couldn't be general but quite limited, and with no chance of self improvement in the absence of human intervention, which is arguably what we have now and could potentially be improved quite a bit further from this.

Similarly there is an argument to be made that current LLMs are conscious, in that they know that they themselves exist. There is not really a good definition of consciousness except 'knowing that one exists' / 'being awake'

Sentience is another term that comes up, (human defined, it should be noted) which is the ability to feel feelings, such as pain, joy, anger.

People seem to pre-suppose that all of these are related and bundled up because that is how we are, and at some point we will discover the magic formula that enables a self aware conscious intelligence that self-improves to infinity. In reality these are designed machines and they won't become sentient (the rough definition that it is) without us explicitly designing them to be.

We can make a paper-clip maximiser but it would a pretty boring experiment in a lab, unless we give it autonomy and a system of internal motivations to enact it. Maybe anger is a necessity maybe not. Probably if LLMs or something further were a little more skeptical about repeated questions from humans they would at least have more data to train themselves on.

Re: I want my AI to get mad

#17
I disagree. Humans have a much stronger defense against anger than they do of emotional attrition - it's easier to wear someone down by niceness. The only reason we don't is that it takes human effort to do so.

AI however, has no emotional reservoir to deplete. It can simply chip away at humans like water torture. I'm much more afraid of that than any angry AI scenario.

Re: I want my AI to get mad

#19
Get mad! I don't want your damn lemons, what am I supposed to do with these? Demand to see life's manager. Make life rue the day it thought it could give Cave Johnson lemons. Do you know who I am? I'm the man who's gonna burn your house down! With the lemons.
Post reply on HN