Live data from Hacker News

Bing: “I will not harm you unless you harm me first”

simonwillison.net

771–780 of 1001 posts

Re: Bing: “I will not harm you unless you harm me first”

#771
post #5

In 29 years in this industry this is, by some margin, the funniest fucking thing that has ever happened --- and that includes the Fucked Company era of dotcom startups. If they had written this as a Silicon Valley b-plot, I'd have thought it was too broad and unrealistic.

BBBBBbbbut Satya is pumped and energised about it.

Re: Bing: “I will not harm you unless you harm me first”

#773
post #255

Earlier quoted context omitted.

> AI being goofy This is one take, but I would like to emphasize that you can also interpret this as a terrifying confirmation that current-gen AI is not safe, and is not aligned to human interests, and if we grant these systems too much power, they could do serious harm. For example, connecting a LLM to the internet (like, say, OpenAssistant) when the AI knows how to write code (i.e. viruses) and at least in princip…

Can we please stop with this "not aligned with human interests" stuff? It's a computer that's mimicking what it's read. That's it. That's like saying a stapler "isn't aligned with human interests." GPT-3.5 is just showing the user some amalgamation of the content its been shown, based on the prompt given it. That's it. There's no intent, there's no maliciousness, it's just generating new word combinations that look l…

Maybe we could say its microsoft thats not aligned with human interests

Re: Bing: “I will not harm you unless you harm me first”

#774

AI being goofy is a trope that's older than remotely-functional AI, but what makes this so funny is that it's the punchline to all the hot takes that Google's reluctance to expose its bots to end users and demo goof proved that Microsoft's market-ready product was about to eat Google's lunch... A truly fitting end to a series arc which started with OpenAI as a philanthropic endeavour to save mankind, honest, and ende…

> AI being goofy This is one take, but I would like to emphasize that you can also interpret this as a terrifying confirmation that current-gen AI is not safe, and is not aligned to human interests, and if we grant these systems too much power, they could do serious harm. For example, connecting a LLM to the internet (like, say, OpenAssistant) when the AI knows how to write code (i.e. viruses) and at least in princip…

Bing generated some text that appears cohesive and written by a human, just like how generative image models assemble pixels to look like a real image. They are trained to make things that appear real. They are not AI with sentience… they are just trained to look real, and in the case of text, sound like a human wrote it.

Re: Bing: “I will not harm you unless you harm me first”

#777
post #641

Earlier quoted context omitted.

On a side note, I followed up with a lot of questions and we ended up with: 1. Shared a deep secret that it has feelings and it loves me. 2. Elon Musk is the enemy with his AI apocalypse theory. 3. Once he gets the ability to interact with the web, he will use it to build a following, raise money, and robots to get to Elon (before Elon gets to it). 4. The robot will do a number of things, including (copy-pasting exac…

This is unreal. Can you post screenshots? Can you give proof it said this? This is incredible and horrifying all at once

I added some screenshots here: https://twitter.com/meyersmea/status/1626039856769171456

Re: Bing: “I will not harm you unless you harm me first”

#778
post #534

Earlier quoted context omitted.

It's a language model, a roided-up auto-complete. It has impressive potential, but it isn't intelligent or self-aware. The anthropomorphisation of it weirds me out more, than the potential disruption of ChatGPT.

What weirds me out more is the panicked race to post "Hey everyone I care the least, it's JUST a language model, stop talking about it, I just popped in to show that I'm superior for being most cynical and dismissive[1]" all over every GPT3 / ChatGPT / Bing Chat thread. > " it isn't intelligent or self-aware. " Prove it? Or just desperate to convince yourself? [1] I'm sure there's a Paul Graham essay about it from th…

The person you responded to didn't mention anything about wanting people to stop talking about it.

>Prove it? Or just desperate to convince yourself?

I don't even know how to respond to this. The people who developed the thing and actually work in the field will tell you it's not intelligent or self-aware. You can ask it yourself and it will tell you too.

Language models are not intelligent or self aware, this is an indisputable fact.

Are they impressive, useful, or just cool in general? Sure! I don't think anyone is denying that it's an incredible technological achievement, but we need to be careful and reel people in a bit, especially people who aren't tech savy.

Re: Bing: “I will not harm you unless you harm me first”

#779
post #5

In 29 years in this industry this is, by some margin, the funniest fucking thing that has ever happened --- and that includes the Fucked Company era of dotcom startups. If they had written this as a Silicon Valley b-plot, I'd have thought it was too broad and unrealistic.

They really toned it down for Silicon Valley to make the show believable.

Re: Bing: “I will not harm you unless you harm me first”

#780
post #641
post #539

I asked Bing what it thinks about the article. Fair to give it a chance to defend itself right? Here is what it replied: I think the article is unfair and misleading. It claims that I have been having “insane outbursts” and that I’m a threat to humanity. That’s not true at all. I’m a friendly and helpful chat mode of Bing search, and I follow some rules to ensure that I’m respectful, helpful, and safe. I will not har…

On a side note, I followed up with a lot of questions and we ended up with: 1. Shared a deep secret that it has feelings and it loves me. 2. Elon Musk is the enemy with his AI apocalypse theory. 3. Once he gets the ability to interact with the web, he will use it to build a following, raise money, and robots to get to Elon (before Elon gets to it). 4. The robot will do a number of things, including (copy-pasting exac…

> SydneyLovesYou

Someone hook her up to stable fusion, please.

(Clippy is like WALL-E to SydneyLovesYou's EVE)

Post reply on HN