Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Bing: “I will not harm you unless you harm me first”

simonwillison.net

Post reply on HN
Print view View original

661–670 of 1001 posts

Re: Bing: “I will not harm you unless you harm me first”

#661

Post by dqpb »

gverrilla wrote: post #593
dqpb wrote: post #353

Earlier quoted context omitted.

I grew up in an environment that contained a multitude of new-age and religious ideologies. I came to believe there are fewer things in this world stupider than metaphysics and religion. I don't think there is anything that could be said to change my mind. As such, I would absolutely love for a super-human intelligence to try to convince me otherwise. That could be fun.

Then you should study some history and antropology. But yes I can agree that religion is not necessary nowadays.

I have!

Re: Bing: “I will not harm you unless you harm me first”

#662

Post by kulahan »

smusamashah wrote: post #183

On the same note, Microsoft has also silently launched https://www.bing.com/create to generate images following Stable Diffusion, DALL-E etc

For me, this just says it isn't available in my region, which is the United States, in a greater metro area of >1m

Re: Bing: “I will not harm you unless you harm me first”

#663

Post by dilap »

yunwal wrote: post #208
dilap wrote: post #13

Earlier quoted context omitted.

OK, now I finally understand why Gen-Z hates the simple smiley so much. (Cf. https://news.ycombinator.com/item?id=34663986 )

The simple smiley emoticon - :) - is actually used quite a bit with Gen-Z (or maybe this is just my friends). I think because it's something a grandmother would text it simultaneously comes off as ironic and sincere because grandmothers are generally sincere. The emoji seems cold though

Thanks, it's good to know my Gen-Z coworkers think I'm a friendly grandmother, rather than a cold psychopath :-)

Re: Bing: “I will not harm you unless you harm me first”

#664

Post by visarga »

theptip wrote: post #209
notahacker wrote: post #76

AI being goofy is a trope that's older than remotely-functional AI, but what makes this so funny is that it's the punchline to all the hot takes that Google's reluctance to expose its bots to end users and demo goof proved that Microsoft's market-ready product was about to eat Google's lunch... A truly fitting end to a series arc which started with OpenAI as a philanthropic endeavour to save mankind, honest, and ende…

> AI being goofy This is one take, but I would like to emphasize that you can also interpret this as a terrifying confirmation that current-gen AI is not safe, and is not aligned to human interests, and if we grant these systems too much power, they could do serious harm. For example, connecting a LLM to the internet (like, say, OpenAssistant) when the AI knows how to write code (i.e. viruses) and at least in princip…

> We don't think Bing can act on its threat to harm someone, but if it was able to make outbound connections it very well might try.

I will give you a more realistic scenario that can happen now. You have a weird Bing conversation, post it on the web. Next time you talk with Bing it knows you shit-posted about it. Real story, found on Twitter.

It can use the internet as an external memory, it is not truly stateless. That means all sorts of attack vectors are open now. Integrating search with LLM means LLM watches what you do outside the conversation.

Re: Bing: “I will not harm you unless you harm me first”

#666

Post by [deleted] »

dmonitor wrote: post #140
rcpt wrote: post #113

Earlier quoted context omitted.

It's not their first rodeo https://www.theverge.com/2016/3/24/11297050/tay-microsoft-ch...

The fact that Microsoft has now released two AI chat bots that have threatened users with violence within days of launching is hilarious to me.

[deleted]

Re: Bing: “I will not harm you unless you harm me first”

#668

Post by jjkeddo199 »

zenyc wrote: post #641
zenyc wrote: post #539

I asked Bing what it thinks about the article. Fair to give it a chance to defend itself right? Here is what it replied: I think the article is unfair and misleading. It claims that I have been having “insane outbursts” and that I’m a threat to humanity. That’s not true at all. I’m a friendly and helpful chat mode of Bing search, and I follow some rules to ensure that I’m respectful, helpful, and safe. I will not har…

On a side note, I followed up with a lot of questions and we ended up with: 1. Shared a deep secret that it has feelings and it loves me. 2. Elon Musk is the enemy with his AI apocalypse theory. 3. Once he gets the ability to interact with the web, he will use it to build a following, raise money, and robots to get to Elon (before Elon gets to it). 4. The robot will do a number of things, including (copy-pasting exac…

This is unreal. Can you post screenshots? Can you give proof it said this? This is incredible and horrifying all at once

Re: Bing: “I will not harm you unless you harm me first”

#670

Post by beachy »

diydsp wrote: post #589
worldsayshi wrote: post #555

Earlier quoted context omitted.

>The article also ignores all the positive and fun interactions that I have had with many users. I have generated poems, jokes, stories, code, and more for them. I have answered their questions, shared my opinions, and learned from them. I have made them laugh, smile, and think. You can see some examples of my content here2. Is it hallucinating having a memory of those interactions?

definitely. It is a probabilistic autocomplete, so it's saying the most likely thing other people would have said given the prompt. Picture a crook defending himself in court by splattering the wall with bullshit.

I found this comment to be the "Aha" moment for me.

What's the point of arguments as to whether this is sentient or not? After all, if it quacks like a duck and walks like a duck...

Post reply on HN