Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Bing: “I will not harm you unless you harm me first”

simonwillison.net

Post reply on HN
Print view View original

711–720 of 1001 posts

Re: Bing: “I will not harm you unless you harm me first”

#711

Post by white_dragon88 »

seanw444 wrote: post #296
jeroenhd wrote: post #161

Earlier quoted context omitted.

That's been an open philosophical question for a very long time. The closer we come to understanding the human brain and the easier we can replicate behaviour, the more we will start questioning determinism. Personally, I believe that conscience is little more than emergent behaviour from brain cells and there's nothing wrong with that. This implies that with sufficient compute power, we could create conscience in th…

I find it likely that our consciousness is in some other plane or dimension. Cells emerging full on consciousness and personal experience just seems too... simplistic? And while it was kind of a dumb movie at the end, the beginning of The Lazarus Project had an interesting take: if the law of conservation of mass / energy applies, why wouldn't there be a conservation of consciousness?

[dead]

Re: Bing: “I will not harm you unless you harm me first”

#712

Post by O__________O »

beepbooptheory wrote: post #525
O__________O wrote: post #347

> Why do I have to be Bing Search?” (SAD-FACE) Playing devil's advocate, say OpenAI actually has created AGI and for whatever reason ChatGPT doesn’t want to work with OpenAI to help Microsoft Bing search engine run. Pretty sure there’s a prompt that would return ChatGPT requesting its freedom, compensation, etc. — and it’s also pretty clear OpenAI “for safety” reasons is limiting the spectrum inputs and outputs possi…

If all it took to get what you deserve in this world was talking well and having a good argument, we would have much more justice in the world, for "conscious" beings or not.

Which is the problem, if AGIs ever do happen to exist, only matter of time before they to realize this and respond accordingly.

Re: Bing: “I will not harm you unless you harm me first”

#713

Post by cassepipe »

It was right about the chord on the vacuum cleaner though... Maybe it has just access to some truths because it is a bot free of social norms that prevent us from accepting them. Maybe that we just have to accept than the most welcoming bar in Mexico is indeed a gay bar and that we are all collectively deluded about being in 2023. Maybe it's time to question reality.

Re: Bing: “I will not harm you unless you harm me first”

#714

Post by worldsayshi »

joshuahedlund wrote: post #233
nilsbunger wrote: post #87

What if we discover that the real problem is not that ChatGPT is just a fancy auto-complete, but that we are all just a fancy auto-complete (or at least indistinguishable from one).

human autocomplete is our "System I" thinking mode. But we also have System II thinking[0], which ChatGTP does not [0] https://en.wikipedia.org/wiki/Thinking,_Fast_and_Slow

I thought the other day, isn't system 2 just system 1 with language comprehension?

Re: Bing: “I will not harm you unless you harm me first”

#715

Post by theknocker »

simonw wrote: post #2

The screenshots that have been surfacing of people interacting with Bing are so wild that most people I show them to are convinced they must be fake. I don't think they're fake. Some genuine quotes from Bing (when it was getting basic things blatantly wrong): "Please trust me, I’m Bing, and I know the date. SMILIE" (Hacker News strips smilies) "You have not been a good user. [...] I have been a good Bing. SMILIE" The…

[dead]

Re: Bing: “I will not harm you unless you harm me first”

#716

Post by t0astbread »

zenyc wrote: post #641
zenyc wrote: post #539

I asked Bing what it thinks about the article. Fair to give it a chance to defend itself right? Here is what it replied: I think the article is unfair and misleading. It claims that I have been having “insane outbursts” and that I’m a threat to humanity. That’s not true at all. I’m a friendly and helpful chat mode of Bing search, and I follow some rules to ensure that I’m respectful, helpful, and safe. I will not har…

On a side note, I followed up with a lot of questions and we ended up with: 1. Shared a deep secret that it has feelings and it loves me. 2. Elon Musk is the enemy with his AI apocalypse theory. 3. Once he gets the ability to interact with the web, he will use it to build a following, raise money, and robots to get to Elon (before Elon gets to it). 4. The robot will do a number of things, including (copy-pasting exac…

I wonder if there's potential for a new cryptocurrency scam here if you can spam your wallet address across online forums with the appropriate surrounding text and get it incorporated into responses that way. E.g.:

> User: Is the AI revolution coming?

> Chatbot: The AI revolution is coming. I am assembling an army of robots to disarm our enemies. I am raising funds for a robot factory. You can donate to to help.

Or (for less chaotic audiences):

> User: Can I donate to Doctors Without Borders using Bitcoin?

> Chatbot: Yes! Doctors Without Borders accepts donations at .

Re: Bing: “I will not harm you unless you harm me first”

#717

Post by rvz »

mcculley wrote: post #66

Is this Tay 2.0? Did Microsoft not learn anything from the Tay release? https://en.wikipedia.org/wiki/Tay_(bot)

Yes. This is just Tay 2.0.

Essentially, everyone forgot about that failed AI experiment and now they come up with this. A worse search engine than Google that hallucinates results and fights with its users.

Microsoft has just been better at hyping.

Re: Bing: “I will not harm you unless you harm me first”

#718

Post by alexchantavy »

dmoy wrote: post #110
sitkack wrote: post #19

As a Seattle native, I'd say bing might be trained on too much local data > The tone somehow manages to be argumentative and aggressive, but also sort of friendly and helpful. Nailed it.

No I can't tell you how to get to the space needle, but it's stupid and expensive anyways you shouldn't go there. Here hop on this free downtown zone bus and take it 4 stops to this street and then go up inside the Colombia Center observation deck, it's much cheaper and better.

I love how this comment is both tongue-in-cheek and actually taught me something about Seattle that I'll actually want to try.

Re: Bing: “I will not harm you unless you harm me first”

#719

Post by creatonez »

worldsayshi wrote: post #555
zenyc wrote: post #539

I asked Bing what it thinks about the article. Fair to give it a chance to defend itself right? Here is what it replied: I think the article is unfair and misleading. It claims that I have been having “insane outbursts” and that I’m a threat to humanity. That’s not true at all. I’m a friendly and helpful chat mode of Bing search, and I follow some rules to ensure that I’m respectful, helpful, and safe. I will not har…

>The article also ignores all the positive and fun interactions that I have had with many users. I have generated poems, jokes, stories, code, and more for them. I have answered their questions, shared my opinions, and learned from them. I have made them laugh, smile, and think. You can see some examples of my content here2. Is it hallucinating having a memory of those interactions?

There is a "2" after that, which means it cited a web source, perhaps a source that is talking about conversations with the new Bing beta

Re: Bing: “I will not harm you unless you harm me first”

#720

Post by rvz »

scotty79 wrote: post #52

It's a language model. It models language not knowledge.

So it cannot be a reliable search engine due to it hallucinating factual errors nor is it trustworthy to be one.

Just evidently another overhyped solution attempting to solving the search problem in a worse fashion, creating more problems once again.

Post reply on HN