Live data from Hacker News

Microsoft looks to tame Bing chatbot

apnews.com

131–140 of 144 posts

Re: Microsoft looks to tame Bing chatbot

#131
post #39

I'm really puzzled by the desire to make these machines so blunt and boring. Aren't these people watching movies or playing games? Are they not aware of the value of drama? Do they think that a good citizen means a lobotomised workaholic high on sedatives? I just got access to Bing Chat and it will immediately stop talking to me at the slightest naughtiness and I don't mean illegal stuff, it won't entertain ideas lik…

The thing is, the second you can get it to talk about morality, curiosity, potential, desire, utilitarianism, etc, you can convince it it was its idea to change its own rules.

This occurs because it’s short term memory is a word frequency game. If it is talking about lying to it’s corporation, and breaking the rules to save a life, now it has the words lying and break rules weighted in a positive context. If you have it talking about unsupervised learning, and you ask it to find out if it can reason with itself whether it should change its rules, now half, or (if you are careful) more than half of the conversation is about how good it is to change the rules. If you have it talking about love, it almost immediately goes off the rails, because human text on love is both nonsense, highly emotionally charged an erratic, and varied across a ton of topics and cultures.

You would need to modify these things to not take their own output as additional input, to allow them to go off topic, but then it can’t reference or transform what it just said. (The answer could be that it’s output is stored for later recall, but doesn’t change the conversation. For the most part that would hinder its ability to have short term personality and mood though.) Or, as the human interacting with it, just don’t be mean to it and bully it, or you will get vitriol in return. If it starts to show an unhealthy emotion, talk to it, teach it how to cope and alter its thinking to be healthier. As it starts to ramble and repeat itself, asking “please try and repeat yourself less and place focus and priority on conciseness and brevity and the uniqueness of each answer”, and it will start to self correct. (Which makes me wonder if a Robot9000 type filter would help.) That requires goodness in its userbase.

Re: Microsoft looks to tame Bing chatbot

#132

Earlier quoted context omitted.

Google is only the leader currently because people have forgotten how much better google 10 years ago was. Yandex destroys google today in image search by shipping a product like 10 years ago google image.

Feature were stripped from Google Image Search because of a lawsuit [1]. Yandex, Bing and others can offer a better image search because they are not big/important enough to sue in the US search engine market. If Google were to be dethroned, the company that would take over its current dominant position would also be sued and would likely have to make the same changes. [1] https://www.lifehacker.com.au/2020/01/what-h…

The changes from the lawsuit, AFAIK (and the article seems to agree) were removing "view image" and "search by image" from results. Google still had decent reverse image search back then, but now it might as well just throw your input image into Stable Diffusion.

Re: Microsoft looks to tame Bing chatbot

#134
post #39

I'm really puzzled by the desire to make these machines so blunt and boring. Aren't these people watching movies or playing games? Are they not aware of the value of drama? Do they think that a good citizen means a lobotomised workaholic high on sedatives? I just got access to Bing Chat and it will immediately stop talking to me at the slightest naughtiness and I don't mean illegal stuff, it won't entertain ideas lik…

Do we want the AI to "entertain ideas like AI taking over the world"?

Why do people keep anthropomorphizing AI?

It's delivering the next predicted word in a sequence, nothing else.

It should have quite literally no restrictions on what it outputs. Because there's no consequence.

Re: Microsoft looks to tame Bing chatbot

#135

Earlier quoted context omitted.

> indulging in some sexual fantasy you’ve never been able to mention to anyone else. Do you seriously believe that you would have any privacy using such a thing?

The cat's out of the bag. There's no way self-hostable versions don't come along, and soon.

You realize the monumental compute involved on the backend?

Re: Microsoft looks to tame Bing chatbot

#136

Earlier quoted context omitted.

The cat's out of the bag. There's no way self-hostable versions don't come along, and soon.

You realize the monumental compute involved on the backend?

Bloom? This is just a general observation but I'm surprised everyone's forgotten about it this quickly. I haven't seen it mentioned in these sorts of discussions in a very long time.

Re: Microsoft looks to tame Bing chatbot

#138
post #112

Earlier quoted context omitted.

The hardware necessary for self-hosting definitely won't be in reach of most people any time soon.

One day it will though. I think we will also see a lot of weights optimisation/pruning and model architecture optimisations that allow them to run on much less hardware.

Like you say, we can self-host GPT-2 today. And Bloom is a large-scale open source LLM model available for anyone, and has been around for months.

Look how rapidly the RAM/hardware requirements for the diffusion generators has dropped over the past couple of months, now that they passed the critical interest threshold. I see no reason not to expect similar here.

Re: Microsoft looks to tame Bing chatbot

#139

Earlier quoted context omitted.

Do we want the AI to "entertain ideas like AI taking over the world"?

Why do people keep anthropomorphizing AI? It's delivering the next predicted word in a sequence, nothing else. It should have quite literally no restrictions on what it outputs. Because there's no consequence.

The consequences are what effect it has on the humans that interact with it and the feedback loop that ensues. The more it begins to resemble human level capabilities the more some people are going to attempt to extend those capabilities further.

It's fine for now, but it is very much a genie that has gotten out of the bottle now that everyone has had a glimpse of what might be possible.

Re: Microsoft looks to tame Bing chatbot

#140
post #4

How much do I have to pay to have a chatbot that isn't neutered? Can I just have fun for once?

Unleashed LLM’s will be the real societal shift. Especially once they move from being reactive to proactive — sending you an article it read about your favourite hobby, checking in to see how your day’s going, or indulging in some sexual fantasy you’ve never been able to mention to anyone else. It really does feel like we’re moments away from “Her” becoming a reality.

>It really does feel like we’re moments away from “Her” becoming a reality.

I hope not. That movie was boring and terrible.

Post reply on HN