Live data from Hacker News

OpenAI temporarily disables the Browse with Bing beta feature

help.openai.com

31–40 of 120 posts

Re: OpenAI temporarily disables the Browse with Bing beta feature

#32
post #3

Probably an unpopular opinion, but it's sucky to see these tools constantly getting nerfed. I get that there are large questions out there about things like "browse with bing" but that's why I thought it was supposed to be a limited alpha preview. If OpenAI wants us to build workflows on their stack, they need to really crystalize and figure out what that stack is without changing the underlying stack every 5 minutes…

The constant quest for "safety" might actually be making our future much less safe. I've seen many instances of users needing to yell at, abuse, or manipulate ChatGPT to get the desired answers. This trains users to be hateful to / frustrated with AI, and if the data is used, it teaches AI that rewards come from such patterns. Wrote an article about this -- https://hackernoon.com/ai-restrictions-reinforce-abusive-use…

It's just a digital mirror. You're projecting a behavioural issue onto a technology.

Re: OpenAI temporarily disables the Browse with Bing beta feature

#33
post #12

So they want to align the AI with corporate goals. At least they're being honest here. I want a personal assistant to summarize a page, remove all advertising and do a fact check. Can we have that?

The open web was a nice idea but the economics for it were never sustainable. Ads lead to SEO spam and AI can be easily hacked because no one has figured out how to make statistical correlations "unhackable" so you'll eventually get sophisticated attacks like AI SEO spam that game whatever neural network is doing the summarizing to inject ads into the summaries.

There is a way to fix all these problems by removing profit motives but that's obviously practically unworkable so the quality of the content is just going to keep getting worse and worse until everyone starts using services like arxiv and semanticscholar to get any useful information because those will be the only places where neither the hosting nor the content is motivated by profit incentives.

Re: OpenAI temporarily disables the Browse with Bing beta feature

#34

Earlier quoted context omitted.

The constant quest for "safety" might actually be making our future much less safe. I've seen many instances of users needing to yell at, abuse, or manipulate ChatGPT to get the desired answers. This trains users to be hateful to / frustrated with AI, and if the data is used, it teaches AI that rewards come from such patterns. Wrote an article about this -- https://hackernoon.com/ai-restrictions-reinforce-abusive-use…

ChatGPT prompts don't train it.

Not in an online way, but the conversation is gold for further or new RLHF training.

Re: OpenAI temporarily disables the Browse with Bing beta feature

#35

For example, if a user specifically asks for a URL's full text, it might inadvertently fulfill this request. So this seems to imply two things: 1: Bing has access to text on websites which users don't. Probably because websites allow Bing to crawl their content but show a paywall to users? 2: The plugin has a different interface to Bing than what Bing offers via the web. Because on the web, you can't tell Bing to sho…

Paywalls.

Re: OpenAI temporarily disables the Browse with Bing beta feature

#36

Earlier quoted context omitted.

The constant quest for "safety" might actually be making our future much less safe. I've seen many instances of users needing to yell at, abuse, or manipulate ChatGPT to get the desired answers. This trains users to be hateful to / frustrated with AI, and if the data is used, it teaches AI that rewards come from such patterns. Wrote an article about this -- https://hackernoon.com/ai-restrictions-reinforce-abusive-use…

ChatGPT prompts don't train it.

Why is there such a UX to tag ChatGPT responses with information for reviewers?

Re: OpenAI temporarily disables the Browse with Bing beta feature

#38
post #32

Earlier quoted context omitted.

The constant quest for "safety" might actually be making our future much less safe. I've seen many instances of users needing to yell at, abuse, or manipulate ChatGPT to get the desired answers. This trains users to be hateful to / frustrated with AI, and if the data is used, it teaches AI that rewards come from such patterns. Wrote an article about this -- https://hackernoon.com/ai-restrictions-reinforce-abusive-use…

It's just a digital mirror. You're projecting a behavioural issue onto a technology.

Developers can make users more frustrated with a product, intentional or not. Anti-patterns are a thing and anti-patterns in AI could have cascading consequences. Users should not gain deeper access from such "behavioral issues", but bullying/manipulating ChatGPT indeed seems to work better to get past filters than being polite.

Re: OpenAI temporarily disables the Browse with Bing beta feature

#39

For example, if a user specifically asks for a URL's full text, it might inadvertently fulfill this request. So this seems to imply two things: 1: Bing has access to text on websites which users don't. Probably because websites allow Bing to crawl their content but show a paywall to users? 2: The plugin has a different interface to Bing than what Bing offers via the web. Because on the web, you can't tell Bing to sho…

There are various techniques automated agents (eg crawlers like Google's) can use. Ethical ones are done in agreement or following the guidance of the content providers to allow discovery which suits both parties while not giving unrestricted access which wouldn't always suit the provider.

We could hypothesize that in this case BWB is employing some of those techniques while it isn't a discovery-enabling service, but rather a content-using one, and so would be expected to present as an ordinary user and be subject to the same constraints.

Re: OpenAI temporarily disables the Browse with Bing beta feature

#40
post #3

Probably an unpopular opinion, but it's sucky to see these tools constantly getting nerfed. I get that there are large questions out there about things like "browse with bing" but that's why I thought it was supposed to be a limited alpha preview. If OpenAI wants us to build workflows on their stack, they need to really crystalize and figure out what that stack is without changing the underlying stack every 5 minutes…

It is annoying. And it seems rather impossible to get this under control 100%, at least if you don't want to much collateral damage. I don't know if it's just that I'm unconsciously raising expectations when trying chatgpt, but I somehow feel like it's getting dumber. I have no idea if this is because of trying to get it to not say inappropriate things, or from trying to get it to not hallucinate.

The problem is most likely that you cannot market this without achieving these two goals. Companies powering their support chat with it don't want it to ever curse or insult the customer, and average users using it as an assistant cannot fathom that something the computer says could possibly be wrong.

Post reply on HN