Live data from Hacker News

ChatGPT provides false information about people, and OpenAI can't correct it

noyb.eu

1–10 of 92 posts

Re: ChatGPT provides false information about people, and OpenAI can't correct it

#3
post #2

Popcorn time: NOYB (Max Schrems) filed a complaint against OpenAI with the Austrian DPA: ChatGPT is not GDPR compliant.

Sounds like a win for the US...get competing economies to block the technology for trivial reasons, then by time the bugs are worked out they will be so far behind that their only choice will be to choose US-based solutions

Re: ChatGPT provides false information about people, and OpenAI can't correct it

#4
IMHO this is not a fixable problem, it's not even a new problem because false information existed since ever. With the Web it become globally available, with social media it become globally spreadable and with "AI" it has become of endless supply in form and variety.

Humans need to develop humane defense mechanisms for the new reality, tech cannot be stopped and cannot be hermetically insulated against mistakes or bad actors.

Re: ChatGPT provides false information about people, and OpenAI can't correct it

#6
This seems so backwards to me. As a user of LLMs, it's clear to me that tokens generated by ChatGPT and similar are not to be interpreted as a legally-valid statement by the company making the LLMs, unless explicitly stated by said company. I certainly don't engage with them that way. I believe this to be fairly obvious to anyone who has used such tools, so I just see this as an opportunity to sue for a quick buck.

Re: ChatGPT provides false information about people, and OpenAI can't correct it

#7
Every single time...

https://hachyderm.io/@inthehands/112006855076082650

> You might be surprised to learn that I actually think LLMs have the potential to be not only fun but genuinely useful. “Show me some bullshit that would be typical in this context” can be a genuinely helpful question to have answered, in code and in natural language — for brainstorming, for seeing common conventions in an unfamiliar context, for having something crappy to react to.

> Alas, that does not remotely resemble how people are pitching this technology.

Re: ChatGPT provides false information about people, and OpenAI can't correct it

#8

This seems so backwards to me. As a user of LLMs, it's clear to me that tokens generated by ChatGPT and similar are not to be interpreted as a legally-valid statement by the company making the LLMs, unless explicitly stated by said company. I certainly don't engage with them that way. I believe this to be fairly obvious to anyone who has used such tools, so I just see this as an opportunity to sue for a quick buck.

NOYB doesn't make money out of suing. I otherwise agree with the rest of your comment.

Re: ChatGPT provides false information about people, and OpenAI can't correct it

#9
post #2

Popcorn time: NOYB (Max Schrems) filed a complaint against OpenAI with the Austrian DPA: ChatGPT is not GDPR compliant.

Sounds like a win for the US...get competing economies to block the technology for trivial reasons, then by time the bugs are worked out they will be so far behind that their only choice will be to choose US-based solutions

> trivial reasons

Come again?

Re: ChatGPT provides false information about people, and OpenAI can't correct it

#10
People have a fundamental misunderstanding of what LLMs are.

I’ve had to explain this so many times even to engineers. People keep using it as Google. It is not a mechanism to retrieve facts.

It’s rather a reasoning mechanism, that when used like a search engine generates text that looks like output from a retrieval of facts.

The article talks about OpenAI being unwilling to correct errors. But they just can’t. There just aren’t facts like birthdays for specific people discernible from the weights. Maybe for some.

So what would they correct? The best that can be done is like it is said in the article, apply filtering to refuse to answer.

Post reply on HN