This isn't an AI problem...
Clickbait headline.
Scientists invented a fake disease. AI told people it was real
21–30 of 97 posts
Re: Scientists invented a fake disease. AI told people it was real
#22Seems to be a failure of the publishing system. For humans, or Ai, to have any knowledge, we need to have trustworthy sources. Naturally,when you use publishing systems considered trust worthy, that is going to be trusted.
[dead]
Re: Scientists invented a fake disease. AI told people it was real
#23You’ve seen people game adsense It’s gunna be even wilder when people realise they have an incentive to seed fake information on the internet to game AI product recommendations I’ve already bought stuff based off of an AI suggestion, I didn’t even consider it would be so easy to influence the suggestion. Just two research papers? Mad.
This has a name already: "AEO (Answer Engine Optimization)".
Re: Scientists invented a fake disease. AI told people it was real
#24What stops a small, or even a large group of people to intentionally "poison" the LLMs for everyone? Seems to me that they are very fragile, and that an attack like that could cost AI companies a lot. How are they defending themselves from such attacks?
Re: Scientists invented a fake disease. AI told people it was real
#25This would work on people too, you can see daily fake info/text/videos and many people believing in them.
LLMs do not think, why this is still hard to understand? They just spit out whatever data they analyse and trained on.
I feel this kind of articles is aimed at people who hate AI and just want to be conformable within their own bias.
Re: Scientists invented a fake disease. AI told people it was real
#26You’ve seen people game adsense It’s gunna be even wilder when people realise they have an incentive to seed fake information on the internet to game AI product recommendations I’ve already bought stuff based off of an AI suggestion, I didn’t even consider it would be so easy to influence the suggestion. Just two research papers? Mad.
This has a name already: "AEO (Answer Engine Optimization)".
I hate people. Things could be so good if we weren't the way we are.
Re: Scientists invented a fake disease. AI told people it was real
#27One of the frustrating parts about LLMs is that they are so neutered and conditioned to be politically correct and non-offensive, they are polite more than correct.
Its too easy to "lead the witness" if you say "could the problem be X?" It will do an unending amount of mental gymnastics to find a way that it could be X, often constructing elaborate rube Goldberg type logic rats nests so that it can say those magic words "you're absolutely right"
I would pay a lot of money for a blunt, non-politeness conditioned LLM that I would happily use with the knowledge it might occasionally say something offensive if it meant I would get the plain, cold, hard truth, instead of something watered down, placating, nanny-state robotic sycophant, creating logical spider webs desperate for acceptance, so the public doesn't get their little feelings hurt or inadequacies shown.
Re: Scientists invented a fake disease. AI told people it was real
#28This would work on people too, you can see daily fake info/text/videos and many people believing in them. LLMs do not think, why this is still hard to understand? They just spit out whatever data they analyse and trained on. I feel this kind of articles is aimed at people who hate AI and just want to be conformable within their own bias.
The journals the scientist submitted had a fake university, explicitly fake people, references to the simpsons and star trek, etc
Most doctors would not believe that, and would also consider any new eye disease they’d never see in real life with scepticism
Re: Scientists invented a fake disease. AI told people it was real
#29What stops a small, or even a large group of people to intentionally "poison" the LLMs for everyone? Seems to me that they are very fragile, and that an attack like that could cost AI companies a lot. How are they defending themselves from such attacks?
This is already a thing: https://www.scworld.com/brief/poison-fountain-initiative-aim...
We'll see if they succeed.
Re: Scientists invented a fake disease. AI told people it was real
#30One of the frustrating parts about LLMs is that they are so neutered and conditioned to be politically correct and non-offensive, they are polite more than correct. Its too easy to "lead the witness" if you say "could the problem be X?" It will do an unending amount of mental gymnastics to find a way that it could be X, often constructing elaborate rube Goldberg type logic rats nests so that it can say those magic wo…
Claude: Dutch Mode