Live data from Hacker News

AI advice made people less accurate but more confident – sudy

thenextweb.com

51–60 of 234 posts

Re: AI advice made people less accurate but more confident – sudy

#51

Advice and information subreddits have gone to shit because of AI usage. A large number of people seem to think that when someone asks a question, what they really want is not someone with direct knowledge, but instead someone to relay the question to ChatGPT and post the result as if it is their own hard earned knowledge and insight. I have no idea about the quality of this research but in the real world (well, real…

You mean like this? https://xkcd.com/903/

Re: AI advice made people less accurate but more confident – sudy

#52

Did they ask any substantive questions? It sounds like they asked movie trivia questions, in a way that the LLM was almost guaranteed to be wrong. So extremely low-stakes where there is no conceivable downside to being wrong.

That was exactly the point - there was no downside to saying you just don't know, people didn't know, but they still chose to use (what they thought was) AI and got it wrong that way.

Re: AI advice made people less accurate but more confident – sudy

#53

Advice and information subreddits have gone to shit because of AI usage. A large number of people seem to think that when someone asks a question, what they really want is not someone with direct knowledge, but instead someone to relay the question to ChatGPT and post the result as if it is their own hard earned knowledge and insight. I have no idea about the quality of this research but in the real world (well, real…

Writing and videos produced before 2022 are the information equivalent of low-background steel (steel produced before the atom bomb era). Not all are precious, but they are important. AI influences are so pervasive at this point, even in informational writing from domain experts.

Relentless grounding is my personal solution for my AI epistemic crisis, but it's an expensive solution in terms of time and effort, and triage is hard too.

Re: AI advice made people less accurate but more confident – sudy

#55
post #7

AI pessimist view. Even if AI gets smarter it will still be agreeable, and people will use it to more confidently reinforce thier stupider ideas, especially in areas where they lack the knowledge to know if they are right. Even if this can be solved, technically, people won't want to use the model that says they are wrong, so they will choose the glib lies that reinforce their beliefs. Freedown of speech forces peopl…

Im not mad about this.

As someone who rarely uses LLMs because I dont need to, nor does it benefit me - I work on stuff that is original for which LLMs are useless at - Im glad.

I want everyone around me to get dumb as hell. It makes my path in life much easier and more successful.

Re: AI advice made people less accurate but more confident – sudy

#56

Advice and information subreddits have gone to shit because of AI usage. A large number of people seem to think that when someone asks a question, what they really want is not someone with direct knowledge, but instead someone to relay the question to ChatGPT and post the result as if it is their own hard earned knowledge and insight. I have no idea about the quality of this research but in the real world (well, real…

[deleted]

Re: AI advice made people less accurate but more confident – sudy

#57
Instead of monetary rewards, they should preface it with, "This is AI model is not very accurate on these types of questions" and then see how they fare. In some areas, AI is quite accurate, so their experience may lead to different expectations.

Re: AI advice made people less accurate but more confident – sudy

#58
post #15
post #8

This was posted earlier but didn’t get traction, and I made the following comment: Id want to know if “AI” makes a material difference vs just having access to the wrong answer. Like someone could be given search access that successfully retrieved wrong answers to questions, would that give the same results. How much do uniquely AI characteristics, like sycophancy or the conversational aspect play into this, vs peopl…

You can read the study here: https://osf.io/preprints/psyarxiv/5y6m4_v1 TLDR: They studied both cases (Access to a LLM/Chat interface which gives a wrong answer when asked, and access to pregenerated (wrong) answers). Both experiments yielded similar results.

That is not a good summary. In all their versions of the experiment, they presented the tool as AI, and used actual LLM answers. In the first example, participants were directly interacting with a real, though small, LLM, but they had technical issues because of that - 10% of the time the LLM setup failed to present an answer at all. So they redid the experiment with pre-generated answers - the participants saw the same UI, but when they asked the question of the AI, they instead got one of 3 pre-generated answers from that AI, to avoid the technical issues.

Re: AI advice made people less accurate but more confident – sudy

#60

Advice and information subreddits have gone to shit because of AI usage. A large number of people seem to think that when someone asks a question, what they really want is not someone with direct knowledge, but instead someone to relay the question to ChatGPT and post the result as if it is their own hard earned knowledge and insight. I have no idea about the quality of this research but in the real world (well, real…

[flagged]
Post reply on HN