Live data from Hacker News

Editor's Note: Retraction of article containing fabricated quotations

arstechnica.com

181–190 of 223 posts

Re: Editor's Note: Retraction of article containing fabricated quotations

#181
post #177
post #166

Earlier quoted context omitted.

How do you unintentionally use an AI to help you write an article?

A fever can cause altered mental states, confusion, etc. It's not surprising that someone suffering from one would act out of character.

Yeah, personally with a high fever I’d say I’m more impaired than when I’m drunk. It’s not a state people should be doing anything important in.

Re: Editor's Note: Retraction of article containing fabricated quotations

#182
post #101

Several of the subscribers in the comments are so eager to praise Ars for "catching" the error and being honest by retracting the article, as if that's not an expected journalistic standard. They're so happy to have a reason NOT to be upset. This wasn't even caught by Ars or any of its readers. The guy being misquoted had to sign up and post a comment about it.

I'm happy that they fixed it, checked for any similar errors, and promised that they would improve their processes to try to prevent it from happening again. This is pretty much what I expect when an organization makes a mistake. Many organizations don't do as well.

Standard practice at most organisations these days is to apologize then keep doing it, it seems

Re: Editor's Note: Retraction of article containing fabricated quotations

#183
post #101

Several of the subscribers in the comments are so eager to praise Ars for "catching" the error and being honest by retracting the article, as if that's not an expected journalistic standard. They're so happy to have a reason NOT to be upset. This wasn't even caught by Ars or any of its readers. The guy being misquoted had to sign up and post a comment about it.

I mean, honestly, “it was a failure and we won’t do it again” is better than a lot of outlets would do; some have the magic robots wholesale make up articles for them.

Re: Editor's Note: Retraction of article containing fabricated quotations

#184

Former technology journalist here. If you want to experiment with reported news using untested tools that have known quality problems, do it in a strictly controlled environment where the output can be carefully vetted. Senior editor(s) need to be in the loop. Start with something easier, not controversial or high-profile articles. One other thing. If the author cut corners because he's too sick to write, but did so…

In mainstream journalism wasn't the practice to have a junior position research and confirm quotes, dates, proper names, etc?

Re: Editor's Note: Retraction of article containing fabricated quotations

#185

Earlier quoted context omitted.

Is it an American thing to work even when you are sick?

Depends entirely on the workplace and the individual. You can tell people not to work when they're sick, but it's not like they're not aware of deadlines for things that, in some cases, only they can reasonably do.

As someone who has deadlines, and is occasionally sick, if I have a high fever I am not working. Nor would my manager thank me for it if I did. If you have a high fever, you’re mentally impaired and shouldn’t be doing anything important if it can possibly be avoided.

Re: Editor's Note: Retraction of article containing fabricated quotations

#186
post #22

What are they changing to prevent this from happening in the future? Why was the use of LLMs not disclosed in the original article? Do they host any other articles covertly generated by LLMs? As far as I can tell, the pulled article had no obvious tells and was caught only because the quotes were entirely made up. Surely it's not the only one, though?

The _claim_ is that the article wasn’t AI generated, only the quote (the journalist rather unwisely trusted in the ability of an LLM to summarise things).

Re: Editor's Note: Retraction of article containing fabricated quotations

#187
post #100

Bluesky post by Benj (one of the authors of the article). https://bsky.app/profile/benjedwards.com/post/3mewgow6ch22p He admits to using an AI tool, says he was sick and did dumb things. He does clear Kyle (the other author).

Really refreshing to see someone owning up to their mistake, that is something rare nowadays.

[dead]

Re: Editor's Note: Retraction of article containing fabricated quotations

#188

Earlier quoted context omitted.

Yes. This is being treated as thought it were a mistake, and oh, humans make mistakes! But it was no mistake. Possibly it was a mistake on the part of whoever was responsible for reviewing the article before publication didn't catch it. But plagiariasm and fabrication require malicious intent, and the authors responsible engaged in both.

> Possibly it was a mistake on the part of whoever was responsible for reviewing the article before publication didn't catch it My wife, former journalist, said that you don’t direct quote anyone without talking to them first and verifying what you’re quoting is for sure from them. The she said “I guess they have no editors?” because in her experience editors aren’t like fact checkers but they’re suppose to have the…

In this case, the article was quoting a blog post, so presumably the editor (it _does_ look like there was one) took the arguably-not-unreasonable stance that _obviously_ the author wouldn't have fabricated quotes from a blog post they're literally linking to, that would be _insane_, nobody would do that. And thus that they didn't need to check.

And that might be a semi-justifiable stance if dealing with a human.

One of the many problems with our good friends the magic robots is that they don't just do incorrect stuff, they do _weird_ incorrect stuff, that a human would be unlikely to do, so it can fly under the radar.

Re: Editor's Note: Retraction of article containing fabricated quotations

#189

Earlier quoted context omitted.

I'll admit that at least looks consistent with extreme carelessness rather than lying. I don't find it terribly convincing, though. I find it a suspiciously long chain of excuses perfectly calibrated to excuse the events. The description gets vague right at the critical point where AI output gets laundered into journalistic output, and the part about the tool being strictly to gather "verbatim source material" sounds…

Well I appreciate you taking the time to respond and acknowledge the new evidence. I agree with the broad point that dishonesty can't be tolerated in a newsroom. And it's a "Caesar's wife must be beyond reproach" situation, the appearance of dishonesty is very bad regardless of the reality. And despite what Orland claims I do think there's blame to go around for not catching the mistake (assuming we accept his accoun…

> but it is weird for him to have COVID in December and February.

Unlucky, sure, but not beyond the bounds of possibility. Also possible that one or both was actually flu or RSV or other non-COVID fever-inducing respiratory disease; people often just bucket them all under COVID these days (a bit like they used to with flu).

Re: Editor's Note: Retraction of article containing fabricated quotations

#190

People put a lot of weight on blame-free post-mortems and not punishing people who make "mistakes", but I believe that has to stop at the level of malice. Falsifying quotes is malice. Fire the malicious party or everything else you say is worthless.

I don’t see how you could know that without more information. Using an AI tool doesn’t imply that they thought it would make up quotes. It might just be careless. Assuming malice without investigating is itself careless.

> Using an AI tool doesn’t imply that they thought it would make up quotes

He covers AI for Ars Technica. Like, if he doesn't know that chatbots make shit up...

FWIW I suspect that a lot of the problem here was that he was _working while he had a high fever_. This is a really bad idea.

Post reply on HN