Live data from Hacker News

Editor's Note: Retraction of article containing fabricated quotations

arstechnica.com

31–40 of 223 posts

Re: Editor's Note: Retraction of article containing fabricated quotations

#31
post #29

Earlier quoted context omitted.

The bylines are known, check in 4-5 months whether either or both names still appear on new articles or not..

They're both still on the staff page presently. https://arstechnica.com/staff-directory/ It is definitely not a good look for a "Senior AI Reporter."

This is a US holiday weekend and lots of people are going to be on weekend vacations. Check back on Wednesday.

Re: Editor's Note: Retraction of article containing fabricated quotations

#32
post #15

People put a lot of weight on blame-free post-mortems and not punishing people who make "mistakes", but I believe that has to stop at the level of malice. Falsifying quotes is malice. Fire the malicious party or everything else you say is worthless.

There’s no malice if there was no intention of falsifying quotes. Using a flawed tool doesn’t count as intention.

> Using a flawed tool doesn’t count as intention.

"Ars Technica does not permit the publication of AI-generated material unless it is clearly labeled and presented for demonstration purposes. That rule is not optional, and it was not followed here."

They aren't allowed to use the tool, so there was clearly intention.

Re: Editor's Note: Retraction of article containing fabricated quotations

#33
post #21
post #5

Earlier quoted context omitted.

I don't know how you could possibly have that take away from reading this. They did a review of their context to confirm this was an isolated incident and reaffirmed that it did not follow the journalistic standards they have set for themselves. They admit wrong doing here and point to multiple policy violations.

> That rule is not optional, and it was not followed here. It’s not optional, but wasn’t followed, with zero repercussions. Sounds optional.

Reading between the lines, this is corporate-speak for "this is a terminable offense for the employees involved." It's a holiday weekend in the US so they may need to wait for office staff to return to begin the process.

Re: Editor's Note: Retraction of article containing fabricated quotations

#35

Earlier quoted context omitted.

The comments are trending towards being more critical as of my posting. A lot more asking what they're going to do about the authors, and what the hell happened.

> Greatly appreciate this direct statement clarifying your standards, and yet another reason that I hope Ars can remain a strong example of quality journalism in a world where that is becoming hard to find > Kudos to ARS for catching this and very publicly stating it. > Thank you for upholding your journalistic standards. And a note to our current administration in DC - this is what transparency looks like. > Thank y…

No reason to trust that the comment section is any more genuine than the deleted fake article. If an Ars employee used genAI to astroturf these comments, they clearly would not be fired for it or even called out by name.

Re: Editor's Note: Retraction of article containing fabricated quotations

#36

Earlier quoted context omitted.

They're expected by policy to not use AI. Lying about using AI is also malice.

It's a reckless disregard for the readers and the subjects of the article. Still not malice though, which is about intent to harm.

Lying is intent to deceive. Deception is harm. This is not complicated.

Re: Editor's Note: Retraction of article containing fabricated quotations

#38
post #22

What are they changing to prevent this from happening in the future? Why was the use of LLMs not disclosed in the original article? Do they host any other articles covertly generated by LLMs? As far as I can tell, the pulled article had no obvious tells and was caught only because the quotes were entirely made up. Surely it's not the only one, though?

My read is, "Oops someone made a mistake and got caught. That shouldn't have happened. Let's do better in the future." and that's about it.

Re: Editor's Note: Retraction of article containing fabricated quotations

#39
post #24

Earlier quoted context omitted.

No one said it was defensible. They drew a distinction between incompetence and malice. Let's not misquote each other here in the comments.

Even if it didn't fabricate quotes wholesale, taking an LLM's output and claiming it as your own writing is textbook plagiarism, which is malicious intent. Then, if you know that LLMs are next-token-prediction-engines that have no concept of "truth" and are programmed solely to generate probabilistically-likely text with no specific mechanism of anchoring to "reality" or "facts", and you use that output in a journal…

The article in question appears to me to be written by a human (excluding what's in quotation marks), but of course neither of us has a crystal ball. Are there particular parts of it that you would flag as generated?

Honestly I'm just not astounded by that level of incompetence. I'm not saying I'm impressed or that's it's okay. But I've heard much worse stories of journalistic malpractice. It's a topical, disposable article. Again, that doesn't justify anything, but it doesn't surprise me that a short summary of a series of forum exchanges and blog posts was low effort.

Re: Editor's Note: Retraction of article containing fabricated quotations

#40

People put a lot of weight on blame-free post-mortems and not punishing people who make "mistakes", but I believe that has to stop at the level of malice. Falsifying quotes is malice. Fire the malicious party or everything else you say is worthless.

That don't actually say it's a blame free post-mortem, nor is it worded as such. They do say it's their policy not to publish AI generated anything unless specifically labelled. So the assumption would be that someone didn't follow policy and there will be repercussions.

The problem is people on the Internet, hn included, always howl for maximalist repercussions every time. ie someone should be fired. I don't see that as a healthy or proportionate response, I hope they just reinforce that policy and everyone keeps their jobs and learns a little.

Post reply on HN