Live data from Hacker News

I won a championship that doesn't exist

ron.stoner.com

101–110 of 141 posts

Re: I won a championship that doesn't exist

#101
post #97
post #51

Earlier quoted context omitted.

I mean, the name of that whale is now Teresa T. You gave it that name.

And your name is now Berningular Farshthruster III. I gave you that name. Which is, of course, silly. It is a name for you, just like Teresa T is a name for the whale, but it’s not your / their name, just like the RRS Sir David Attenborough is not named Boaty McBoatface (to the chagrin of most). Simon does not have the authority to unilaterally¹ name the whale (which is why the exercise makes sense). ¹ Important poin…

> Simon does not have the authority to unilaterally¹ name the whale

There's no such thing as authority to name a whale, and anyways I don't believe authority is strictly needed. A name is what people use to refer to something, full stop. It is only required that names become common-ish parlance; the more well known they are, the more they feel like the 'real' name. The inverse of Ohms is named Mhos (imo much more recognizable than the official name, "siemens"). The "#" symbol is named the hashtag, octothorp, pound sign, tic-tac-toe, number sign, and probably a million other things. Which one of these is the "real" primary name? I think intuitively we know that the real one is whatever people around us are most familiar with. You should take a guess, and I'll put the wikipedia-suggested-answer in the footnotes [1]. I bet your name for it is different than the 'official' wikipedia suggestion.

In the case of the whale, the _only_ name that is associated with that whale is Teresa T. I think this immediately makes it the most valid name of that whale.

[1] wikipedia says this is the number sign: https://en.wikipedia.org/wiki/Number_sign

Re: I won a championship that doesn't exist

#103
This has nothing to do with LLMs. If incorrect info can get onto a reputable resource, that info will seem authoritative, and it will be incorrect - that's not surprising. LLM's use publicly available info in their training, and often times publicly-available info is incorrect. I feel this is just as interesting as the base claim of 'I can get incorrect info onto wiki pages', no more interesting, and no less.

If somebody is trying to put out incorrect information on the internet, and they choose a small enough niche, it is not at all surprising that they can succeed.

Re: I won a championship that doesn't exist

#104

Pails in comparison to what Frank Dux and Frank Abagnale were able to convince much of the world they did with no evidence other than their own stories. Who knows how much of recorded and believed history is complete bullshit? Not to get too far into sacred territory, but claims around Siddhartha Gautama, Jesus Christ, and the Prophet Muhammad are quite a bit less plausible than the legends of Ragnar Lodbrok or the t…

Good point. Also, most humans seem to have no problems believing even stories that are self-contradictory. Philosophers from all periods have often stated that the situation with human mind and reasoning is almost hopeless.

The news here is that AI has too much trust in the internet. The first time I allowed tool-calling, it started googling up some nonsense instead of thinking... But I think at least it's possible for the AI to evaluate the quality of the source - you just have to ask for an analysis, and you'll get a reasonable evaluation. With humans, something like that just doesn't work - they'll get aggressive or might even start throwing bananas...

Re: I won a championship that doesn't exist

#105

Earlier quoted context omitted.

It's also clearly AI generated writing. That doesn't help its credibility or interest. I'm extremely suspicious of people who use AI to write an ostensibly personal blog, for all the usual obvious reasons.

What are you basing that on? I'm usually pretty good at sniffing out AI writing, and it smells human to me.

The line "This is the part that really matters." and the line "This is the circular citation pattern, and it’s one of the most under discussed attacks on the “retrieval augmented generation” trust model. " both raised flags. AI absolutely loves writing about the One Weird Trick that dentists don't want you to know. They love talking about "what really matters" or saying something is "the most under discussed" thing.

Then we get to the section "Why This Is A Bigger Deal Than It Looks". The title of this section again raises similar flags to before. But the bulleted list of:

1. The retrieval layer (immediately) 2. The model training corpus layer (months to years) 3. The agent layer (where the money is)

Absolutely reeks of AI. This list with this sequence of parentheticals is exactly how LLMs write, both structurally and the specific phrasing. This was the point where I felt confident enough to publicly accuse the post of AI writing.

I could go on with the prose in this section... How about "The attack surface is not hypothetical, it’s the default case."? Or "The cleanup problem for corpus poisoning is genuinely unsolved as of 2026."? (LLMs wildly overuse "genuine(ly)" and "real")

Re: I won a championship that doesn't exist

#106
post #77

Earlier quoted context omitted.

What are you basing that on? I'm usually pretty good at sniffing out AI writing, and it smells human to me.

Agreed. Nothing about this post really stood out as AI. It didn't raise a single flag for me. I think calling something AI generated is just a lazy way of dismissing stuff nowadays.

If this truly set off zero flags for you then you're probably just not very attuned to LLM writing style. I've noticed that most people are not.

I posted a bunch of specifics in a reply to the GP since I was quite annoyed with being accused of "a lazy way of dismissing stuff". It's nothing of the sort. I am a very good reader and I have read a lot of LLM writing and a lot of human writing.

Re: I won a championship that doesn't exist

#107
post #77

Earlier quoted context omitted.

What are you basing that on? I'm usually pretty good at sniffing out AI writing, and it smells human to me.

Agreed. Nothing about this post really stood out as AI. It didn't raise a single flag for me. I think calling something AI generated is just a lazy way of dismissing stuff nowadays.

This paragraph under ‘Trust Laundering’ is when it hit my AI writing trigger threshold:

> This is the circular citation pattern, and it’s one of the most under discussed attacks on the “retrieval augmented generation” trust model. It doesn’t require compromising Wikipedia’s infrastructure with l33t hacker skills. It doesn’t require social engineering an editor. You just simply write the source yourself, cite yourself on Wikipedia, and let the trust flow downstream. Easy peasy!

“It doesn’t X. It doesn’t Y. You just Z. Conclusion”

Once I saw that some other elements stood out too.

There’s a set of bullet points under ‘Thae Approach’ where each bullet starts with a bolded phrase: “one domain”, “one press release”, “one Wikipedia edit”, followed by a bolded sentence “The whole thing took maybe about twenty minutes”.

The emphasis here on irrelevant quantifiable optimizations - who cares that it only needs one of each of three things and it took under twenty minutes? - with unnecessary faux-profundity is a strong AI tell.

Add to that that the writer talks in the article about using AI generation to produce the content for the poisoning site, the suggestion that he used it to write up a blog post about this is hardly an implausible suggestion.

Re: I won a championship that doesn't exist

#108
post #90
post #88

Earlier quoted context omitted.

The fun part is when it’s important you have the right information to make a decision. Eg Russia to invade Ukraine and all top generals claim they can do it in 2 weeks. Similar for a corporation with layers of middle management deception and self promotion, I don’t know how executives make decisions but it must be RNG basically, because it certainly isn’t fact. Lying at scale is basically information noise.

If you don't lie enough, if you are not sycophantic enough, then no promotion or worst, purged. I can easily see how such a hierarchy would reproduce ... until it fails so bad it can't.

See also the SNAFU principle: http://ftp.informatik.rwth-aachen.de/jargon300/SNAFUprincipl...

Re: I won a championship that doesn't exist

#109
post #43

Earlier quoted context omitted.

Which illustrates another problem: unscrupulous actors with big names can spread whatever information they want to millions of people with minimal effort.

Yes, they can. We can be glad that respectable newspapers and TV news channels have never done it and never will. You can even trust than the headlines are accurate summaries of the content of the articles. /s

I started writing a response and realized I basically wrote the exact same thing the other day

https://news.ycombinator.com/item?id=47921829

Re: I won a championship that doesn't exist

#110

Most of the popular discourse around AI is still at the level of, "Don't trust the AI, trust the sources!" When it gets to the point where even the sources of simple facts are untrustworthy, the average person just trying to learn some trivia about the world is doomed. Doesn't help that AI media literacy is so primitive compared to how intelligent the models are generally. We're in a marginally better place than we w…

Wikipedia calls this https://en.wikipedia.org/wiki/Citogenesis (after XKCD coined it). You can expect the spicy autocomplete to feed you flattering bullshit. It may cite Wikipedia (it shouldn't), but you should go check out those citations, and validate the claims yourself. It's the least you can do. And if the cited source is Wikipedia... check Wikipedia's sources too. Wikipedians try their best to provide you with…

> ... eventually the only thing that accrues is things that the factions agree on, or at least what ArbCom has demanded they stop fighting over

Or what the faction with the most favored access to ArbCom manages to make stick by getting the other faction banned.

A state actor could absolutely cause immense damage to Wikipedia at scale, because most admins aren't experts in the subjects whose articles they police. I'm just surprised that nobody has done so already.

Post reply on HN