Live data from Hacker News

GenAI, the snake eating its own tail

ybrikman.com

121–130 of 138 posts

Re: GenAI, the snake eating its own tail

#121
post #111

Earlier quoted context omitted.

Poison Fountain: https://rnsaffn.com/poison2/ https://www.theregister.com/2026/01/11/industry_insiders_see...

Yea, this will work about as well as those image poisoners... they'll eat up more power, but won't have any effect at the end of the day.

It only takes 50 poisoned documents to make an LLM training algorithm spit out wrong results on a specific topic, and 250 can make it produce complete gibberish. https://www.anthropic.com/research/small-samples-poison

Re: GenAI, the snake eating its own tail

#122
post #21

Earlier quoted context omitted.

StackOverflow as built back in the days of Web 2.0 where the idea was that user generated content formed in the days of the (relatively) altruistic web. There isn't any clean way to do "contributor gets paid" without adding in an entire mess of "ok, where is the money coming from? Paywalls? Advertising? Subscriptions?" and then also get into the mess of international money transfers (how do you pay someone in Iran fr…

Stack Overflow is making money by selling its database to AI companies. It chose not to reimburse the people who built that database.

https://archive.org/search?query=creator%3A%22Stack+Exchange...

You can download the database for free.

Trying to say "give us your payment and tax information so that we can pay you $0.13 for your contributions" would be even more insulting than not paying anyone.

Doing renumeration for people in some countries could get legally challenging too.

Re: GenAI, the snake eating its own tail

#123
post #122

Earlier quoted context omitted.

Stack Overflow is making money by selling its database to AI companies. It chose not to reimburse the people who built that database.

https://archive.org/search?query=creator%3A%22Stack+Exchange... You can download the database for free. Trying to say "give us your payment and tax information so that we can pay you $0.13 for your contributions" would be even more insulting than not paying anyone. Doing renumeration for people in some countries could get legally challenging too.

Doesn't make a lot of sense, does it? But they adopted it as their new business model nonetheless. Just one more stupid decision on the pile.

Re: GenAI, the snake eating its own tail

#124
post #86

Isn't this a self solving problem? If LLMs won't be able to solve a certain problem, arbitrage opportunities open to solve it as a human (by writing a blog post for example), just like in the old days, people typically did this for fame. I think LLMs can be understood as a really good way to search existing solutions, including combining multiple solutions in the fly. Only if something cannot be "found", we go back t…

There may like 0.001% of the general population who would ever write a blog post, most of the LLM data in future would be fake blog posts used to trick LLMs or just spam.

Re: GenAI, the snake eating its own tail

#125
post #53

Companies will provide incentives for people to generate authentic content. Example X giving $1M reward for the top Articles. Because they can use it for training. In fact, this might be overall good thing, because finally original content will be highly on demand since those companies now use to train their models. But we are probably just in a transition phase. The other thing is that new sources of input will come…

> Example X giving $1M reward for the top Articles.

Oh boy I can already see what kind of articles those would be.

Re: GenAI, the snake eating its own tail

#126
post #83

Earlier quoted context omitted.

How do you evaluate if content is authentic?

Eventually it won’t matter. People will forget what it was like to have authentic content. They’d look at it like how we might view monks in the middle ages copying the bible a hundred times by hand. Even today people don’t even trust themselves to write an email. You see people on HN and reddit openly admitting they used ai to help make their post because they believe they cannot write. The march to illiteracy and i…

> People will forget what it was like to have authentic content.

This is already true. Most people on the internet are stuck in tiktok loop anyway. Even chatgpt would struggle to get them. By the time LLMs get good enough, a lot of people who were willing to pay for them would have lost their jobs and they would not be paying for something that costed them their job, many will quit the internet fully. We are looking at value being driven out of internet at a grand scale.

Re: GenAI, the snake eating its own tail

#127
post #115

Earlier quoted context omitted.

> He made a new industry. He didn't cannibalize an existing one. I don't see how you can claim the second part is true. Cars directly cannibalized other forms of self transportation.

? Cars don't "eat" horses. I wouldn't equate "making redundant" with "consuming"

Cannibalizing a is a common phrase to describe the act of a new thing outcompeting an existing thing to another thing to the degree that it significantly harms the market share, sometimes to the point of figurative extinction. Redundancy is a very common reason for this to occur.

It has nothing to do with literally eating.

Re: GenAI, the snake eating its own tail

#128
post #58

Earlier quoted context omitted.

The proposed solution is also pretty confused: > For each response, the GenAI tool lists the sources from which it extracted that content, perhaps formatted as a list of links back to the content creators, sorted by relevance, similar to a search engine This literally isn’t possible given the architecture of transformer models and there’s no indication it will ever be.

Technically correct, but the workarounds AI search engines use for grounding results could be a close enough approximation. Might not be accurate, but could be better than nothing. Also Anthropic is doing interesting work in interpretability, who knows what could come out of that. And could be snake oil, but this startup claims to be able to attribute AI outputs to ingested content: https://prorata.ai/

Not every LLM implementation can use RAG against a Google-sized knowledge base. This proposal essentially says LLMs have to be paired with Google to be legit.

Re: GenAI, the snake eating its own tail

#129
post #82

Earlier quoted context omitted.

Inscryption is the GOAT, beautiful game. Played it when I had Covid.

> Inscryption is the GOAT, beautiful game. Played it when I had Covid. Oh Man, Y'know I once beat Inscryption's kaycee's mods challenge without doing any blood sacrifice the whole run after I got bored when I had defeated all kaycee's mods The gecko deck was amazing. I even played some mods of Inscryption. It was so lovely. The people who play inscryption & people who don't aren't the same lol. Played it during covid…

Man it’s been a while so I don’t remember all the details, but I think I created a card that was a combination of the Mantis God and the Ouroboros or something like that, so this card had triple strike and was hitting for like 60 damage a turn lol.

The aesthetic of the game is just so beautiful too. One of my all time favorites.

Re: GenAI, the snake eating its own tail

#130
The “snake eating its own tail” frame is real, but it’s not mystical — it’s incentives + sampling.

If the web gets flooded with LLM output and you train on it naively, you’re effectively training on your own prior. That pushes models toward the mean: less surprise, less specificity, more template-y phrasing. It’s like photocopying a photocopy: the sharp edges disappear.

The fix isn’t “never use synthetic data.” It’s to treat it like a controlled ingredient: tag provenance, keep a high-quality human/grounded core, filter aggressively, and anchor training to things that don’t self-contaminate (code that compiles/tests, math with verifiable proofs, retrieval with citations, real user feedback). Otherwise the easiest path is content volume, and volume is exactly what kills signal.

Post reply on HN