Three sites made 215,128 “best software” pages for AI. Perplexity cites them

Post by marcus_holmes » Thu, Sep 03, 2026, 2:23 AM UTC

dspillett wrote: post #149

xpct wrote: post #18

If I recall correctly, there were some papers which suggested that LLMs favor LLM-generated passages over human written ones. I can consistently reproduce this by asking Claude which code snippet it prefers: the one it generated in a different chat, or one that I refactored for my own needs and find more useful. It always picks its own :) I've also experienced that both Claude and Codex routinely include generated we…

> If I recall correctly, there were some papers which suggested that LLMs favor LLM-generated passages over human written ones That makes sense. What an LLM does is output what the model thinks is the best set of tokens in response to a given input, so when you ask it to judge the best response to that input it is going to conclude that the best one is the one that must closely matches what it would output, which is…

Post by brador » Thu, Sep 03, 2026, 2:31 AM UTC

Post by xp84 » Thu, Sep 03, 2026, 2:38 AM UTC

cainxinth wrote: post #86

xpct wrote: post #18

If I recall correctly, there were some papers which suggested that LLMs favor LLM-generated passages over human written ones. I can consistently reproduce this by asking Claude which code snippet it prefers: the one it generated in a different chat, or one that I refactored for my own needs and find more useful. It always picks its own :) I've also experienced that both Claude and Codex routinely include generated we…

Take a random essay and add in a bunch of the phrases that LLMs love like “load-bearing,” “crucial,” structural,” and “woven,” and then submit the original and the edited version to an LLM and ask which is better. It will choose the second one virtually every time. They have ingrained biases that associate those words with good writing and arguments.

Post by ShinyLeftPad » Thu, Sep 03, 2026, 2:43 AM UTC

lelanthran wrote: post #115

xpct wrote: post #18

If I recall correctly, there were some papers which suggested that LLMs favor LLM-generated passages over human written ones. I can consistently reproduce this by asking Claude which code snippet it prefers: the one it generated in a different chat, or one that I refactored for my own needs and find more useful. It always picks its own :) I've also experienced that both Claude and Codex routinely include generated we…

> I can consistently reproduce this by asking Claude which code snippet it prefers: the one it generated in a different chat, or one that I refactored for my own needs and find more useful. It always picks its own :) A better question to ask for each snippet is "Estimate the seniority and competence of the developer who wrote the following code, ignoring bugs that linters or LLMs can catch and focus only on structure…

Post by ShinyLeftPad » Thu, Sep 03, 2026, 2:45 AM UTC

iamacyborg wrote: post #83

dgellow wrote: post #74

Earlier quoted context omitted.

A bit different, but one thing I’ve seen is models repackaging Reddit slop. Like, it will do a search, find a Reddit thread somewhat related where someone in a comment casually mentioned incorrect information that any human would have dismissed. The model takes that as granted, but expands on it and present it as a well established fact, presented in a very plausible fashion. In general I don’t find models to be good…

Newspapers have been doing this for a long time, notably the Metro in London.