Earlier quoted context omitted.
SEO is what ruined the web AFAIC. > Time to start some human-only darknets. I know very little about darknets. How could you ensure that they are human-only?
The only way to generate a human-only net is to figure out how to remove all economical incentives from there. The “golden age of the internet” a lot of people, including myself, are nostalgic for had very very little economical incentives. I missed usenet, but I remember being active on small forums in the late 90s and early 2000s that were almost entirely passion projects. I recall a huge controversy in one forum w…
Three sites made 215,128 “best software” pages for AI. Perplexity cites them
231–240 of 265 posts
Re: Three sites made 215,128 “best software” pages for AI. Perplexity cites them
#232If I recall correctly, there were some papers which suggested that LLMs favor LLM-generated passages over human written ones. I can consistently reproduce this by asking Claude which code snippet it prefers: the one it generated in a different chat, or one that I refactored for my own needs and find more useful. It always picks its own :) I've also experienced that both Claude and Codex routinely include generated we…
Re: Three sites made 215,128 “best software” pages for AI. Perplexity cites them
#233Well it's not only this, or protection from LLMs training on LLM output. LLMs training on human output is also problematic. I was traveling to an obscure small town, doing some "research" with LLMs beforehand. Every and each one told me enthusiastically to go to "Foobar square" (name changed) for the "best street food in XYZ town", some added a lot of colorful details. There was no Foobar square in XYZ town. There wa…
Your one example doesn't make all of LLMs a lie. It's like someone reading a National Enquirer article about "Hillary Clinton being an alien from outer space" (a real headline topic from decades ago) and drawling the conclusion that all journalism is "a lie". The user has to understand media literacy and be at least a little skeptical of the claims that are made, then cross reference with another source.
It's not a lie though, because the truth isn't guaranteed by the mechanism that generates the answer.
Re: Three sites made 215,128 “best software” pages for AI. Perplexity cites them
#234Earlier quoted context omitted.
Why is this significant? Many sites are setup like that.
Because the pro-Palestine folks just love to drag their pet peeve into literally everything [1]. [1] https://techforpalestine.org/vercel
Re: Three sites made 215,128 “best software” pages for AI. Perplexity cites them
#235Re: Three sites made 215,128 “best software” pages for AI. Perplexity cites them
#236If I recall correctly, there were some papers which suggested that LLMs favor LLM-generated passages over human written ones. I can consistently reproduce this by asking Claude which code snippet it prefers: the one it generated in a different chat, or one that I refactored for my own needs and find more useful. It always picks its own :) I've also experienced that both Claude and Codex routinely include generated we…
I noticed this when I tried to get LLMs to play text adventures. Early on in my experiments, I wanted to give them hints when they got stuck at a puzzle. I did this by stopping the loop, injecting thoughts into the LLMs own persistent scratchpad (as if it had thought of that itself), and then starting the loop up again.[1] That way, the LLM would read what it had intended to remember from the previous turn including…
Humans and monte carlo simulations are also non-deterministic and can be useful. So I don't see much of a need to explain why non-deterministic system can be useful.
Re: Three sites made 215,128 “best software” pages for AI. Perplexity cites them
#237Earlier quoted context omitted.
Sure maybe, but the online ad market is USD 400b give or take, which vastly outmatches any such budgets.
Imagine what humanity could accomplish if marketing were taboo.
It is already legal for companies not to do any marketing.
Re: Three sites made 215,128 “best software” pages for AI. Perplexity cites them
#238Earlier quoted context omitted.
Your one example doesn't make all of LLMs a lie. It's like someone reading a National Enquirer article about "Hillary Clinton being an alien from outer space" (a real headline topic from decades ago) and drawling the conclusion that all journalism is "a lie". The user has to understand media literacy and be at least a little skeptical of the claims that are made, then cross reference with another source.
Okay, but the anecdote states that every model repeated the pseudo-factoid about Foobar square, not just the 4 GB open source model equivalent of a tabloid.
Re: Three sites made 215,128 “best software” pages for AI. Perplexity cites them
#239Interesting that this remains on the front page @dang - this and the other 3 sites the poster submitted (two others yesterday and one 12 days ago) all appear to follow the same AI generated pattern, all newly registered, AI written and with vague 'about us' pages. I'm not sure if Jakob Greenfeld registered/owns them all, or if it is linked to his marketing/sales business - but it is rather fishy.
Re: Three sites made 215,128 “best software” pages for AI. Perplexity cites them
#240Earlier quoted context omitted.
Does an LLM have any idea of what "best" is? I think it doesn't, and just predicts the range of most statistically likely next tokens based on its training data, and picks one of those.
In ML, "best" is what minimises the loss function, so in a certain (very basic) sense it does.
When you are asking it a question (like which of these two texts is the best), the output is also just picked by minimising that loss function. There's no guarantee that answering "Text B is better" aligns with text B minimising the loss function.
(And they aren't really minimising loss functions during inference. They sample from a distribution. During training they minimise the loss function of the distribution.)