I think this only applies to a rather narrow set of ideas. I'm not really interested in pursuing ideas that stop being good if somebody gets there first. If I bothered to design it its because I wanted it to exist and if somebody makes it exist then I'm happy because then I get to use it. So what kind of things does this apply to? Likely, it's zero sum games, schemes to control other people, ways to be the first to c…
The Cognitive Dark Forest
181–190 of 301 posts
Re: The Cognitive Dark Forest
#182It is also asymmetric. If you announce your presence, even if 4 out of 5 civs that notice you don’t annihilate you immediately (but they probably should), the fifth might. It’s just a probability game, with permadeath. So hiding is the most rational - the only - strategy of survival. This is a paranoid and cynical strategy that doesn't win out in the known history of life. What works is grow, expand, mingle, maintain…
Re: The Cognitive Dark Forest
#183When there's higher violence and lower property values in a Black neighborhood, people like OP are quick to blame Black culture. But when the "Cognitive Dark Forest" emerges from a community that shares its own common characteristics, suddenly collective accountability no longer applies.
When discussing violence in the Black community, it's "cultural." But when the subject turns to financial crimes or exploitation — where the per-capita ratios tell their own story — proportionality and population-to-crime-rate analysis mysteriously stop mattering.
It's difficult to take the "Cognitive Dark Forest" seriously as an existential concern when the people raising the alarm are so selectively offended. The crisis only becomes real when their innovations, their livelihoods, and their moats are threatened. Everyone else was supposed to just adapt.
The "Cognitive Dark Forest" is and will be continued to be perpetuated by "them" and if you really cared about the issue you would have addressed them.
Re: The Cognitive Dark Forest
#184The best analogy I can think of (quite similar to this one) is that the internet is low Earth orbit and AI is the Kessler syndrome. We abandon the place not to hide ourselves, but because it is saturated with garbage, and anything you try to put up there will only result in even more garbage being generated, without any positive effect. The ideal solution would be to remove the garbage, but right now we can't even de…
Best you can do is to spread all of the goods it provides, as it is too greedy to not devour them itself. It will consume them and suffocate slowly.
Re: The Cognitive Dark Forest
#185The thesis that in the past it was safe to share ideas and projects because the execution was hard, and that now things have changed because of AI is an interesting AI, but I wonder if it is really true. It certainly seems true that for small projects and relatively narrow scoped things that AI can replicate them easily. I'm thinking specifically about blog posts where people share their first steps and simple progra…
The blog post does touch upon this. The key difference, I believe, would be that compute scales in a way "meat-heads" doesn't, where if the other person has 100x the capital to throw at it, they could do the same 10 hour thing in 10 minutes.
Basically, what I got from it was that innovation has never been truly scalable enough to create the "dark forest", since hiring more and more engineers saturates quickly. But if/when innovation does become scalable (or crosses some scalability threshold) via AI, that could trigger a "dark forest" scenario.
Re: The Cognitive Dark Forest
#186I find the selective framing here very telling. When there's higher violence and lower property values in a Black neighborhood, people like OP are quick to blame Black culture. But when the "Cognitive Dark Forest" emerges from a community that shares its own common characteristics, suddenly collective accountability no longer applies. When discussing violence in the Black community, it's "cultural." But when the subj…
Re: The Cognitive Dark Forest
#187Thanks, this helped crystallize something for me: the play the AI labs are making is anti-fragile (in the Nassim Taleb sense): > The very act of resisting feeds what you resist and makes it less fragile to future resistance. At least along certain dimensions. I don't think the labs themselves are antifragile. Obviously we all know the labs are training on everything (so write/act the way you want future AIs to percei…
You have a point but current LLM architectures in particular are very fragile to data poisoning [1,2]. [1] https://www.anthropic.com/research/small-samples-poison [2] https://arxiv.org/abs/2510.07192
Re: The Cognitive Dark Forest
#188I find the selective framing here very telling. When there's higher violence and lower property values in a Black neighborhood, people like OP are quick to blame Black culture. But when the "Cognitive Dark Forest" emerges from a community that shares its own common characteristics, suddenly collective accountability no longer applies. When discussing violence in the Black community, it's "cultural." But when the subj…
Feel like we are trying to put the author in a bad (racist or classists?) light so we do not have to address the real issues touched on by the article.
Re: The Cognitive Dark Forest
#189I find the selective framing here very telling. When there's higher violence and lower property values in a Black neighborhood, people like OP are quick to blame Black culture. But when the "Cognitive Dark Forest" emerges from a community that shares its own common characteristics, suddenly collective accountability no longer applies. When discussing violence in the Black community, it's "cultural." But when the subj…
What are you talking about? You appear to be responding to a completely different subject to the essay.
Re: The Cognitive Dark Forest
#190The LLMisms in the "thinkpad" section caused me to close the tab
Everyday I see dozens of huge posts where someone has generated a wall of text that's expressing a very simple, very derivative idea and I see tons of earnest people replying with posts that the they've written themselves seemingly unaware of this and it really pisses me off to be honest. If you are going to generate your thinkpiece like this there should be an international law that says it can't be longer than two sentences.