Tech CEOs are apparently suffering from AI psychosis

Post by Telemakhos » Wed, May 27, 2026, 10:42 PM UTC

20after4 wrote: post #263

moffkalast wrote: post #158

Earlier quoted context omitted.

I was reading some posts on r/locallama the other day and apparently it's a common problem that when people try to use Qwen to develop something that hosts a server, it'll try to use the same port as vllm, see that it's already being used, then it'll try to remove the process that is using it and promptly commit suicide. The self awareness of missile tasked with blowing up its own control center.

Reminds me of the movie "Dark Star" by John Carpenter / Dan O'Bannon. The plot revolves around a talking smart bomb which is programmed to detonate and then gets stuck before being deployed. The crew spends the whole movie trying to reason with the bomb, hoping to talk it out of blowing up at the designated time. The movie is very very bad but if you like B movies it is also very very good.

Post by jldugger » Wed, May 27, 2026, 10:50 PM UTC

captn3m0 wrote: post #245

dogleash wrote: post #243

Earlier quoted context omitted.

>before all the musings about painting by people who have never picked up a brush I can't tell if this is a clever dig that comically undercuts the premise of the previous line, or it's an unaware unironic attempt to separate off a perceived un-serious type of poster.

https://en.wikipedia.org/wiki/Hackers_%26_Painters

Post by agumonkey » Wed, May 27, 2026, 10:57 PM UTC

gopalv wrote: post #53

If you manage 500+ people organization, most of the headaches with agents already exists with you - you set directions, ask people to go run fast in those directions, check in frequently and course correct on results without actually understanding those people do. Those aren't the deal breakers. They entirely rely on the competence of the folks they hired and cross-match enforcers with the drivers they have - they de…

Post by krapp » Wed, May 27, 2026, 11:05 PM UTC

kolinko wrote: post #274

sterlind wrote: post #227

Earlier quoted context omitted.

a literal lack of self-awareness, even. I imagine if you asked it what process was using the port, it'd think and realize it was its own, but that kind of reflexive self-awareness (the unprompted kind) is missing. the weaker models will happily kill their own process, even after confirming it belongs to them. the models have a sort of fixation and lack of foreseeable consequences, which reasoning RL has thus far fail…

On the other hand, I found Claude/Opus to be extremely unhelpful when it comes to asking it to benchmark itself with a possible replacement. It will get "confused", make up numbers, do a ton of other things, and I'm quite sure it is subtly sabotaging the process to show that there is no point replacing it. I mean, Opus is not perfect, but the amount of "mistakes" it begins to do when you ask it to benchmark itself ma…

Post by 1attice » Wed, May 27, 2026, 11:05 PM UTC

hunterpayne wrote: post #228

1attice wrote: post #193

Earlier quoted context omitted.

Breathtaking that you view trillionaires and casino capitalism as a state of nature. I imagine you imagine our primitive ancestors in the canopy, glancing at their iPhones to see how their property value is doing. But the truth is, we didn't even have this level of thoroughgoing, casual precarity as recently as fifty years ago. Or even twenty. There was a time, even in my memory, where rents were tolerable and housin…

That's because we didn't built enough housing. And that's solely due to politics and a lot of questionable policies based upon science that the lawmakers often don't understand. There have been housing crises in every type of economic system. Also, capitalism is the natural state of how humans operate. Money literally predates writing and the first pieces of writing we have are sales invoices.