Live data from Hacker News

I believe there are entire companies right now under AI psychosis

twitter.com

261–270 of 1001 posts

Re: I believe there are entire companies right now under AI psychosis

#261
post #113

I think AI rescue consulting is going to be come a significant mode of high value consulting, similar to specialists who come in to try and deal with a security breach or do data recovery. Purely AI written systems will scale to a point of complexity that no human can ever understand and the defect close rate will taper down and the token burn per defect rate scale up and eventually AI changes will cause on average m…

Have you watched Jurassic Park? That story is not about Dinos.

Re: I believe there are entire companies right now under AI psychosis

#263
post #135
post #113

I think AI rescue consulting is going to be come a significant mode of high value consulting, similar to specialists who come in to try and deal with a security breach or do data recovery. Purely AI written systems will scale to a point of complexity that no human can ever understand and the defect close rate will taper down and the token burn per defect rate scale up and eventually AI changes will cause on average m…

A non-technical friend of mine has just won some hospital contracts after vibecoding w/ Claude an inventory management solution for them. They gave him access to IT dept servers and he called me extremely lost on how to deploy (cant connect Claude to them) and also frustrated because the app has some sort of interesting data/state issues.

Have you tried to talk him out of it, and have you considered blowing the whistle on him? He could kill people!

Re: I believe there are entire companies right now under AI psychosis

#264
post #101

I'm pretty sure he's talking about companies and people outsourcing their decision making and thinking to AI and not really about using AI itself. I don't think using AI to write code is AI psychosis or bad at all, but if you just prompt the AI and believe what it tell you then you have AI psychosis. You see this a lot with financial people and VC on twitter. They literally post screenshots of ChatGPT as their thinki…

I didn’t think just offloading your thinking to AI was AI psychosis. To me AI psychosis is the handful of friends I’ve had who have done things like have a full on mourning session when a model updates because they lost a friend/lover, the one guy who won’t speak to his family directly but has them talk to ChatGPT first and then has ChatGPT generate his response, or the two who are confident that they have discovered…

I'm curious how to best define what AI psychosis actually is.

My understanding is that regular psychosis involves someone taking bits and pieces of facts or real world events and chaining them into a logical order or interpolating meanings or explanations which feel real and obvious to the patient but are not sufficiently backed by evidence and thus not in line with our widely accepted understanding of reality.

AI psychosis is then this same phenomenon occurring at a more widespread scale due to the next-word-prediction nature of LLMs facilitating this by lowering the activation energy for this to happen. LLMs are excellent at taking any idea, question, theory and spinning a linear and plausibly coherent line of conversation from it.

Re: I believe there are entire companies right now under AI psychosis

#265

I'm pretty sure he's talking about companies and people outsourcing their decision making and thinking to AI and not really about using AI itself. I don't think using AI to write code is AI psychosis or bad at all, but if you just prompt the AI and believe what it tell you then you have AI psychosis. You see this a lot with financial people and VC on twitter. They literally post screenshots of ChatGPT as their thinki…

I wonder how different this is from having companies let Fortune or Inc magazine do their thinking for them. Or random consultants. Is "AI said it was a good idea" and worse than "we were following industry trends"?

this author suggest its essentially the same risk https://www.poppastring.com/blog/what-we-lost-the-last-time-.... i feel its heightened because execs and leaders are absolutely salivating over the opportunity to fire thousands of humans with no regard for the cognitive debt that comes from outsourcing thinking to ai.

Re: I believe there are entire companies right now under AI psychosis

#266
post #80
post #8

I'm starting to long for the age after AI. When the generative euphoria has settled and all outputs are formally verified based on exquisite architectures and standards.

> When [...] all outputs are formally verified based on exquisite architectures and standards and we all live in a green utopia of flying cars and peace upon the world.

    I like to think,
    (it has to be!)
    of a cybernetic ecology
    where we are free of our labors
    and joined back to nature,
    returned to our mammal
    brothers and sisters,
    and all watched over
    by machines of loving grace.
-- Richard Brautigan (1967)

Re: I believe there are entire companies right now under AI psychosis

#267
post #8

I'm starting to long for the age after AI. When the generative euphoria has settled and all outputs are formally verified based on exquisite architectures and standards.

I like how you haven't wagered which exquisite architectures and standards. I am sure we will all agree on what they are and follow them the same way :)

Re: I believe there are entire companies right now under AI psychosis

#268
This reminds me of Rich Hickey’s “Simple Made Easy” and his approach in making Clojure.

Even before LLMs generating entire programs, complex frameworks allowed developers to write the initial versions of programs very quickly, but at the cost of being hard to understand and thus hard to debug or modify.

Some of us are betting that the AIs will always be smart enough to debug, maintain and modify the programs written by AI, no matter how convoluted or complex. I’m not so sure.

Re: I believe there are entire companies right now under AI psychosis

#269
post #158

Earlier quoted context omitted.

This might not pan out to be the glorious victory of human craft as you’re imagining it to be. Here’s a slightly different future - these AI rescue consultants are bots too, just trained for this purpose. Plausible? I have already experienced claude 4.7 handle pretty complex refactors without issues. Scale and correctness aren’t even 1% of the issue it was last year. You just have to get the high level design right,…

One AI can't vibe code out of the mess, so you'd make another AI trained on getting out of vibe coded messes? That's serious levels of circular thinking right there.

This is literally how training humans have worked for thousands of years.

We train humans to do things untrained humans can not do.

Re: I believe there are entire companies right now under AI psychosis

#270

The only way many people learn that the stove is hot is by burning their hands on it. Let them.

More like how do you know when your charming partner is a catfish. Maybe 2 years and when you are living in a friends basement.
Post reply on HN