When the justice system finally catches up and puts Sam behind bars.
> When the justice system finally catches up and puts Sam behind bars Sam bears massive personal liability, in my opinion. But criminal? What crimes has he committed?
I'm sure we could invent one that sufficiently covers the insane sociopathy that rots the upper echelons of corporate technology. Society needs to hold these people accountable. If the current legal system is not adequate, we can repair it until it is.
The whiplash of carefully filtering out sycophantic behavior from GPT-5 to adding it back in full force for GPT-5.1 is dystopian. We all know what's going on behind the scenes: The investors want their money.
Remarkable that you're being downvoted on a venture capital forum whose entire purpose is "take venture capital and then eventually pay it back because that's how venture capital works".
GPT-5 was so good in the first week, just a raw chatbot like GPT-3.5 and GPT-4 were in the beginning and now it has this disgusting "happy" and "comforting" personality and "tuning" it doesn't help one bit, it makes performance way worse and after a few rounds it forgets all instructions. I've already deleted memory, past chats, etc...
Even when you tell it to not coddle you, it just says something cringeworthy like "ok, the gloves are off here's the raw deal, with New Yorker honesty:" and proceeds to feed you a ton of patronizing bullshit. It's extremely annoying.
Yeah, this is why a lot of us don't use these tools.
"Sure, this software induces psychosis and uses a trillion gallons of water and all the electricity of Europe, and also it gives wrong answers most of the time, but if you ignore all that, it's really quite amazing."
One of the more disturbing things I read this year was the my boyfriend is AI subreddit. I genuinely can't fathom what is going on there. Seems so wrong, yet no one there seems to care. I worry about the damage caused by these things on distressed people. What can be done?
What's going on is that we've spent a few solid decades absolutely destroying normal human relationships, mostly because it's profitable to do so, and the people running the show have displayed no signs of stopping. Meanwhile, the rest of society is either unwilling or unable (or both) to do anything to reverse course. There is truly no other outcome, and it will not change unless and until regular people decide that enough is enough.
I'd tell you exactly what we need to do, but it is at odds with the interests of capital, so I guess keep showing up to work and smiling through that hour-long standup. You still have a mortgage to pay.
> I worry about the damage caused by these things on distressed people. What can be done? Why? We are gregarious animals, we need social connections. ChatGPT has guardrails that keep this mostly safe and helps with the loneliness epidemic. It's not like people doing this are likely thriving socially in the first place, better with ChatGPT than on some forum à la 4chan that will radicalize them. I feel like this will…
The tech industry's capacity to rationalize anything, including psychosis, as long as it can make money off it is truly incredible. Even the temporarily embarrassed founders that populate this message board do it openly.
We need a Truth and Reconciliation Commission for all of this someday, and a lot of people will need to be behind bars, if there be any healing to be done.
One of the more disturbing things I read this year was the my boyfriend is AI subreddit. I genuinely can't fathom what is going on there. Seems so wrong, yet no one there seems to care. I worry about the damage caused by these things on distressed people. What can be done?
There are plenty of reasons why having a chatbot partner is a bad idea (especially for young people), but here's just a few: - The sycophantic and unchallenging behaviours of chatbots leaves a person unconditioned for human interactions. Real relationships have friction, from this we develop important interpersonal skills such as setting boundaries, settling disagreements, building compromise, standing up for oneself…
Love your thoughts about needing input from others! In Autistic / ADHD circles, the lack of input from other people, and the feedback of thoughts being amplified by oneself is called rumination. It can happen for many multiple ways-- lack of social discussion, drugs, etc. AI psychosis is just rumination, but the bot expands and validates your own ideas, making them appear to be validated by others. For vulnerable people, AI can be incredibly useful, but also dangerous. It requires individuals to deliberately self-regulate, pause, and break the cycle of rumination.
Even when you tell it to not coddle you, it just says something cringeworthy like "ok, the gloves are off here's the raw deal, with New Yorker honesty:" and proceeds to feed you a ton of patronizing bullshit. It's extremely annoying.
Yeah, this is why a lot of us don't use these tools.
Even when you tell it to not coddle you, it just says something cringeworthy like "ok, the gloves are off here's the raw deal, with New Yorker honesty:" and proceeds to feed you a ton of patronizing bullshit. It's extremely annoying.
I’ve had some limited success attributing ideas to other people and asking it to help me assess the quality of the idea. Only limited success though. It’s still a fucking LLM.
The issue is not that it's an LLM, the issue is that it's been RLHFed to hell to be a sycophant.