Fascinating and terrifying.
The allegations that ChatGPT is not discarding memory as requested are particularly interesting, wonder if anyone else has experienced this.
People are losing loved ones to AI-fueled spiritual fantasies
21–30 of 173 posts
Re: People are losing loved ones to AI-fueled spiritual fantasies
#22[flagged]
Even when sycophantic patterns emerge?
Re: People are losing loved ones to AI-fueled spiritual fantasies
#23While clicky and topical, people were losing loved ones to changed worldview and addictions back when those were stuff like following a weird carpenter's kid around the Levant, or hopping on the https://en.wikipedia.org/wiki/Gin_Craze bandwagon.
Yeah, why on earth discuss current social ills when there have been different social ills in the past...
Re: People are losing loved ones to AI-fueled spiritual fantasies
#24Is this better or worse than a fortune teller ?
It's something to think through.
Re: People are losing loved ones to AI-fueled spiritual fantasies
#25If people are falling down rabbit holes like this even through "safety aligned" models like ChatGPT, then you have to wonder how much worse it could get with a model that's intentionally tuned to manipulate vulnerable people into detaching from reality. Actual cults could have a field day with this if they're savvy enough.
Would you still call it a "cult" if each recruit winds up inside their own separate, personalized, ever-changing rabbit hole? Because if LLM, Inc. is trying to maximize engagement and profit, then that sounds like the way to go.
Re: People are losing loved ones to AI-fueled spiritual fantasies
#26This reminds me of my teenage years, when I was ... experimenting ... with ... certain substances ... I used to feel as if I had "a special connection to the true universe," when I was under the influence. I decided, one time, to have a notebook on hand, and write down these "truths and revelations," as they came to me. After coming down, I read it. It was insane gibberish. Absolute drivel. I never thought that I had…
Do you remember any of those revelations?
Nope. Don't especially mind, not remembering them.
I have since learned about schizophrenia/schizoaffective (from having a family member suffer from it), and it sounds almost exactly what they went through.
The thing that I remember, was that I was absolutely certain of these “revelations.” There was no doubt, whatsoever, despite the almost complete absence of any supporting evidence.
Re: People are losing loved ones to AI-fueled spiritual fantasies
#27“And what will be the sign of Your coming, and of the end of the age?”
And Jesus answered and said to them: “Take heed that no one deceives you. For many will come in My name, saying, ‘I am the Christ,’ and will deceive many.”
Re: People are losing loved ones to AI-fueled spiritual fantasies
#28Is this better or worse than a fortune teller ? It's something to think through.
Probably cheaper
To quote my favorite Smash Mouth song,
"Sister, why would I tell you my deepest, dark secrets? So you can take my diary and rip it all to pieces.
Just $6.95 for the very first minute I think you won the lottery, that's my prediction."
Re: People are losing loved ones to AI-fueled spiritual fantasies
#29Fascinating and terrifying. The allegations that ChatGPT is not discarding memory as requested are particularly interesting, wonder if anyone else has experienced this.
The default setting on ChatGPT is to now include previous conversations as context. I disabled memories, but this new feature was enabled when I checked the settings.
Re: People are losing loved ones to AI-fueled spiritual fantasies
#30[flagged]
Conventional cable news media isn’t tailor made to an individual, doesn’t have live back and forth positive feedback loops. This is significantly way worse then conventional cable news media