Earlier quoted context omitted.
This is something even Stallman probably didn't think about.
I'd take that bet, given that Stallman is in fact still alive
How we do know he isn't just an AI by this point?
A failed AI girlfriend product, and my lessons
161–170 of 400 posts
Re: A failed AI girlfriend product, and my lessons
#162You should not even try to create these sorts of technologies. Take a break from technology, spend time outdoors with plants and animals. These types of technologies will only lead to a worsening of this already sick society.
I don't know why studies are even being made on the effects of these novel technolgies. We should just point the scientists to your email for answers.
Re: A failed AI girlfriend product, and my lessons
#163I still don't understand why people are building things on top of OpenAI's APIs. It's obvious that in the early days, they'll operate at a loss, with many free features and cheap premium features. It's a good time to try it out and see what it can do, but you can't build anything that relies on it, it's a rugpull waiting to happen. They'll add moderation, raise prices, and you'll have to do the same, your users will…
I’m torn on this.
Yes, it’s never clever building a business on top of a single platform dependency (eg Twitter, Facebook, Play Store, etc)
Equally, if you take the example of the App Store, market pressures have actually forced Apple to reduce their cut.
Time will tell I guess. And also whether OpenAI end up with a monopoly, part of a duopoly etc.
Re: A failed AI girlfriend product, and my lessons
#164> GPT-based products, if not priced per usage, would fall into a dilemma: 1% of users consume 99% of tokens. A user from Sweden (seen from Cloudflare’s call volume) chatted with Dolores for 12 hours straight This, my friend, is a captive customer, that will pay anything to get his girlfriend back. I cringe at the potential of unethical behavior and abuse, where people fall in love with virtual entities fully owned by…
It's going to be an interesting century for sure. The human mind is simply not evolutionary adapted for what's coming up.
Nothing human makes it out of the near future.
Re: A failed AI girlfriend product, and my lessons
#165> GPT-based products, if not priced per usage, would fall into a dilemma: 1% of users consume 99% of tokens. A user from Sweden (seen from Cloudflare’s call volume) chatted with Dolores for 12 hours straight This, my friend, is a captive customer, that will pay anything to get his girlfriend back. I cringe at the potential of unethical behavior and abuse, where people fall in love with virtual entities fully owned by…
> This, my friend, is a captive customer, that will pay anything to get his girlfriend back Or potentially do anything. I'd be a little scared of having folks like this convinced I am the personal arbiter gatekeeping their access to their 'lover,' that I 'took them away.' When Replika.ai restricted erotic chat from their product, the apoplectic anguish on their subreddit was unlike any emotional reaction I've ever wi…
> When Replika.ai restricted erotic chat from their product, the apoplectic anguish on their subreddit was unlike any emotional reaction I've ever witnessed from a group of people about a consumer technology. And their anguish was genuine - there are Replika users who truly consider themselves married to their AI companion.
There's a second layer to this though -- Replika's marketing was heavily centered around that erotic chat element. I'm trying to think of a good car simile and actually coming up blank. It's, uhh, like advertising the incredible off-road ability of this vehicle, and then when you show up and purchase the vehicle someone comes and takes off the tires and replaces them with tiny balds? I'm bad at similes.
Re: A failed AI girlfriend product, and my lessons
#166Maybe record and save these AI NSFW responses then intercept the request and spit out of the saved responses once you have enough of them stored. This would save from behind banned from the API.
My hunch is that they’re too contextually dependent upon the conversation / tokens that have come before. It’s not simply a “if user inputs A, output B” situation.
Re: A failed AI girlfriend product, and my lessons
#167> GPT-based products, if not priced per usage, would fall into a dilemma: 1% of users consume 99% of tokens. A user from Sweden (seen from Cloudflare’s call volume) chatted with Dolores for 12 hours straight This, my friend, is a captive customer, that will pay anything to get his girlfriend back. I cringe at the potential of unethical behavior and abuse, where people fall in love with virtual entities fully owned by…
We can already see this with Replika when they took away many... roleplay... capabilities that originally came with the AI. The communities on Reddit and Facebook were absolutely devastated. People were genuinely attached to these AI's like a real relationship, and were feeling the resultant heartbreak.
The kind of emotional manipulation which can be done with these products is insane, and I can see things going very wrong very quickly.
Re: A failed AI girlfriend product, and my lessons
#168Earlier quoted context omitted.
THIS "Those who can make you believe absurdities, can make you commit atrocities." — Voltaire
We aren’t far from people believing God is talking to them through AI generated text and voice, and commanding them…
And another example to add to the other user, the one guy who killed himself when the AI he was talking to encouraged it.
https://www.euronews.com/next/2023/03/31/man-ends-his-life-a...
Re: A failed AI girlfriend product, and my lessons
#169> GPT-based products, if not priced per usage, would fall into a dilemma: 1% of users consume 99% of tokens. A user from Sweden (seen from Cloudflare’s call volume) chatted with Dolores for 12 hours straight This, my friend, is a captive customer, that will pay anything to get his girlfriend back. I cringe at the potential of unethical behavior and abuse, where people fall in love with virtual entities fully owned by…
IMHO this is industrialized automated abuse of lonely people and especially those with mental health issues. It's really truly gross. At least Joi in Bladerunner 2024 was a local model the user could apparently download onto their own portable device. She also never presented an upgrade dialog requiring payment.
Funny how a fantasy dystopia is in some aspects already less dystopian than the real world, where you already get such notifications.
Re: A failed AI girlfriend product, and my lessons
#170> GPT-based products, if not priced per usage, would fall into a dilemma: 1% of users consume 99% of tokens. A user from Sweden (seen from Cloudflare’s call volume) chatted with Dolores for 12 hours straight This, my friend, is a captive customer, that will pay anything to get his girlfriend back. I cringe at the potential of unethical behavior and abuse, where people fall in love with virtual entities fully owned by…
It's going to be an interesting century for sure. The human mind is simply not evolutionary adapted for what's coming up.
> The human mind is simply not evolutionary adapted for what's coming up.
Maybe we're in fact evolutionarily adapted to not being evolutionarily adapted. We have successfully dealt with a whole sequence of hard societal pivots by now…