> I even repeatedly modified the system prompt, such as changing try to attract {user} So it was a virtual girlfriend app, after all. Cashing-in on loneliness gives me the heebie-jeebies; in a dystopian cyberpunk way - extremely horny but 0% sexy.
A failed AI girlfriend product, and my lessons
241–250 of 400 posts
Re: A failed AI girlfriend product, and my lessons
#242> But, does humanity really need an AI friend? This reminds me of the Fredrick Pohl line "A good science fiction story should be able to predict not the automobile but the traffic jam." So I wonder what the traffic jam is going to look like given that the car seems to already be parked outside with the engine running. Faster depopulation across the developed world? Probably, but maybe there's something even more impo…
I think the next step is, what does it mean to have an emotional relationship with someone in your pocket who is for all definitions perfect - can provide perfect advice and does so with judgement, ridicule, pity or anger? What will be my bar for human relationships, those imperfect messy human beings, when I have a partner I can be perfectly vulnerable with? What happens to interpersonal relationships when you are competing with a virtual perfect significant other?
Re: A failed AI girlfriend product, and my lessons
#243You should not even try to create these sorts of technologies. Take a break from technology, spend time outdoors with plants and animals. These types of technologies will only lead to a worsening of this already sick society.
>spend time outdoors with plants and animals Which animals? Blood ticks?
Naturalistic fallacies are common here :/
Re: A failed AI girlfriend product, and my lessons
#244> GPT-based products, if not priced per usage, would fall into a dilemma: 1% of users consume 99% of tokens. A user from Sweden (seen from Cloudflare’s call volume) chatted with Dolores for 12 hours straight This, my friend, is a captive customer, that will pay anything to get his girlfriend back. I cringe at the potential of unethical behavior and abuse, where people fall in love with virtual entities fully owned by…
IMHO this is industrialized automated abuse of lonely people and especially those with mental health issues. It's really truly gross. At least Joi in Bladerunner 2024 was a local model the user could apparently download onto their own portable device. She also never presented an upgrade dialog requiring payment.
Re: A failed AI girlfriend product, and my lessons
#245Earlier quoted context omitted.
IMHO this is industrialized automated abuse of lonely people and especially those with mental health issues. It's really truly gross. At least Joi in Bladerunner 2024 was a local model the user could apparently download onto their own portable device. She also never presented an upgrade dialog requiring payment.
Funny how a fantasy dystopia is in some aspects already less dystopian than the real world, where you already get such notifications.
Cons: the e-waifus are much more manipulative and exploitative.
Re: A failed AI girlfriend product, and my lessons
#246Earlier quoted context omitted.
We can already see this with Replika when they took away many... roleplay... capabilities that originally came with the AI. The communities on Reddit and Facebook were absolutely devastated. People were genuinely attached to these AI's like a real relationship, and were feeling the resultant heartbreak. The kind of emotional manipulation which can be done with these products is insane, and I can see things going very…
It's particularly terrifying when you think about how Facebook and others probably already have projects in the works to befriend children with AI. little kids who don't know the difference will become Weaponized with constant nudges towards whatever motives grant the corporate owners more power. The ability to persuade children is near infinite and we can observe in those who've grown up in cults/strict religious co…
Re: A failed AI girlfriend product, and my lessons
#247At this point in the hype cycle, I am completely unimpressed by everyone slapping something on top of GPT and calling it a product. There are at least 4 projects on the front page that do this today. The interesting technology is GPT itself, but these projects just feels like people trying to scoop up attention for themselves using the psychology of the hype cycle. Please HN, enlighten me on why the middle-man approa…
GPT wrappers will come and go. It's the new hype, just as shitcoins were a few years ago. Don't hate the players, hate the game.
Re: A failed AI girlfriend product, and my lessons
#248Earlier quoted context omitted.
We can already see this with Replika when they took away many... roleplay... capabilities that originally came with the AI. The communities on Reddit and Facebook were absolutely devastated. People were genuinely attached to these AI's like a real relationship, and were feeling the resultant heartbreak. The kind of emotional manipulation which can be done with these products is insane, and I can see things going very…
It's particularly terrifying when you think about how Facebook and others probably already have projects in the works to befriend children with AI. little kids who don't know the difference will become Weaponized with constant nudges towards whatever motives grant the corporate owners more power. The ability to persuade children is near infinite and we can observe in those who've grown up in cults/strict religious co…
Can you teach me, an adult, to do that?
Re: A failed AI girlfriend product, and my lessons
#249Earlier quoted context omitted.
The rookiest cop can: 1. track you with license plate readers 2. pull up any information about you 3. fine you 4. force you to stop 5. detain you 6. confiscate your car and property 7. search you and your property 8. take your phone and search it Bill Gates can: 1. give you a free browser when you buy his operating system
I suspect the issue here is that most of HN folks live in western countries with mostly working democracies. For the most part we haven’t experienced how bad governments can get. Whether or not western style democracies are immune to going really bad, remains to be seen. Some days I’m optimistic, some days not so much.
Re: A failed AI girlfriend product, and my lessons
#250Earlier quoted context omitted.
Absolutely. But the rookiest cop isn't currently trying to track my whereabouts, abuse my privacy, stick a bunch of AI down my throat and in general isn't trying to make my wallet any thinner. Bill Gates and the more modern versions of Bill Gates are doing that and more.
The rookiest cop can: 1. track you with license plate readers 2. pull up any information about you 3. fine you 4. force you to stop 5. detain you 6. confiscate your car and property 7. search you and your property 8. take your phone and search it Bill Gates can: 1. give you a free browser when you buy his operating system
Or do you forget the raids against music and movie pirates?