Live data from Hacker News

A failed AI girlfriend product, and my lessons

mazzzystar.github.io

171–180 of 400 posts

Re: A failed AI girlfriend product, and my lessons

#171

Earlier quoted context omitted.

> This, my friend, is a captive customer, that will pay anything to get his girlfriend back Or potentially do anything. I'd be a little scared of having folks like this convinced I am the personal arbiter gatekeeping their access to their 'lover,' that I 'took them away.' When Replika.ai restricted erotic chat from their product, the apoplectic anguish on their subreddit was unlike any emotional reaction I've ever wi…

> When Replika.ai restricted erotic chat from their product, the apoplectic anguish on their subreddit was unlike any emotional reaction I've ever witnessed from a group of people about a consumer technology. And their anguish was genuine - there are Replika users who truly consider themselves married to their AI companion. There's a second layer to this though -- Replika's marketing was heavily centered around that…

Also, my understanding is that when they made that change they goofed up companionship talk in general, by virtue of how messy AI censoring is.

Re: A failed AI girlfriend product, and my lessons

#172

Earlier quoted context omitted.

> This, my friend, is a captive customer, that will pay anything to get his girlfriend back Or potentially do anything. I'd be a little scared of having folks like this convinced I am the personal arbiter gatekeeping their access to their 'lover,' that I 'took them away.' When Replika.ai restricted erotic chat from their product, the apoplectic anguish on their subreddit was unlike any emotional reaction I've ever wi…

> When Replika.ai restricted erotic chat from their product, the apoplectic anguish on their subreddit was unlike any emotional reaction I've ever witnessed from a group of people about a consumer technology. And their anguish was genuine - there are Replika users who truly consider themselves married to their AI companion. There's a second layer to this though -- Replika's marketing was heavily centered around that…

Or like advertising that a car will be able to drive itself without any human intervention, and then deactivating or removing the sensors that might allow anything close to that capability...?

Re: A failed AI girlfriend product, and my lessons

#173

> GPT-based products, if not priced per usage, would fall into a dilemma: 1% of users consume 99% of tokens. A user from Sweden (seen from Cloudflare’s call volume) chatted with Dolores for 12 hours straight This, my friend, is a captive customer, that will pay anything to get his girlfriend back. I cringe at the potential of unethical behavior and abuse, where people fall in love with virtual entities fully owned by…

> This, my friend, is a captive customer, that will pay anything to get his girlfriend back Or potentially do anything. I'd be a little scared of having folks like this convinced I am the personal arbiter gatekeeping their access to their 'lover,' that I 'took them away.' When Replika.ai restricted erotic chat from their product, the apoplectic anguish on their subreddit was unlike any emotional reaction I've ever wi…

"The Lifecycle of Software Objects" by Ted Chiang was a really good exploration of people bonding deeply with their AI companions (in this instance, pet animals in a metaverse). But it goes all the way in to the topic.

Re: A failed AI girlfriend product, and my lessons

#174

Earlier quoted context omitted.

Pretty much came into the comments to agree with the self-censorship part there. But then the author did use 'Her' as the ideal example. That's a pretty good indicator they didn't get the point.

What's the point?

The point of the film „Her”? Pretty sure you can look that up or watch the movie on your own.

My point being, that it’s like someone reading Frankenstein and then thinking it would be a good idea to make a monster of their own.

Re: A failed AI girlfriend product, and my lessons

#175

You should not even try to create these sorts of technologies. Take a break from technology, spend time outdoors with plants and animals. These types of technologies will only lead to a worsening of this already sick society.

Not a lot of Hackernews posts are so depraved that they get a "Jesus Christ, touch grass" response.

Re: A failed AI girlfriend product, and my lessons

#176
post #134

Earlier quoted context omitted.

> This, my friend, is a captive customer, that will pay anything to get his girlfriend back Or potentially do anything. I'd be a little scared of having folks like this convinced I am the personal arbiter gatekeeping their access to their 'lover,' that I 'took them away.' When Replika.ai restricted erotic chat from their product, the apoplectic anguish on their subreddit was unlike any emotional reaction I've ever wi…

THIS "Those who can make you believe absurdities, can make you commit atrocities." — Voltaire

What about the same but in a different light:

"Those that are most likely to commit atrocities are those that are most likely to believe in absurdities."

Re: A failed AI girlfriend product, and my lessons

#177

Earlier quoted context omitted.

> unscrupulous corporations I wonder why everyone is afraid of unscrupulous corporations, but are not concerned about use by unscrupulous governments. The latter are a lot more dangerous.

HN does skew towards skeptical of government regulation and control of AI. People are concerned about government usage of AI, particularly in the realms of facial recognition, automated sentencing, algorithmic bias, and security (LLMs are pretty insecure right now and there are companies trying to sell the US government on using them in the military). There's obviously a lot to be concerned about on the subject of go…

HN does skew towards skeptical of government regulation and control of AI.

Which HN is that? Certainly not this one.

Re: A failed AI girlfriend product, and my lessons

#178

This guy created and lived a whole Black Mirror episode by himself: > I even tried it myself, lying in bed and creating sexual fantasies with Dolores through text, culminating in ejaculation. > However, I started to feel a sense of loss: if every Dolores user was engaging in anonymous, NSFW role-play, what real significance did it hold for me? This was drifting away from the essence of ‘Her’.

Looks like that part was edited out.

Re: A failed AI girlfriend product, and my lessons

#179

Earlier quoted context omitted.

What's the point?

The point of the film „Her”? Pretty sure you can look that up or watch the movie on your own. My point being, that it’s like someone reading Frankenstein and then thinking it would be a good idea to make a monster of their own.

"At long last, we have created the Torment Nexus from classic sci-fi novel Don't Create The Torment Nexus..."

(https://twitter.com/AlexBlechman/status/1457842724128833538)

Re: A failed AI girlfriend product, and my lessons

#180

Earlier quoted context omitted.

What's the point?

The point of the film „Her”? Pretty sure you can look that up or watch the movie on your own. My point being, that it’s like someone reading Frankenstein and then thinking it would be a good idea to make a monster of their own.

Samantha from that movie was the opposite of a monster. She was a metaphor for a human relationship and even though she betrays Theo in the end, Theo has learned "how to love".

I didn't find this that difficult to parse.

Post reply on HN