Live data from Hacker News

A failed AI girlfriend product, and my lessons

mazzzystar.github.io

51–60 of 400 posts

Re: A failed AI girlfriend product, and my lessons

#51

You should not even try to create these sorts of technologies. Take a break from technology, spend time outdoors with plants and animals. These types of technologies will only lead to a worsening of this already sick society.

>spend time outdoors with plants and animals

Which animals? Blood ticks?

Re: A failed AI girlfriend product, and my lessons

#52

> GPT-based products, if not priced per usage, would fall into a dilemma: 1% of users consume 99% of tokens. A user from Sweden (seen from Cloudflare’s call volume) chatted with Dolores for 12 hours straight This, my friend, is a captive customer, that will pay anything to get his girlfriend back. I cringe at the potential of unethical behavior and abuse, where people fall in love with virtual entities fully owned by…

It's going to be an interesting century for sure. The human mind is simply not evolutionary adapted for what's coming up.

> The human mind is simply not evolutionary adapted for what's coming up.

This can be said of pretty much everything humans ended up creating with technology so... not sure there's anything really new down the road. Humans adapt.

Re: A failed AI girlfriend product, and my lessons

#53

> GPT-based products, if not priced per usage, would fall into a dilemma: 1% of users consume 99% of tokens. A user from Sweden (seen from Cloudflare’s call volume) chatted with Dolores for 12 hours straight This, my friend, is a captive customer, that will pay anything to get his girlfriend back. I cringe at the potential of unethical behavior and abuse, where people fall in love with virtual entities fully owned by…

The author doesn't appear to even consider any kind of obligation to their users.

Re: A failed AI girlfriend product, and my lessons

#54

Earlier quoted context omitted.

> Also it seems like he had full access to the replies via the voice generator, which sure isn't great from a privacy standpoint. Whose privacy is being violated? Dolores's?

You joke, but I can forsee issues. If he has the replies to a particular user, and he has a means of IDing that user, he could cause them a lot of hurt. They are getting intensely sexual replies back, they aren't getting that without supplying sexual prompting. Could also be used to out gay users.

Oh, yeah, there's a huge privacy problem here and the part you referenced gave me pause too. But there's also the part where OpenAI flagged the replies as being sexual in nature. There are multiple third parties able to intercept these communications and it's not just the replies.

I was being facetious, but I found it interesting to think that Dolores's privacy was being intruded too and that an intelligence like us probably wouldn't engage in such a conversation knowing full well it is being eavesdropped by the author. Unless the intelligence considers the author to be God, I suppose.

Re: A failed AI girlfriend product, and my lessons

#55
Wow this read more like Frankenstein than anything I’ve read recently: A talented scientist is driven by curiosity to create ever more sophisticated creations, culminating in a monstrous entity that leads to the scientist’s downfall. But the scientist doesn’t realize this until too late.

Really, if our top tinkerers had a little more contextual knowledge of history and less naiveté about people we could save ourselves from ever more dangerous Frankenstein tragedies.

Re: A failed AI girlfriend product, and my lessons

#56

You should not even try to create these sorts of technologies. Take a break from technology, spend time outdoors with plants and animals. These types of technologies will only lead to a worsening of this already sick society.

Could say the same about antidepressants. "Fix the causes, not the symptoms!" And yet, here we are.

> “Fix the causes”

How, exactly? Yes, some people experience depression as a symptom of something than can be addressed through various therapies, but what about people who just have it wired into their brains? How do we “fix” that?

Re: A failed AI girlfriend product, and my lessons

#57
post #37

Interesting read. Others have also created virtual friends using ChatGPT. What I find unsavory, is OpenAI imposing content restrictions like NSFW. That can easily extend to censorship of non-PC content, unpopular political ideas, and more. The solution will (I hope) ultimately be open-source LLMs that you can run locally, on your own hardware.

Yes. But those open-source LLMs already exist. It's surprising the OP didn't at least explore the possibility of using them to get around the limitations of "Open" AI (which sounds more and more like a Victorian matron).

Are the risks worth it for OpenAI to allow that at what is basically the start of their business?

Re: A failed AI girlfriend product, and my lessons

#58
post #25

Eventually, a virtual girlfriend app that will put together sound and image will be released an empty the pockets of sad, lonely men on a large scale. Depressing stuff but this is the world we live in. Thank you to the author for this interesting read.

> Eventually, a virtual girlfriend app that will put together sound and image will be released an empty the pockets of sad, lonely men on a large scale. Sounds indistinguishable from an actual girlfriend ;)

[flagged]

Re: A failed AI girlfriend product, and my lessons

#59
This is an interesting post and the person achieved a huge amount.

They should not have given up.

I would have pivoted to personal pet companions. If people want virtual girlfriends then they certainly want personal dogs, cats and birds that talk to you.

Enough was achieved here to raise money.

Some careful redesign and development might have allowed some caching and reuse of expensive AI API interactions, reducing costs.

Add in further gameplay elements so it is not just about making the AI API do stuff, that would also reduce costs and maybe even engage the users more.

Perhaps AI should be the icing and accents on a game rather than the focus.

As an aside, this is the first time I have read anyone tell about how they wanked to their own software.

Altogether this was perhaps a missed opportunity for this founder.

BUT it is now an opportunity for one of the HN readers to follow this playbook and replicate what this founder did.

Re: A failed AI girlfriend product, and my lessons

#60

Eventually, a virtual girlfriend app that will put together sound and image will be released an empty the pockets of sad, lonely men on a large scale. Depressing stuff but this is the world we live in. Thank you to the author for this interesting read.

Eventually? Months away.
Post reply on HN