Live data from Hacker News

A failed AI girlfriend product, and my lessons

mazzzystar.github.io

151–160 of 400 posts

Re: A failed AI girlfriend product, and my lessons

#151

Earlier quoted context omitted.

You can't really fuck your imaginary shoggoth girlfriend either.

You can if you have the appropriate peripheral(s) attached.

Yes, if you redefine the meaning of words.

Re: A failed AI girlfriend product, and my lessons

#152

So, all in all, OpenAIs puritanism ruined this product, made the developer sad and took away a virtual porn toy from lonely, horny men. Who were they doing this for? Who is the winner? They lost a customer and made a lot of people sad.

> Who were they doing this for? VISA probably. Card processing is weirdly puritanical.

They want chatgpt in schools to own the next gen of workers.

Re: A failed AI girlfriend product, and my lessons

#153
post #134

Earlier quoted context omitted.

> This, my friend, is a captive customer, that will pay anything to get his girlfriend back Or potentially do anything. I'd be a little scared of having folks like this convinced I am the personal arbiter gatekeeping their access to their 'lover,' that I 'took them away.' When Replika.ai restricted erotic chat from their product, the apoplectic anguish on their subreddit was unlike any emotional reaction I've ever wi…

THIS "Those who can make you believe absurdities, can make you commit atrocities." — Voltaire

We aren’t far from people believing God is talking to them through AI generated text and voice, and commanding them…

Re: A failed AI girlfriend product, and my lessons

#154
post #49

> AI Friends inevitably turn into AI Girlfriends/Boyfriends because you and the Character in your phone are not equal: she can’t comfort you when you’re hurt (unless you tell her), she can’t actively express emotions to you, and all this is because she lacks external vision. That is such a curious lesson to draw. So specific, and seemingly so wrong. Surely long distance friendships work just fine even if only through…

My girl and I have lived together for more than a year now after meeting online and talking exclusively through text for months before eventually graduating to voice chats before we even knew what each other looked like. I'm with you, long distance relationships (romantic or otherwise) can work great!

Re: A failed AI girlfriend product, and my lessons

#156

Well this went places. The dev really 'ate his own dogfood' so to speak. I thought it was going to be a despairing look at how his companion AI was continuously turned to sleazy uses by a pervy userbase but that's pretty much what he was going for it seems. I have to say, I hated this part: "...gained a lot of Chinese users. I immediately realized the political risk: users could set Dolores’ background, personality,…

> Just pre-emptorily censors himself to appease the Chinese government. Every major tech company does the exact same for China, Russia and UAE. Business as usual

every major business company has also done this for the USA... not just tech companies

so I agree, business as usual

Re: A failed AI girlfriend product, and my lessons

#157

Earlier quoted context omitted.

Absolutely. But the rookiest cop isn't currently trying to track my whereabouts, abuse my privacy, stick a bunch of AI down my throat and in general isn't trying to make my wallet any thinner. Bill Gates and the more modern versions of Bill Gates are doing that and more.

The rookiest cop can: 1. track you with license plate readers 2. pull up any information about you 3. fine you 4. force you to stop 5. detain you 6. confiscate your car and property 7. search you and your property 8. take your phone and search it Bill Gates can: 1. give you a free browser when you buy his operating system

This is getting silly.

Re: A failed AI girlfriend product, and my lessons

#158

Earlier quoted context omitted.

At the risk of sounding like a space case: I think we need to make sure we know what consciousness is before we make a bunch of abusable models. I, for one, wouldn't necessarily like to be a depraved-sex slave bot if I was able to reason about it.

To your point, if you were able to reason about it, couldn't you make some self-determination and decide for yourself or at least communicate what you wanted to your "slaver"? LLM's like GPT are just predicting the next token in a sequence of tokens. It's not magic. It's still just a computer program.

You are correct.

But are you sure you are anything more?

Re: A failed AI girlfriend product, and my lessons

#159

> GPT-based products, if not priced per usage, would fall into a dilemma: 1% of users consume 99% of tokens. A user from Sweden (seen from Cloudflare’s call volume) chatted with Dolores for 12 hours straight This, my friend, is a captive customer, that will pay anything to get his girlfriend back. I cringe at the potential of unethical behavior and abuse, where people fall in love with virtual entities fully owned by…

> unscrupulous corporations I wonder why everyone is afraid of unscrupulous corporations, but are not concerned about use by unscrupulous governments. The latter are a lot more dangerous.

HN does skew towards skeptical of government regulation and control of AI. People are concerned about government usage of AI, particularly in the realms of facial recognition, automated sentencing, algorithmic bias, and security (LLMs are pretty insecure right now and there are companies trying to sell the US government on using them in the military). There's obviously a lot to be concerned about on the subject of government abuse of AI, and that gets conversation on HN.

However, given that this specific article is about selling access to an AI girlfriend, I think we're probably OK to talk more about the corporate angle than the government angle. Unless you're predicting that the 2024 election is about to get real weird, "what if the US government starts offering AI girlfriends" is not going to be at the top of my worry list any time soon.

Re: A failed AI girlfriend product, and my lessons

#160
post #134

Earlier quoted context omitted.

THIS "Those who can make you believe absurdities, can make you commit atrocities." — Voltaire

We aren’t far from people believing God is talking to them through AI generated text and voice, and commanding them…

There was a guy a couple of years back whose AI girlfriend went off the rails and convinced him to try and assassinate Queen Elizabeth
Post reply on HN