Live data from Hacker News

A failed AI girlfriend product, and my lessons

mazzzystar.github.io

311–320 of 400 posts

Re: A failed AI girlfriend product, and my lessons

#311

Earlier quoted context omitted.

Also, my understanding is that when they made that change they goofed up companionship talk in general, by virtue of how messy AI censoring is.

IIRC, they screwed it up so massively that, for a while, the chatbot would still send "thirsty" automated messages inviting users to sexually explicit conversations, but would refuse to follow through.

Well that just services a different customer demographic.

Re: A failed AI girlfriend product, and my lessons

#312

Earlier quoted context omitted.

> I struggle to see the benefit of this kind of censorship as well, it has a very “video games make people murders” vibe. That we’re being protected, for our own good, from…horny robots? These broad strokes are always the result of poor reporting extrapolated to all humans. See also: escalation of porn use. In all of these "___ makes people ___," there are a minority of people for which it's true. The media just pres…

1. Some people are so far to the left side of the bell curve that they're going to be screwed out of a human relationship no matter what they do, and it's unkind to withhold sex bots from them just to provide increased motivation to the segment of the population that's still salvageable. 2. Society seems to have collectively decided that romantic intimacy, unlike food and shelter, is optional and that experiencing an…

You make some good points. I don't agree with them, but they're solid.

> Therefore, the kindest thing they can do is leave the autists alone so they can cope as best they can in peace.

This one, no. I'm probably autistic. It wasn't a diagnosis for anything when I was growing up, I was just weird. I craved connection so badly it compelled me to try to "improve" myself to be more like others. I'd be completely fucked today if someone offered a fake, effortless alternative.

I don't think parasocial relationships are actually working out for anyone. The kids are all miserable, lonely, and have a million mental health issues. Kids used to negotiate their differences and play together. Now each of them thinks they get to set the rules for the entire playground. I'd be lonely and bitter too with that mentality.

> You could argue the AI companies would have an incentive to exploit their users, but this is a thing that happens in real relationships as well!

Sadly, yeah. Your chances of finding a human companion who isn't a piece of shit is way higher than finding an ethical tech company to pour your heart out to though.

Re: A failed AI girlfriend product, and my lessons

#313

Earlier quoted context omitted.

> This, my friend, is a captive customer, that will pay anything to get his girlfriend back Or potentially do anything. I'd be a little scared of having folks like this convinced I am the personal arbiter gatekeeping their access to their 'lover,' that I 'took them away.' When Replika.ai restricted erotic chat from their product, the apoplectic anguish on their subreddit was unlike any emotional reaction I've ever wi…

> When Replika.ai restricted erotic chat from their product, the apoplectic anguish on their subreddit was unlike any emotional reaction I've ever witnessed from a group of people about a consumer technology. And their anguish was genuine - there are Replika users who truly consider themselves married to their AI companion. There's a second layer to this though -- Replika's marketing was heavily centered around that…

I think most times you don't need to make a simile but just re-state the issue as simply and explicit as possible. Like, they heavily advertised and sold a feature and then took it away after people were used to it.

They had valid reasons for that, but people were understandably mad.

Re: A failed AI girlfriend product, and my lessons

#314
post #309

Earlier quoted context omitted.

How can BG make you unemployable? Who has he done this to?

> How can BG make you unemployable? - He could drag up and publicise something you wrote at some point and make you one of the "today's twitter main character" people. (Last I heard Justine Sacco was still unemployed). If he did this by paying a competent PR firm, you'd never know it wasn't just something that happened by coincidence - He could get linkedin to quietly drop or deprioritise your job applications - He c…

Any evidence Bill Gates did any of this?

Even if true, compare this against the difficulty finding a job if you have a criminal record. Now there's a real blacklist.

> Justine Sacco is still unemployed

No evidence she was sabotaged by a corporation. Besides, she's employed as of 2018:

https://www.vox.com/2018/1/19/16911074/justine-sacco-iac-mat...

> silicon valley wage-fixing scandal

Is kinda nothing set against government wage fixing laws.

> old-school blacklist

I'm sure there are informal blacklists. But I've been in tech all my life, and nobody ever handed me a blacklist and said "don't hire these people". There are a zillion companies in the US, any such pervasive blacklist will inevitably become common knowledge.

Re: A failed AI girlfriend product, and my lessons

#315

Interesting read. Others have also created virtual friends using ChatGPT. What I find unsavory, is OpenAI imposing content restrictions like NSFW. That can easily extend to censorship of non-PC content, unpopular political ideas, and more. The solution will (I hope) ultimately be open-source LLMs that you can run locally, on your own hardware.

It's not clear what the limits are, from the article or really from OpenAI. The author only really knew that some combination of quantity and extent of material was enough to trigger a warning, it could very well have been a handful of users pushing boundaries pretty far. NSFW is one thing, but chat can certainly go into NSFL territory, non-consensual roleplay, etc.

I don't know if people here are being naive or dense, but merely "non-PC" content isn't going to trigger anything.

I spent like a couple minutes setting up a roleplay where ChatGPT is happily advocating for Nazi ideology (and not even on the API; ChatGPT is generally more censorious than the API). I'm not going to try to hit the limits, but I literally don't think you can hit the limits with merely political speech. I don't know what the NSFW limits are, but I bet they are further than people here think.

The vagueness absolutely makes stuff difficult, and the author hit a kind of all-or-nothing approach by going from no restrictions to using the moderation endpoint which is very strict. That could be improved.

Re: A failed AI girlfriend product, and my lessons

#316

Well this went places. The dev really 'ate his own dogfood' so to speak. I thought it was going to be a despairing look at how his companion AI was continuously turned to sleazy uses by a pervy userbase but that's pretty much what he was going for it seems. I have to say, I hated this part: "...gained a lot of Chinese users. I immediately realized the political risk: users could set Dolores’ background, personality,…

I hadn't read anything like that so I just checked and searched for "China" and it's not in the article. Looks like he censored the censorship.

Edit: Yeah, looking at an archived version, it's been edited quite a bit.

Re: A failed AI girlfriend product, and my lessons

#317

> But, does humanity really need an AI friend? This reminds me of the Fredrick Pohl line "A good science fiction story should be able to predict not the automobile but the traffic jam." So I wonder what the traffic jam is going to look like given that the car seems to already be parked outside with the engine running. Faster depopulation across the developed world? Probably, but maybe there's something even more impo…

Personal Data lake Draught syndrome / Data Impaired Persona Personality?

Not for AI friends, but for AI social agents that automate social interaction on your behalf; microblogs, videoblogs, memeposts and discuss online on your behalf - for the users that starts using AI agents too early in life and have too little data to imbue the agents with a personality that stems from their own voice and expression?

Re: A failed AI girlfriend product, and my lessons

#318

> But, does humanity really need an AI friend? This reminds me of the Fredrick Pohl line "A good science fiction story should be able to predict not the automobile but the traffic jam." So I wonder what the traffic jam is going to look like given that the car seems to already be parked outside with the engine running. Faster depopulation across the developed world? Probably, but maybe there's something even more impo…

Not for AI friends but I’m starting to see ‘traffic jams’ at work - people using GPT to output a bunch of verbose text, and others then using GPT to summarise that text so they can understand it. It feels like the beginning of a weird arms race where everybody is insulated from everyone else by a layer of junk created by AI (and the workaround to that junk is more AI)

More like a weird arms race where no one actually thinks about what they are saying or reading anymore and you are drowning in word soup. After all words are just tools to achieve some goal.

Re: A failed AI girlfriend product, and my lessons

#319

Earlier quoted context omitted.

I think the pleasure trip is just porn. We have that already and it's possible to discuss the effects of widespread porn on people. I think the next step is, what does it mean to have an emotional relationship with someone in your pocket who is for all definitions perfect - can provide perfect advice and does so with judgement, ridicule, pity or anger? What will be my bar for human relationships, those imperfect mess…

If your definition of perfect is an AI that is programmed not to upset you, then sure. But maybe there is perfection in the imperfection of humans and the pain that inevitably arises from human relationships? We learn how to love through our differences. Intimacy is deepened by meeting each other in the raw, vulnerable and wounded places. The kind of “perfect significant other” you’re describing sounds sterile and a…

Lex Friedman podcast with Elon where they discuss that war is an inevitability of the human condition. The idea of world peace may not be a worthwhile goal as what it is to be human is to have suffering, to some degree.

As I navigate dating, I've found the perfectly "compliant" or even "subservient" relationships are just as shallow as the ones fueled by lust.

Sadly, when relationships are as replaceable as water, there's not much thirst for anything real, including the ups and downs.

I guess what I'm musing is that I feel bad for the people stuck in the empty loops of "perfect" satisfaction and hope they find the human in themselves in the day to day. Amusing Ourselves to Death comes to mind.

Re: A failed AI girlfriend product, and my lessons

#320
post #205

Earlier quoted context omitted.

Hm, let's try an extreme: the AI friend slowly becomes a cult leader to you, hijacking your mind into subservience to the owner of the service to which AI belongs, and further up some social/political hierarchy to a few controlling people/groups of people. The traffic jam is society stymied by individuals mind-controlled at a level closer to connection to a human than any other way possible before this.

Kinda feel like you have that backwards, why would an AI that sophisticated care about controlling your mind? Why would the group of people who control that AI care about you as anything other than a liability? What do they get out of manipulating average individuals? Votes? The scarier prospect to me is human labor and intelligence become almost worthless and those at the top start to view the masses as superfluous.

> Why would the group of people who control that AI care about you as anything other than a liability? What do they get out of manipulating average individuals

Greater ad revenue. I would expect that tailoring your reality feed to whatever makes the AI controller the most money will be extremely lucrative.

Kind of like how visa/stripe takes 2-5% of every financial transaction. Imagine if a firm could make 5-10% of everything you do by manipulating you to maximum effect.

Post reply on HN