Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

A failed AI girlfriend product, and my lessons

mazzzystar.github.io

Post reply on HN
Print view View original

271–280 of 400 posts

Re: A failed AI girlfriend product, and my lessons

#271

Post by stylepoints »

jstarfish wrote: post #126
phatskat wrote: post #64

Earlier quoted context omitted.

And this doesn’t just cover sexually NSFW content - anything trending towards topics like violence and suicide is also off the table for most AI backends from what I understand. I struggle to see the benefit of this kind of censorship as well, it has a very “video games make people murders” vibe. That we’re being protected, for our own good, from…horny robots?

> I struggle to see the benefit of this kind of censorship as well, it has a very “video games make people murders” vibe. That we’re being protected, for our own good, from…horny robots? These broad strokes are always the result of poor reporting extrapolated to all humans. See also: escalation of porn use. In all of these "___ makes people ___," there are a minority of people for which it's true. The media just pres…

Just get a cat/dog.

Re: A failed AI girlfriend product, and my lessons

#272

Post by icepat »

Dylan16807 wrote: post #227
icepat wrote: post #203

Earlier quoted context omitted.

Not really, I saw it as technology that was "new and trendy" rebranding a very old and exploitive employment paradigm. "You can work at a DAO and be paid on the blockchain" "You can work at a company and be paid in script" It's the same thing, but the modern technology masks what exactly is happening.

Do the relevant laws about how people get paid care about the difference between company scrip and company token?

I think the major difference is a DAO is not a corporation, by design. So the legislation around them is still in catch-up mode.

In other words, yes, because the entire framework is different.

Re: A failed AI girlfriend product, and my lessons

#273

Post by Izkata »

ericmcer wrote: post #228
dpflan wrote: post #205

Earlier quoted context omitted.

Hm, let's try an extreme: the AI friend slowly becomes a cult leader to you, hijacking your mind into subservience to the owner of the service to which AI belongs, and further up some social/political hierarchy to a few controlling people/groups of people. The traffic jam is society stymied by individuals mind-controlled at a level closer to connection to a human than any other way possible before this.

Kinda feel like you have that backwards, why would an AI that sophisticated care about controlling your mind? Why would the group of people who control that AI care about you as anything other than a liability? What do they get out of manipulating average individuals? Votes? The scarier prospect to me is human labor and intelligence become almost worthless and those at the top start to view the masses as superfluous.

> why would an AI that sophisticated care about controlling your mind? [..] What do they get out of manipulating average individuals?

Captcha slaves?

Re: A failed AI girlfriend product, and my lessons

#274

Post by Izkata »

nemothekid wrote: post #242
Octokiddie wrote: post #193

> But, does humanity really need an AI friend? This reminds me of the Fredrick Pohl line "A good science fiction story should be able to predict not the automobile but the traffic jam." So I wonder what the traffic jam is going to look like given that the car seems to already be parked outside with the engine running. Faster depopulation across the developed world? Probably, but maybe there's something even more impo…

I think the pleasure trip is just porn. We have that already and it's possible to discuss the effects of widespread porn on people. I think the next step is, what does it mean to have an emotional relationship with someone in your pocket who is for all definitions perfect - can provide perfect advice and does so with judgement, ridicule, pity or anger? What will be my bar for human relationships, those imperfect mess…

You can find that out already by looking at Replika users.

Re: A failed AI girlfriend product, and my lessons

#275

Post by JohnFen »

nemothekid wrote: post #242
Octokiddie wrote: post #193

> But, does humanity really need an AI friend? This reminds me of the Fredrick Pohl line "A good science fiction story should be able to predict not the automobile but the traffic jam." So I wonder what the traffic jam is going to look like given that the car seems to already be parked outside with the engine running. Faster depopulation across the developed world? Probably, but maybe there's something even more impo…

I think the pleasure trip is just porn. We have that already and it's possible to discuss the effects of widespread porn on people. I think the next step is, what does it mean to have an emotional relationship with someone in your pocket who is for all definitions perfect - can provide perfect advice and does so with judgement, ridicule, pity or anger? What will be my bar for human relationships, those imperfect mess…

> what does it mean to have an emotional relationship with someone in your pocket who is for all definitions perfect - can provide perfect advice and does so with judgement, ridicule, pity or anger?

I don't think I could have an emotional relationship with such an entity, to be honest. It wouldn't be perfect at all -- it would be deeply flawed.

But maybe that's just me.

Re: A failed AI girlfriend product, and my lessons

#276

Post by dwroberts »

Octokiddie wrote: post #193

> But, does humanity really need an AI friend? This reminds me of the Fredrick Pohl line "A good science fiction story should be able to predict not the automobile but the traffic jam." So I wonder what the traffic jam is going to look like given that the car seems to already be parked outside with the engine running. Faster depopulation across the developed world? Probably, but maybe there's something even more impo…

Not for AI friends but I’m starting to see ‘traffic jams’ at work - people using GPT to output a bunch of verbose text, and others then using GPT to summarise that text so they can understand it. It feels like the beginning of a weird arms race where everybody is insulated from everyone else by a layer of junk created by AI (and the workaround to that junk is more AI)

Re: A failed AI girlfriend product, and my lessons

#277

Post by antiterra »

Octokiddie wrote: post #193

> But, does humanity really need an AI friend? This reminds me of the Fredrick Pohl line "A good science fiction story should be able to predict not the automobile but the traffic jam." So I wonder what the traffic jam is going to look like given that the car seems to already be parked outside with the engine running. Faster depopulation across the developed world? Probably, but maybe there's something even more impo…

> A good science fiction story should be able to predict not the automobile but the traffic jam.

One simple way to tilt any romanticized sci-fi invention dystopian is simply to imagine the invention is required and the only option for nearly everyone. This works for everything from text-to-speech to robot companions to teleportation to AR headsets to cars.

Re: A failed AI girlfriend product, and my lessons

#279

Post by JohnFen »

mustacheemperor wrote: post #122
cornholio wrote: post #24

> GPT-based products, if not priced per usage, would fall into a dilemma: 1% of users consume 99% of tokens. A user from Sweden (seen from Cloudflare’s call volume) chatted with Dolores for 12 hours straight This, my friend, is a captive customer, that will pay anything to get his girlfriend back. I cringe at the potential of unethical behavior and abuse, where people fall in love with virtual entities fully owned by…

> This, my friend, is a captive customer, that will pay anything to get his girlfriend back Or potentially do anything. I'd be a little scared of having folks like this convinced I am the personal arbiter gatekeeping their access to their 'lover,' that I 'took them away.' When Replika.ai restricted erotic chat from their product, the apoplectic anguish on their subreddit was unlike any emotional reaction I've ever wi…

> And their anguish was genuine - there are Replika users who truly consider themselves married to their AI companion.

That's what elevated the whole thing from just really creepy to utterly terrifying.

Re: A failed AI girlfriend product, and my lessons

#280

Post by [deleted] »

mrguyorama wrote: post #256
Der_Einzige wrote: post #215

Earlier quoted context omitted.

God forbid that ugly people get to have the same kinds of positive relationship experiences that attractive people get. I can’t believe how the moment that a technology comes out which gives incels real options it’s seen as being terrible for society. It’s awesome for society.

This doesn't give an incel an "option" anymore than playing mario kart makes you a better race car driver. As a business, they will be optimized to fit an incel's wants, not to help them adapt to reality and healthy relationships. Incels need therapy and support, not a fake "girlfriend" program that charges them money to reinforce their existing horrific worldviews

[deleted]
Post reply on HN