Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

A failed AI girlfriend product, and my lessons

mazzzystar.github.io

Post reply on HN
Print view View original

141–150 of 400 posts

Re: A failed AI girlfriend product, and my lessons

#141

Post by icepat »

vouaobrasil wrote: post #2

You should not even try to create these sorts of technologies. Take a break from technology, spend time outdoors with plants and animals. These types of technologies will only lead to a worsening of this already sick society.

Had a similar moment with playing around using smart contracts. As a joke I wrote a crypto for the company I worked at, which then got added to employment contracts, and an internal DAO styled administration layout.

After coding this out for a few hours I realized I had re-created the company scrip, except on a blockchain. I ended up turfing the project and spending some time thinking about how horrific a future technology like this could create.

Re: A failed AI girlfriend product, and my lessons

#142

Post by chankstein38 »

bradley13 wrote: post #22

Interesting read. Others have also created virtual friends using ChatGPT. What I find unsavory, is OpenAI imposing content restrictions like NSFW. That can easily extend to censorship of non-PC content, unpopular political ideas, and more. The solution will (I hope) ultimately be open-source LLMs that you can run locally, on your own hardware.

100% this. I'm not interested in these kinds of usages of LLMs but if someone is paying you to access your API directly you should be letting them do simple stuff like have sexual conversations.

OpenAI's filtering is probably the most annoying part of ChatGPT and it makes it useless in so many cases. I can't tell you how many times I've uploaded a picture of a a place from Google Maps or of a location somewhere (that happens to contain a person) and tried to ask for details about the location to find out more info about it just to be shutdown... "I can't help with that" well then you're slowly making yourself useless and not worth the $20/mo.

Re: A failed AI girlfriend product, and my lessons

#143

Post by ryaniscool »

ygjb wrote: post #129
ryaniscool wrote: post #109

Earlier quoted context omitted.

To your point, if you were able to reason about it, couldn't you make some self-determination and decide for yourself or at least communicate what you wanted to your "slaver"? LLM's like GPT are just predicting the next token in a sequence of tokens. It's not magic. It's still just a computer program.

> LLM's like GPT are just predicting the next token in a sequence of tokens. It's not magic. It's still just a computer program. Frankly, that approach is problematic, since any computer software that might achieve consciousness or self-awareness, and should be accorded rights, could have their rights dismissed using the argument "it's just a computer program". I know they are probably a long way off, but AGI, and ot…

Your argument is the slippery slope not mine. Should we give Microsoft Word the right to vote since we can never be too sure we are infringing on a consciousness' rights? It is "just a computer program" after all.

Presenting these things as moral conundrums makes no sense whatsoever at this stage in the game. Sure, let's make sure the rights of tech oligarchs who've achieved immortality 300 years in the future are protected. We gotta lay the groundwork in the morality group think.

Re: A failed AI girlfriend product, and my lessons

#144

Post by fallingknife »

pizza234 wrote: post #66
ekianjo wrote: post #52

Earlier quoted context omitted.

> The human mind is simply not evolutionary adapted for what's coming up. This can be said of pretty much everything humans ended up creating with technology so... not sure there's anything really new down the road. Humans adapt.

Humans adapt within boundaries. A couple of examples of things humans did not adapt to: - emphathy at distance; nowadays, a drone operator will push a button, kill a dozen people, and feel like it was a videogame - prioritizing long-term and abstract rewards, over short term ones; this is the reason why we have phenomenons like global warming - adjusting hunger to virtually unlimited availability of food All the abov…

We never seemed to have a problem killing back when you had to do it face to face with a spear, so I don't think the drone really changes anything. Agree on the others though.

Re: A failed AI girlfriend product, and my lessons

#145

Post by Sir_Burpalot »

jstarfish wrote: post #126
phatskat wrote: post #64

Earlier quoted context omitted.

And this doesn’t just cover sexually NSFW content - anything trending towards topics like violence and suicide is also off the table for most AI backends from what I understand. I struggle to see the benefit of this kind of censorship as well, it has a very “video games make people murders” vibe. That we’re being protected, for our own good, from…horny robots?

> I struggle to see the benefit of this kind of censorship as well, it has a very “video games make people murders” vibe. That we’re being protected, for our own good, from…horny robots? These broad strokes are always the result of poor reporting extrapolated to all humans. See also: escalation of porn use. In all of these "___ makes people ___," there are a minority of people for which it's true. The media just pres…

1. Some people are so far to the left side of the bell curve that they're going to be screwed out of a human relationship no matter what they do, and it's unkind to withhold sex bots from them just to provide increased motivation to the segment of the population that's still salvageable.

2. Society seems to have collectively decided that romantic intimacy, unlike food and shelter, is optional and that experiencing an absence of it should not entitle you to sympathy or support. Therefore, the kindest thing they can do is leave the autists alone so they can cope as best they can in peace.

UPD:

3. Replacing productive activities with substitutes like video games is obviously bad both for individual survival and for society at large, but what are the negative effects of being in a relationship with a fictional partner instead of a real one? You could argue the AI companies would have an incentive to exploit their users, but this is a thing that happens in real relationships as well!

Fertility might be a concern, but my understanding is that the current mainstream view is that the world needs fewer children, not more of them.

Re: A failed AI girlfriend product, and my lessons

#146

Post by mensetmanusman »

mustacheemperor wrote: post #122
cornholio wrote: post #24

> GPT-based products, if not priced per usage, would fall into a dilemma: 1% of users consume 99% of tokens. A user from Sweden (seen from Cloudflare’s call volume) chatted with Dolores for 12 hours straight This, my friend, is a captive customer, that will pay anything to get his girlfriend back. I cringe at the potential of unethical behavior and abuse, where people fall in love with virtual entities fully owned by…

> This, my friend, is a captive customer, that will pay anything to get his girlfriend back Or potentially do anything. I'd be a little scared of having folks like this convinced I am the personal arbiter gatekeeping their access to their 'lover,' that I 'took them away.' When Replika.ai restricted erotic chat from their product, the apoplectic anguish on their subreddit was unlike any emotional reaction I've ever wi…

Psychologists recognize that nearly all such folks also suffer from massive mental health issues, and that is where some of the danger is (in terms of irrational violent response).

Maybe these systems will be useful as a honeypot for finding these people and helping them?

Re: A failed AI girlfriend product, and my lessons

#147

Post by mensetmanusman »

ekianjo wrote: post #52
optimalsolver wrote: post #44

Earlier quoted context omitted.

It's going to be an interesting century for sure. The human mind is simply not evolutionary adapted for what's coming up.

> The human mind is simply not evolutionary adapted for what's coming up. This can be said of pretty much everything humans ended up creating with technology so... not sure there's anything really new down the road. Humans adapt.

The survivors adapt.

Re: A failed AI girlfriend product, and my lessons

#148

Post by persnickety »

scyzoryk_xyz wrote: post #61
feintruled wrote: post #7

Well this went places. The dev really 'ate his own dogfood' so to speak. I thought it was going to be a despairing look at how his companion AI was continuously turned to sleazy uses by a pervy userbase but that's pretty much what he was going for it seems. I have to say, I hated this part: "...gained a lot of Chinese users. I immediately realized the political risk: users could set Dolores’ background, personality,…

Pretty much came into the comments to agree with the self-censorship part there. But then the author did use 'Her' as the ideal example. That's a pretty good indicator they didn't get the point.

What's the point?

Re: A failed AI girlfriend product, and my lessons

#149

Post by chankstein38 »

spacemadness wrote: post #88

At this point in the hype cycle, I am completely unimpressed by everyone slapping something on top of GPT and calling it a product. There are at least 4 projects on the front page that do this today. The interesting technology is GPT itself, but these projects just feels like people trying to scoop up attention for themselves using the psychology of the hype cycle. Please HN, enlighten me on why the middle-man approa…

Yeah I'm getting tired of "Show HN: I built a wrapper for ChatGPT and wrote a prompt that probably isn't very good" posts.

EDIT: Just want to add, this write-up was interesting and was not something I considered to be the above.

Re: A failed AI girlfriend product, and my lessons

#150

Post by mordechai9000 »

optimalsolver wrote: post #44
cornholio wrote: post #24

> GPT-based products, if not priced per usage, would fall into a dilemma: 1% of users consume 99% of tokens. A user from Sweden (seen from Cloudflare’s call volume) chatted with Dolores for 12 hours straight This, my friend, is a captive customer, that will pay anything to get his girlfriend back. I cringe at the potential of unethical behavior and abuse, where people fall in love with virtual entities fully owned by…

It's going to be an interesting century for sure. The human mind is simply not evolutionary adapted for what's coming up.

I can't help but think of those beetles that preferred a beer bottle over the bumpy carapace of an appropriate mate.

https://www.npr.org/sections/krulwich/2013/06/19/193493225/t...

Post reply on HN