Live data from Hacker News

GirlfriendGPT – OSS AI Companion

github.com

201–210 of 213 posts

Re: GirlfriendGPT – OSS AI Companion

#201

Haven’t we retreated from life enough? AI companions are just a fancy way of pretending you’re not alone.

Well all we do is pretend that life has some kind of meaning besides being busy until you're dead and forgotten. Might as well pretend a bit more.

That's probably where all of this is going.

Re: GirlfriendGPT – OSS AI Companion

#202
post #35

Earlier quoted context omitted.

ahhh I remember the good old days when I could get 8% on some crypto investments and buy a nice ape for $4k before selling it for $400k if only I would wait for the right time.

These people are selling a service, not soliciting investment. Were you under the impression that the people paying to 'speak' to Amouranth are expecting a financial return?

it's all grifting to me...

Re: GirlfriendGPT – OSS AI Companion

#203

Company that nails this product is going to be very rich and a strange world is ahead of us. Calling it now within 6 years this will be as normal as Tinder. Most of peoples social interactions are between aluminum and glass sheets. I don’t believe it’s going to matter what’s on the other side soon.

> Calling it now within 6 years this will be as normal as Tinder.

hard disagree. tinder is a cesspool and large numbers of younger folks are not using it, or are moving to other options. because of all of the bots.

for the folks desperate for any sort of parasocial activity, it will be normal, but those people are already on 4chan / 8chan / whatever, and already have their RealDoll.

Something less blatantly sexual or romantic will be a thing everywhere, though, as a personal concierge. Looking forward to that, assuming they can make it so its not an insane privacy violation or psy-op.

Re: GirlfriendGPT – OSS AI Companion

#205
post #5

I am not worried about an evil, monstrous AGI suddenly emerging and blowing away humanity, but I do worry about things like this. Hyperpornography seems a squarely apocalyptic trend.

The concept isn't new, 20 years ago Futurama had this public info film about the dangers

https://www.youtube.com/watch?v=wJ6knaienVE

Re: GirlfriendGPT – OSS AI Companion

#206

Earlier quoted context omitted.

By interacting with LLMs, I've realized that as frequently as I interact with others, I'm not actually having many deep, meaningful, or personal interactions; they're mostly professional, and that's bled over into my personal life. Because of how much time I spend on them relative to myself, I don't get to stretch the sides of me that I would if I weren't holed up working, and I've found it hard to verbalize that los…

Got any recommendations for non-neutered local models that perform well on an M1? I've been playing with some of the recent 7B and 13B models from the TheBloke on HuggingFace and they are not bad but not great. https://huggingface.co/TheBloke

A (fine-tuned) model's inference quality is a function of parameters and inputs, so you'll need to be aware of what something was trained on to prompt it correctly (usually in the model card). You'll also see huge differences in inference between llamacpp, ooba, etc.

I haven't benchmarked on Apple Silicon, but if you have the RAM, I'd recommend 30B SuperCOT ggml Q5_1 or a GPT-4-x-Alpaca variant. Because of the disparity in quality, I haven't used many models under 30B and so can't recommend one.

See rentry.org/lmg_models for a practical list and description.

Re: GirlfriendGPT – OSS AI Companion

#207
post #8

AFAICT it uses steamship_langchain which calls to OpenAI. It's technically 'OSS' in the sense a client to a closed system is OSS.

Yea. Would you be interested if I connect it to a local LLM so convo's stay private? Any good models you have in mind?

Maybe Vicuna? It was designed for AI assistant use case.

Re: GirlfriendGPT – OSS AI Companion

#208

Do we think a Boyfriend version will ever come along? Interesting that I've seen so much talk about AI girlfriends but there's a quiet assumption that straight women won't be interested in this technology. Is that correct?

Some of us guys would prefer that version as well.

I’m not sure there’s an assumption, more that the author is a straight guy and creating things based on his experience and perspective. Would the creator even know what a woman, or someone like myself wanted in a partner?

There is truth to our industry being predominantly male though, so this probably gets more interest from people on sites like HN and Reddit.

Re: GirlfriendGPT – OSS AI Companion

#210

Earlier quoted context omitted.

Got any recommendations for non-neutered local models that perform well on an M1? I've been playing with some of the recent 7B and 13B models from the TheBloke on HuggingFace and they are not bad but not great. https://huggingface.co/TheBloke

A (fine-tuned) model's inference quality is a function of parameters and inputs, so you'll need to be aware of what something was trained on to prompt it correctly (usually in the model card). You'll also see huge differences in inference between llamacpp, ooba, etc. I haven't benchmarked on Apple Silicon, but if you have the RAM, I'd recommend 30B SuperCOT ggml Q5_1 or a GPT-4-x-Alpaca variant. Because of the dispar…

Thanks for the reply and the recommendations! I will see if my machine can handle some of the quantized 30B models.

I'm slightly confused about your comment about llama.cpp vs oobabooga. Doesn't text-generation-webui use llama.cpp underneath?

Also, huge thanks for the point towards https://rentry.org/lmg_models. That's an invaluable resource.

Post reply on HN