Live data from Hacker News

Replacing my best friends with an LLM trained on 500k group chat messages

izzy.co

71–80 of 371 posts

Re: Replacing my best friends with an LLM trained on 500k group chat messages

#72
post #49

While I love all these stories of turning your friends and loved ones into chat bots so you can talk to them forever, my brain immediately took a much darker turn because of course it did. How many emails, text messages, hangouts/gchat messages, etc, does Google have of you right now? And as part of their agreement, they can do pretty much whatever they like with those, can't they? Could Google, or any other company…

For all the fears of AGI, these are the more concrete nefarious uses we can actually reason about. It is a point I often make that we don't need AGI for AI to already become very disturbing in its potential use.

The other point, is that technically this AI is not "unaligned". It is doing exactly what is requested of the operator.

The implications are that humanity suffers in either scenario, either by our own agency in control of power we are not prepared to manage or we will be managed by power that we can not control.

Re: Replacing my best friends with an LLM trained on 500k group chat messages

#74
post #49

While I love all these stories of turning your friends and loved ones into chat bots so you can talk to them forever, my brain immediately took a much darker turn because of course it did. How many emails, text messages, hangouts/gchat messages, etc, does Google have of you right now? And as part of their agreement, they can do pretty much whatever they like with those, can't they? Could Google, or any other company…

> Could Google, or any other company out there, build a digital copy of you that answers questions exactly the way you would? "Hey, we're going to cancel the interview- we found that you aren't a good culture fit here in 72% of our simulations and we don't think that's an acceptable risk."

To fix this, you can train your personal LLM on the “FAANG Appropriate Banter” dataset, and then have it send messages to your friends daily for several months in the lead up to your interview.

Re: Replacing my best friends with an LLM trained on 500k group chat messages

#75
post #53
post #49

While I love all these stories of turning your friends and loved ones into chat bots so you can talk to them forever, my brain immediately took a much darker turn because of course it did. How many emails, text messages, hangouts/gchat messages, etc, does Google have of you right now? And as part of their agreement, they can do pretty much whatever they like with those, can't they? Could Google, or any other company…

Reminds me a little of (fiction, for now) Google People: https://qntm.org/person

Reminds me of Harry Potter magic.

Seems like a perfect technology to implement these talking photographs, paintings and pictures from there.

Re: Replacing my best friends with an LLM trained on 500k group chat messages

#76
post #49

While I love all these stories of turning your friends and loved ones into chat bots so you can talk to them forever, my brain immediately took a much darker turn because of course it did. How many emails, text messages, hangouts/gchat messages, etc, does Google have of you right now? And as part of their agreement, they can do pretty much whatever they like with those, can't they? Could Google, or any other company…

And yet, every time these fears are brought up with AI people, they are dismissed as Luddite hyperbole.

“We’re saving the world” they say. With zero regard for second order effects, or with arrogant dismissal of those effects as worth it for the first order gains.

Disgusting to watch unfold.

Re: Replacing my best friends with an LLM trained on 500k group chat messages

#77
post #49

While I love all these stories of turning your friends and loved ones into chat bots so you can talk to them forever, my brain immediately took a much darker turn because of course it did. How many emails, text messages, hangouts/gchat messages, etc, does Google have of you right now? And as part of their agreement, they can do pretty much whatever they like with those, can't they? Could Google, or any other company…

> And as part of their agreement, they can do pretty much whatever they like with those, can't they? No, they definitely can't. Parts of HN love to hate on GDPR, but laws like that prevent companies from doing the things you proposed.

They are supposed to, but usually it takes several dozen times of them getting caught with their hands in the cookie jar and fined before they are even capable of acknowledging these laws even exist.

Re: Replacing my best friends with an LLM trained on 500k group chat messages

#78

Very reminiscent of the Be Right Back episode of Black Mirror [1]. A family member recently died unexpectedly, and I have a small collection of texts, emails, and blog posts by them saved on my machine in the small (perhaps delusional) hope that they'll be a useful training set for a them-flavored chatbot. Perhaps even one that's trained to help me with the grief of their loss. Not a huge amount of training data, tho…

On a lighter note this reminds me of the Bobiverse comedy sci-fi series on Audible. Premise of __ We Are Legion (We Are Bob): Bobiverse, Book 1 __ >> Bob Johansson has just sold his software company for a small fortune and is looking forward to a life of leisure. The first item on his to-do list: Spending his newfound windfall. On an urge to splurge, he signs up to have his head cryogenically preserved in case of dea…

Loved the whole Bobiverse series. Highly recommended for folks who want a relatively easy sci-fi read.

Re: Replacing my best friends with an LLM trained on 500k group chat messages

#79
post #49

While I love all these stories of turning your friends and loved ones into chat bots so you can talk to them forever, my brain immediately took a much darker turn because of course it did. How many emails, text messages, hangouts/gchat messages, etc, does Google have of you right now? And as part of their agreement, they can do pretty much whatever they like with those, can't they? Could Google, or any other company…

> input_dir /path/to/downloaded/llama/weights --model_size 7B

Most absolutely not with the 7B llama model as described here.

…but, potentially, with a much larger fine tuned foundational model, if you have a lot of open source code on GitHub and lots of public samples.

The question is why you would bother? very large models would most likely not be meaningfully improved by fine tuning on a specific individual.

The only reason to do this would be to coax a much smaller model into having characteristics of a much larger one by fine tuning… but, realistically, right now, it seem pretty skeptical anyone would bother.

Why not just invest in a much larger more capable model?

Re: Replacing my best friends with an LLM trained on 500k group chat messages

#80
post #19

This is awesome, clear and concise explanation. I was talking to my wife and debating whether I should build a model of each of us and store it somewhere in case something tragic happens to either of us. But we decided not to because something about it felt wrong but maybe I’ll make it just in case I regret not doing later on.

You certainly won’t regret it. If you need to get information out of your wife and she won’t cooperate you can coerce the LLM of your wife into having it divulge private information that your wife won’t reveal. This can be very useful for something like a divorce case. Best to find a way to keep the LLM regularly training on new data as well. Edit : stop downvoting ideas you don’t like, that’s not what it’s for.

How would the LLM be trained with information she wouldn't divulge?
Post reply on HN