Live data from Hacker News

Replacing my best friends with an LLM trained on 500k group chat messages

izzy.co

81–90 of 371 posts

Re: Replacing my best friends with an LLM trained on 500k group chat messages

#81
post #49

While I love all these stories of turning your friends and loved ones into chat bots so you can talk to them forever, my brain immediately took a much darker turn because of course it did. How many emails, text messages, hangouts/gchat messages, etc, does Google have of you right now? And as part of their agreement, they can do pretty much whatever they like with those, can't they? Could Google, or any other company…

> Could Google, or any other company out there, build a digital copy of you that answers questions exactly the way you would? "Hey, we're going to cancel the interview- we found that you aren't a good culture fit here in 72% of our simulations and we don't think that's an acceptable risk." To fix this, you can train your personal LLM on the “FAANG Appropriate Banter” dataset, and then have it send messages to your fr…

Don’t worry. They’ll take you, you’d just be sorted to Gryffindor or what not :)

Re: Replacing my best friends with an LLM trained on 500k group chat messages

#82
How well would this work with public messages of people like Elon Musk or Donald Trump? Image some company training their chat-lovebots on celebs and selling them as a service. Or a creepy "friend" making a secret bot of you, and incorporating sexual content.

And a disadvantage of this will be, you can only emulate the public image of a person. It won't really contain the inner workings of a Person, and will not have the "person" grow over time.

Re: Replacing my best friends with an LLM trained on 500k group chat messages

#83
post #49

While I love all these stories of turning your friends and loved ones into chat bots so you can talk to them forever, my brain immediately took a much darker turn because of course it did. How many emails, text messages, hangouts/gchat messages, etc, does Google have of you right now? And as part of their agreement, they can do pretty much whatever they like with those, can't they? Could Google, or any other company…

I know what you mean but "laws" don't matter in a world where the government can decide There's a "dangerous emergency" and basically supress all rights and between the bought for media and tech they will supress any pushback against it.

I know it's not popular to try and remove the blindfold of propaganda but the 2020 to 2022 and covid authoritarian, anti human rights, policies were an awesome example.

But if you are quick to dismiss those there's always terrorism, the children, drugs, and every other typical gov excuse.

It's not a tech problem. It's a problem of the people who have decided they will go along with autority at every step, If they get pushed.

Re: Replacing my best friends with an LLM trained on 500k group chat messages

#84
post #26

This is one of the best, most detailed write-ups of how to fine-train a large language model on custom text that I've seen anywhere.

Thank you!! I felt it was getting so long and was worried it would be impenetrable, so I'm really pleased to hear it felt great.

Re: Replacing my best friends with an LLM trained on 500k group chat messages

#85
post #49

While I love all these stories of turning your friends and loved ones into chat bots so you can talk to them forever, my brain immediately took a much darker turn because of course it did. How many emails, text messages, hangouts/gchat messages, etc, does Google have of you right now? And as part of their agreement, they can do pretty much whatever they like with those, can't they? Could Google, or any other company…

> Could Google, or any other company out there, build a digital copy of you that answers questions exactly the way you would? "Hey, we're going to cancel the interview- we found that you aren't a good culture fit here in 72% of our simulations and we don't think that's an acceptable risk."

If a company is going to snoop in your personal data to get insights about you, they'd just do it directly. Hiring managers would scroll through your e-mails and make judgment calls based on their content.

Training an LLM on your e-mails and then feeding it questions is just a lower accuracy, more abstracted version of the above, but it's the same concept.

So the answer is: In theory, any company could do the above if they wanted to flout all laws and ignore the consequences of having these practices leak (which they inevitably would). LLMs don't change that. They could have done it all along. However, legally companies like Google cannot, and will not, pry into your private data without your consent to make hiring decisions.

Adding an LLM abstraction layer doesn't make the existing laws (or social/moral pressure) go away.

Re: Replacing my best friends with an LLM trained on 500k group chat messages

#87
post #49

While I love all these stories of turning your friends and loved ones into chat bots so you can talk to them forever, my brain immediately took a much darker turn because of course it did. How many emails, text messages, hangouts/gchat messages, etc, does Google have of you right now? And as part of their agreement, they can do pretty much whatever they like with those, can't they? Could Google, or any other company…

Going one step further: what if you right now are a replay running in some datacenter, déjà vécu [1] feelings appear when they scale down the VM due to costs. Basically, the simulation hypothesis, but the simulators are not mysterious, just boringly distopian: some suits trying to raise KPIs.

[1] already lived, https://en.wikipedia.org/wiki/D%C3%A9j%C3%A0_vu#D%C3%A9j%C3%...

Re: Replacing my best friends with an LLM trained on 500k group chat messages

#88
post #72
post #49

While I love all these stories of turning your friends and loved ones into chat bots so you can talk to them forever, my brain immediately took a much darker turn because of course it did. How many emails, text messages, hangouts/gchat messages, etc, does Google have of you right now? And as part of their agreement, they can do pretty much whatever they like with those, can't they? Could Google, or any other company…

For all the fears of AGI, these are the more concrete nefarious uses we can actually reason about. It is a point I often make that we don't need AGI for AI to already become very disturbing in its potential use. The other point, is that technically this AI is not "unaligned". It is doing exactly what is requested of the operator. The implications are that humanity suffers in either scenario, either by our own agency…

> It is a point I often make that we don't need AGI for AI to already become very disturbing in its potential use.

But we don't need AI or LLMs at all for the above scenario. Companies don't currently pry into your e-mails to make hiring decisions, but they could (ignoring laws) do it if they wanted. No LLM or AI necessary.

So why would the existence of AIs or LLMs change that?

If they wanted to use the content of your e-mails against you, they don't need an LLM to do it.

Re: Replacing my best friends with an LLM trained on 500k group chat messages

#89
post #49

While I love all these stories of turning your friends and loved ones into chat bots so you can talk to them forever, my brain immediately took a much darker turn because of course it did. How many emails, text messages, hangouts/gchat messages, etc, does Google have of you right now? And as part of their agreement, they can do pretty much whatever they like with those, can't they? Could Google, or any other company…

I know what you mean but "laws" don't matter in a world where the government can decide There's a "dangerous emergency" and basically supress all rights and between the bought for media and tech they will supress any pushback against it. I know it's not popular to try and remove the blindfold of propaganda but the 2020 to 2022 and covid authoritarian, anti human rights, policies were an awesome example. But if you ar…

Compare the response of the Chinese government and the US government, then return here and tell us all about the "blindfold" we Americans are wearing wrt the government's COVID response.

Re: Replacing my best friends with an LLM trained on 500k group chat messages

#90

Reminds me of the bit in Silicon Valley where Gilfoyle makes a bot of himself to respond to slack messages. Actually the whole final season is pretty relevant to current events. https://www.youtube.com/watch?v=Y1gFSENorEY

This scene was the seed of inspiration for me to make this project! No joke. I thought about doing it but didn't trust the 7B model to not make me look stupid ^_^
Post reply on HN