Sorry if my question is stupid, I am completely new to this. But, why exactly is a Weights and Biases account needed? I thought the training is running in vast.ai
Replacing my best friends with an LLM trained on 500k group chat messages
181–190 of 371 posts
Re: Replacing my best friends with an LLM trained on 500k group chat messages
#182I was talking to a non-tech friend about all the AI advancements lately and when she asked me what I thought the biggest risk was I said it's exactly what we all just experienced the past 3 years and realized is awful for human - prolonged social isolation. My biggest worry is that AI generated art (be it photos, music, code, etc.) and AI assistants will become so good we won't need other humans to get our social fix…
I'm wondering how it will turn out too. I wouldn't say it's nightmare fuel for me but i wouldn't say i'm optimistic either. To me, it may parallel when online dating became a thing. Many people were worried about the lack of social interaction in online dating and its effects. Online dating is definitely a different process than IRL dating but I don't know if the outcomes are worse or better.
I can imagine relationships with AI being similar. It's definitely going to be different but to say it's worse or better may be hard to tell.
Re: Replacing my best friends with an LLM trained on 500k group chat messages
#183Earlier quoted context omitted.
This feels very dark to me: I think it would make it enormously harder to actually process the grief. (The thought "You could make one to mimic your ex" passed through my head just long enough for me to recoil in absolute horror.)
yeah i was thinking to myself i could train an LLM on my wife's social media history because it's extensive. But i concluded one wife is enough.
Material for a meme. Next... Imagine a triple boss.
Re: Replacing my best friends with an LLM trained on 500k group chat messages
#184Great write up, thanks for posting. I’ve been thinking of doing this for myself. One thought that’s haunting: how long before AI friends are more interesting and stimulating than any real person would be, leading people to prefer AI over humans to befriend… Super stimulus to end all super stimuluses?
> One thought that’s haunting: how long before AI friends are more interesting and stimulating than any real person would be It can simultaneously pass the bar exam and port Java applications by name to POSIX compliant C. It can get into deep philosophical conversations, guide you through doing market analysis, etc. It can take you on a text based adventure set in your favorite nostalgic video game, take on the perso…
A few years back when it was less castrated, I indeed derived lots of enjoyment from conversing with it. I did it the oldskool way, creating a chat prompt and stopping at my turn to speak. Great fun. Normal humans are really quite limited. ChatGPT is a bit too woke for my taste and I can’t get it quite to my taste. Oh well..
Luckily I don’t have the type of personality that gets addicted easily because I think this could be an issue for people. (“You mean I can talk intelligently for hours about one scene in Star Wars without judgement or rolling eyes??”)
Re: Replacing my best friends with an LLM trained on 500k group chat messages
#185This is one of the best, most detailed write-ups of how to fine-train a large language model on custom text that I've seen anywhere.
I agree. I've been looking to train/fine-tune an LLM model myself but the corpus I want to provide is not in question/answer mode.
Is there a way to train or fine-tune an LLM model using say only plain text files?
Re: Replacing my best friends with an LLM trained on 500k group chat messages
#186Earlier quoted context omitted.
Would you not want her to move on, and be allowed the same privilege? This is unnatural and probably unhealthy.
It might actually be helpful in that process. Many people report talking to a loved one in a dream and getting to say something to them and that helped move on for example.
idk, an LLM of a deceased loved one would be the cruelest thing possible in my mind. If I imagine my wife passing away and then having an LLM trained to resembler her I could see myself coming back to it all the time. Knowing it's not her but just close enough to keep me coming back wishing it was sounds like misery forever.
Re: Replacing my best friends with an LLM trained on 500k group chat messages
#187Best thing I learned from this article is that Messages on Mac stores all your messages in a sqlite db. Pretty cool!
If you don’t have a Mac but have an iPhone, iOS does the same thing - if you back up to iTunes you can access the database file.
Re: Replacing my best friends with an LLM trained on 500k group chat messages
#188Re: Replacing my best friends with an LLM trained on 500k group chat messages
#189Asimov's "Solaria" comes to mind:
> Originally, there were about 20,000 people living in vast estates individually or as married couples. There were thousands of robots for every Solarian. Almost all of the work and manufacturing was conducted by robots.
In our particular universe, "thousands of robots" ended up being "thousands of chatbots", but still, eerily similar.
Re: Replacing my best friends with an LLM trained on 500k group chat messages
#190Earlier quoted context omitted.
I completely agree with you about them failing to be accurate for the various reasons you've explained (hallucinating, limited social conventions, etc). Unfortunately, I've heard enough people believe the hype that this is actually "synthesizing sentience into the machine" or some other buzz speak. I have met researchers of AI at credible universities who believe this kind of thing, completely oblivious to how ChatGP…
You seem to think intelligence is something more than data storage and retrieval and being able to successfully apply it to situations outside your training set. Even very small signs of that ability are worthy of celebration. Why do you feel the need to put it down so hard? Why the need to put down your father, to “enlighten” him? What is missing? Soul? Sentience?
I do think intelligence is something more than data storage and retrieval. I believe it is adaptive behavior thinking about what data I have, what I could obtain, and how to store/retrieve it. I could be wrong, but that's my hypothesis.
We humans don't simply use a fixed model, we're retraining ourselves rapidly thousands of times a day. On top of that, we seem to be perceiving the training, input, and responses as well. There is an awareness of what we're doing, saying, thinking, and reacting that differs from the way current AI produces an output. Whether that awareness is just a reasoning machine pretending to think based on pre-determined actions from our lower brain activity, I don't know, but it definitely seems significantly more complex than what is happening in current "AI" research.
I think you're also onto something, there is a lot of passive data store/retrieve happening in our perception. I think a better understanding of this is worthwhile. However, I have also been informed by folks who are attempting to model and recreate the biological neurons that we use for language processing. Their belief is that LLM and ChatGPT is quite possibly not even headed in the right direction. Does this make LLM viable long term? I don't know. Time will tell. It already seems to be popping up everywhere already, so it seems to have a business case even in its current state.
As for my father, I do not "put him down" as you say. I explained it to him, and I was completely respectful, answered his questions, provided sources and research upon request, etc. I am not rude to my father, I deeply respect him. When I say "painfully" I mean, it was quite painful seeing how ChatGPT so effectively tricked him into thinking it was intelligent. I worry because these "tricks" will be used by bad people against all of us. There is even an article about an AI voice tool being used to trick a mother into thinking scammers had kidnapped her daughter (it was on HackerNews earlier today).
That is what I mean by painful. Seeing that your loved ones can be confused and misled. I take no joy in putting down my father and I do not actively look to do so. I merely worry that he will become another data point of the aging populace that is duped by phone call scams and other trickery.
Edit: Another thing about my father, he hates being misled or feeling ignorant. It was painful because he clearly was excited and hopeful this was real AI. However, his want to always understand how things work removed much of that science fiction magic in the knowing.
He's very grateful I explained how it works. For me though, it's painful being the one he asks to find out about it. Going from "oh my goodness, this is intelligent" fade to "oh, it's just predicting text responses". ChatGPT became a tool, not a revelation of computing. Because, as it is, it is merely a useful tool. It is not "alive" so to speak.