21–30 of 54 posts
Llama 7B is quite dumb. Using the 13B you'd get significantly better results, and you can train a qlora on a single 3090 (I think even less is possible but not sure)
> The concept's appeared in fiction numerous times (the talking paintings in Harry Potter that mimic the person painted, the clones in The Prestige) How is your most notable example not when Gilfoyle does exactly this so he doesn’t have to talk to Dinesh in Silicon Valley??
You said that the model fooled your friends 10% of the time. I wonder how well would chatGPT | llama2 do given just the last 5 messages of each and asking to generate the next reply pre tending to be you… Somehow I don’t think it would be worse?
Super cool! I had a similar idea where I wanted to create such clones of some of my friends (with consent ofc) and see how well they know me. To extend your clone even more, you can also throw in every piece of digital text you have into this, eg. emails, notes, essays, blogs etc. I'm super down to work on LLM clones like these! edit: I actually started a little work on this. If you wanna export more messages than th…
Yeah, this can be extended to create a "simulation game" of us and our friends. This paper (Interactive Simulacra of Human Behaviour https://arxiv.org/abs/2304.03442 ) has a setup on how we could create a Sims game with us as the characters
Awesome work, I've had the idea for a while of setting up a pipeline like this that could take input from all available sources of the person to clone their voice and image as well as dialogue. The intent being to create digital avatars of lost loved ones to help people with the grieving process. I know that there would be tremendous opportunity in such tech for malicious actors to do serious harm, but the stated goa…
Good idea! I expect there will be profitable businesses based on training LLMs to simulate eminent people & celebrities – on both their public utterances and their private correspondence – then charging for access to the best models.
A few years ago I did the same thing with GPT-2 on my friend and I's WhatsApp conversation history. So it would simulate conversations between us. The result was hilarious yet at times uncomfortably accurate... like looking into a mirror...
This is cool, although I’m guessing you need to input your conversation history manually? Or is there a way to export it from WhatsApp?
Nice! I did something similar with GPT 3.5 and slack https://rosslazer.com/posts/fine-tuning/