31–40 of 54 posts
Good idea! I expect there will be profitable businesses based on training LLMs to simulate eminent people & celebrities – on both their public utterances and their private correspondence – then charging for access to the best models.
I remember that the photos in the newspaper moving mimic the person.
But I thought the talking paintings were ghosts living in the paintings or something.
This is cool, although I’m guessing you need to input your conversation history manually? Or is there a way to export it from WhatsApp?
A few years ago I did the same thing with GPT-2 on my friend and I's WhatsApp conversation history. So it would simulate conversations between us. The result was hilarious yet at times uncomfortably accurate... like looking into a mirror...
wow thats cool! Do you have the code put out somewhere?
There was some post-processing needed to get it in this format:
Alice: blah
John: blah blah
---
For finetuning GPT-2 I think we used this thing. I ran it on Google Colab. My friend ran it on his GPU, it should be doable on most modern-ish GPUs.
https://github.com/minimaxir/gpt-2-simple
I tried doing something with this a few months ago though and it was a bit of a hassle to get running (needed to use a specific python version for some dependencies...), I forget the details sorry!
Llama 7B is quite dumb. Using the 13B you'd get significantly better results, and you can train a qlora on a single 3090 (I think even less is possible but not sure)
oh yeah definitely. Do you know how I can get access to one for cheap though? I burnt through $150 just on this exercise with a P100 on GCP
Yeah, GCP GPU prices are terrible. $150 for a short time on a P100 is highway robbery.
TPUs are better, but still kinda pricey.
Does anyone know a convenient way to access the kind of GPUs required for this?
Should I just pay for Google Colab?
> The concept's appeared in fiction numerous times (the talking paintings in Harry Potter that mimic the person painted, the clones in The Prestige) How is your most notable example not when Gilfoyle does exactly this so he doesn’t have to talk to Dinesh in Silicon Valley??
> The concept's appeared in fiction numerous times (the talking paintings in Harry Potter that mimic the person painted, the clones in The Prestige) How is your most notable example not when Gilfoyle does exactly this so he doesn’t have to talk to Dinesh in Silicon Valley??
Hahaha a friend told me this but I havent watched SV. Will do so immediately