Live data from Hacker News

Show HN: WhatsApp-Llama: A clone of yourself from your WhatsApp conversations

github.com

41–50 of 54 posts

Re: Show HN: WhatsApp-Llama: A clone of yourself from your WhatsApp conversations

#41

Good work. But, how is this useful other than for deception and trickery beside the fun aspect of it all? Maybe im lacking imagination and perhaps this type of progress in mimicking human interaction will actually push more and more people back to the IRL world of person to person communication.

Oh I think it could have all sorts of use cases. For example:

Let's say you need to buy a gift for a friend. If your LLM assistant is trained on all the WhatsApp chats you've had with that friend, it would understand your relationship well and would be able to recommend something accordingly

Or it could also just speed up the time taken to reply to messages by suggesting responses and therefore having you type less

Re: Show HN: WhatsApp-Llama: A clone of yourself from your WhatsApp conversations

#42
post #37

I'd love to try this but my GPU is potato. Does anyone know a convenient way to access the kind of GPUs required for this? Should I just pay for Google Colab?

You get $300 credits on GCP when you sign up with a new google account. You can then request for a GPU, they approve quota increase requests immediately

Its very easy to connect your colab notebook to a GCP machine

Re: Show HN: WhatsApp-Llama: A clone of yourself from your WhatsApp conversations

#44

Llama 7B is quite dumb. Using the 13B you'd get significantly better results, and you can train a qlora on a single 3090 (I think even less is possible but not sure)

oh yeah definitely. Do you know how I can get access to one for cheap though? I burnt through $150 just on this exercise with a P100 on GCP

I'd love to see an update for 13B, and I can vouch that vast.ai prices are very good.

Re: Show HN: WhatsApp-Llama: A clone of yourself from your WhatsApp conversations

#45

Good work. But, how is this useful other than for deception and trickery beside the fun aspect of it all? Maybe im lacking imagination and perhaps this type of progress in mimicking human interaction will actually push more and more people back to the IRL world of person to person communication.

I find that Google Workspace saves time in predicting the end of sentences, a subject for a finished email, and informal/formal endings in the language my email is in. I'm sure more personalized predictions would be even better because I'd agree with them more frequently.

Re: Show HN: WhatsApp-Llama: A clone of yourself from your WhatsApp conversations

#46

Llama 7B is quite dumb. Using the 13B you'd get significantly better results, and you can train a qlora on a single 3090 (I think even less is possible but not sure)

oh yeah definitely. Do you know how I can get access to one for cheap though? I burnt through $150 just on this exercise with a P100 on GCP

Ooof. I'd expect this to cost like 5 bucks on runpod using a single 3090.

I use axolotl for training, I didn't check your notebook but axolotl likely comes with more optimized defaults for speed and vram than what you're doing.

Re: Show HN: WhatsApp-Llama: A clone of yourself from your WhatsApp conversations

#47
post #27

I wonder if my clone will also respond 3 days later as if nothing happened

You are being very generous. Unless for dire needs, a weekly replies to Text/WhatsApp is a good frequency to keep/advance world peace.

Re: Show HN: WhatsApp-Llama: A clone of yourself from your WhatsApp conversations

#48
post #5

You said that the model fooled your friends 10% of the time. I wonder how well would chatGPT | llama2 do given just the last 5 messages of each and asking to generate the next reply pre tending to be you… Somehow I don’t think it would be worse?

> You said that the model fooled your friends 10% of the time.

I am imaging some nerds actively changing their real behaviour to become closer to ChatGPT so that others will more likely believe it when they take a break and handover their work/comms to AI tools :)

Re: Show HN: WhatsApp-Llama: A clone of yourself from your WhatsApp conversations

#49
post #12

A few years ago I did the same thing with GPT-2 on my friend and I's WhatsApp conversation history. So it would simulate conversations between us. The result was hilarious yet at times uncomfortably accurate... like looking into a mirror...

wow thats cool! Do you have the code put out somewhere?

Code for fine-tuning davinci (GPT-3): https://github.com/rchikhi/GPT-is-you

Re: Show HN: WhatsApp-Llama: A clone of yourself from your WhatsApp conversations

#50

Nice! I did something similar with GPT 3.5 and slack https://rosslazer.com/posts/fine-tuning/

Very cool. I like the introspection bit, I've realised quite a bit about my texting style from talking to Llama too. I think Im also very "type first and think later" on WhatsApp

Now you can edit messages up to 15 minutes after sending! At least one can on an iPhone 14.
Post reply on HN