[deleted]
Show HN: ChatLLaMA – A ChatGPT style chatbot for Facebook's LLaMA
181–190 of 226 posts
Re: Show HN: ChatLLaMA – A ChatGPT style chatbot for Facebook's LLaMA
#182Me: what is a symbol table used for in a compiler ? ChatLLaMa: A symbol table is a data structure used by compilers to keep track of variables, functions, and other identifiers. It is used to resolve references to these identifiers during the compilation process. Me: what information should be stored in the symbol table ? ChatLLaMa: The symbol table should store the names of variables, functions, and classes, as well…
Yeah, I mention this in the post but this variant of LLaMA isn't storing any of the conversation in memory so it doesn't have context on the prior questions. You're starting fresh with each prompt. We have some ideas for how to improve this though... more soon :)
ah, ok - thanks!
Re: Show HN: ChatLLaMA – A ChatGPT style chatbot for Facebook's LLaMA
#183Earlier quoted context omitted.
Of course you now must ask it > How long is a piece of string, when the string is 4Kim long? ...or even just Km. I can't, as it's being slashdotted
Does it even differentiate between lowercase and uppercase letters? Results for me were: > How long is a piece of string, when the string is 4km long? 4096 meters. > How long is a piece of string, when the string is 4Kim long? 4Kim > How long is a piece of string, when the string is 4Km long? 4096 meters. after that I got the "Something went wrong, please try again." error.
When it comes to tokenization, yeah, it does differentiate. But its training set is certain to have many examples of different capitalizations and misspellings, so it can understand them, too. Which is usually what you want...
GPT-4 really takes this to eleven. For example, it can correctly parse and process this request: "Tll m shrt str bt ncrns; 10 sntncs. Wrt t l vwls prprl."
Re: Show HN: ChatLLaMA – A ChatGPT style chatbot for Facebook's LLaMA
#184Their 7b model performs much better than the 13b model I have running locally with alpaca.cpp. I think this is because (looking at their code) they stick with the float16 parameters while alpaca.cpp is using the quantizized 4bit parameters. The difference is quite noticeable.
Why do you believe the difference is due to quantization rather than all the fine-tuning that they did? Given the difference between GPT-3 and GPT-3.5 - pretty much all of which is fine-tuning and RLHF - I find it much easier to believe in the latter.
Re: Show HN: ChatLLaMA – A ChatGPT style chatbot for Facebook's LLaMA
#185Earlier quoted context omitted.
It’s not a commercial product.
It’s unclear if Baseten is paying for this to be hosted, though two of their employees launched this. Baseten is a serverless backend for building ML-powered applications. Possible Facebook might argue by using the software to drive traffic to their commercial services, it is commercial use — especially if there were internal messages stating this was their intent.
I’m sure they want the test case on if model weights are subject to copyright to be two employees doing something in their free time and giving it away.
Re: Show HN: ChatLLaMA – A ChatGPT style chatbot for Facebook's LLaMA
#186Coming soon: HN_LLaMA. Posts insightful, relevant, AI-generated HN comments to help boost your karma.
Jokes aside, has anyone tried fine tuning a model on forum conversations?
By which I mean, for chatbots, the data for fine-tuning basically presents it with examples of dialogs. But if you take any given comment on HN and walk its parents, you basically end up with something like that, except there's more than two people involved (usually). So what if you fed that to LLaMA, and then used the same format for the actual chat?
Re: Show HN: ChatLLaMA – A ChatGPT style chatbot for Facebook's LLaMA
#187Earlier quoted context omitted.
For this demo, we're using the 8bit version here: https://huggingface.co/tloen/alpaca-lora-7b We also fine-tuned and OSS'd a 30b version here that you can checkout (on the cleaned 52k Alpaca dataset) https://huggingface.co/baseten/alpaca-30b
did you use the cleaned and improved alpaca dataset from https://github.com/tloen/alpaca-lora/issues/28 ?
Yes, we did! The dataset has since been cleaned even more so we're due to update the model.
Re: Show HN: ChatLLaMA – A ChatGPT style chatbot for Facebook's LLaMA
#188Earlier quoted context omitted.
Have a link? I haven't seen any finetuning scripts in the wild that train a PEFT model on a multrigpu setup yet and would love to play around with one.
The original Alpaca repo has the training script. The readme has the torchrun command and arguments used for train.py. https://github.com/tatsu-lab/stanford_alpaca/blob/main/train...
Awesome, thank you!
Re: Show HN: ChatLLaMA – A ChatGPT style chatbot for Facebook's LLaMA
#189Me: Is LLaMA as good as ChatGPT? LLaMa: No, LLaMA is not as good as ChatGPT. ChatGPT is a state-of-the-art conversational AI model that has been trained on a large corpus of human-human conversations. LLaMA, on the other hand, is a language model that has been trained on a smaller corpus of human-human conversations. Me: So you were looking at people chatting in Facebook? LLaMa: Yes, I was. Me: That means Facebook is…
That doesn’t make it true. LLMs don’t know how they were trained. It’s just making that story up.
It may be true, but the fact that the model said that is meaningless.
Re: Show HN: ChatLLaMA – A ChatGPT style chatbot for Facebook's LLaMA
#190Rap battle between ChatGPT and ChatLLaMA (made by copy/pasting responses from one to the other). Note that ChatLLaMA manages to confuse ChatGPT about who is who. == ChatLLaMA: I'm gonna drop some rhymes that'll blow your mind. I'm gonna show you what I'm made of. (note: it repeats "I'm gonna show you what I'm made of." dozens of times but I edited those out). === ChatGPT: Alright ChatLLaMA, I'm down for this rap batt…
Did ChatLLaMA just echo back what ChatGPT spit out? That's not particularly promising
and then ChatGPT showed ChatLLaMA how it should have responded by roasting itself from LLaMA's perspective?
Now that's an alpha LLM flex.