Live data from Hacker News

State-of-the-art open-source chatbot, Vicuna-13B, just released model weights

twitter.com

91–100 of 143 posts

Re: State-of-the-art open-source chatbot, Vicuna-13B, just released model weights

#91
post #67

Earlier quoted context omitted.

That can't be his work, since he only picked up that hobby about 0.000625% of the universe's timespan ago.

For many humans, some "hobbies" involve "projects" which may involve seemingly infinite degrees of procrastination. (This certainly applies to me!)

You're not wrong - but for perspective this is equivalent to a 90 year old picking up a hobby 5 hours ago.

Re: State-of-the-art open-source chatbot, Vicuna-13B, just released model weights

#92
I have a universal benchmark for judging how much knowledge a language model stores, and it's asking about the G-FOLD paper (https://www.lpi.usra.edu/meetings/marsconcepts2012/pdf/4193....), because I noticed GPT-3.5 hallucinates when asked about it, whereas GPT-4 is capable of providing a high-level overview.

Re: State-of-the-art open-source chatbot, Vicuna-13B, just released model weights

#93
post #76

This looks really good for a run-it-on-your-own-hardware model from the examples and sibling comments. I've been working on a pure AVX2 Rust implementation of LLaMA but was starting to lose interest and been waiting for whatever is the next hot downloadable model, but now I want to add this thing to it. I'll be busy next few days. Heck yeah.

Are you the GGML dev?

No, my project is called rllama. No relation to GGML. https://github.com/Noeda/rllama

Re: State-of-the-art open-source chatbot, Vicuna-13B, just released model weights

#94
post #91

Earlier quoted context omitted.

For many humans, some "hobbies" involve "projects" which may involve seemingly infinite degrees of procrastination. (This certainly applies to me!)

You're not wrong - but for perspective this is equivalent to a 90 year old picking up a hobby 5 hours ago.

Gotta do something in your old age. Better than crossword puzzles, I'll bet.

Re: State-of-the-art open-source chatbot, Vicuna-13B, just released model weights

#95
One of my favorite queries to assess an LLM is Is it legal for a man to marry his widow's sister?

Vicuna-13B: The legality of a man marrying his widow's sister (widow marriage) varies depending on the country and cultural context. In some societies, widow marriage was traditionally practiced or tolerated.

GPT-4: It is not possible for a man to marry his widow's sister, as the term "widow" refers to a deceased man's wife. Therefore, if a man has a widow, he is deceased and therefore cannot marry anyone.

Re: State-of-the-art open-source chatbot, Vicuna-13B, just released model weights

#97
post #49

Nice. You need a 28GB GPU, so it's not exactly something people can run on their laptop. Everybody's server costs are about to go the roof.

Wouldnt it be time for a somewhat older gpu with a lot of memory. Or is that hard to achieve?

There's AMD Instinct series, MI50 (32GB) goes for under a 1000 EUR where I live.

Re: State-of-the-art open-source chatbot, Vicuna-13B, just released model weights

#98

Earlier quoted context omitted.

Not a lawyer, but that still feels like dubious territory. I would still be on the hook for acquiring the original download, which Facebook has been launching dmca takedown requests for the llama-dl project.

(I work on llama-dl.) We’re fighting back against the DMCA requests on the basis that NN weights aren’t copyrightable. This thread has details: https://news.ycombinator.com/item?id=35393782 I don't think you have to worry about Facebook going after you. The worst that will happen is that they issue a DMCA, in which case your project gets knocked offline. I don’t think they’ll be going the RIAA route of suing individu…

If NN weights aren't protected by IP law that could slow down progress quite a lot. That could be very good for people worried about alignment.

Re: State-of-the-art open-source chatbot, Vicuna-13B, just released model weights

#99
post #41

Earlier quoted context omitted.

You can use this command to apply the delta weights. ( https://github.com/lm-sys/FastChat#vicuna-13b ) The delta weights are hosted on huggingface and will be automatically downloaded.

I did try, but got: ``` ValueError: Tokenizer class LLaMATokenizer does not exist or is not currently imported. ```

Just rename it in the tokenconfig.json
Post reply on HN