81–90 of 143 posts
Earlier quoted context omitted.
It's in the name of the model - "Vicuna-13B" implies there are 13 billion parameters.
the way these LLMs work, there is a weight for each parameter? 13 billion weights? what is an example of a parameter?
Earlier quoted context omitted.
Essentially a computer neural network is just a lot of addition (and matrix multiplication) of floating point numbers. The parameters are the "strength" or "weights" of the connections between neurons on different layers and the "bias" of each neuron. If neuron Alice is connected to neuron Bob and Alice has a value of 0.7, and the weight of Alice's connection to bob is 0.5, then the value sent from Alice to Bob is 0.…
Why would a 4bit quantized model be less accurate than a 16?
Earlier quoted context omitted.
Lemme save whoever is donating the legal here the time: model weights are definitely copyrightable.
> model weights are definitely copyrightable. on what legal theory or precedence makes this true? IMHO, the weights are akin to the list of telephone numbers in a directory - which is definitely not copyrightable; only the layouts and expressive portion of a phone directory is copyrightable. So to make the weights copyrightable, it needs to be argued that the 'layout' of the weight is a creative expression, rather th…
Recipes, famously, are almost but not quite copyrightable | patentable.
eg:
https://copyrightalliance.org/are-recipes-cookbooks-protecte...
https://etheringtons.com.au/are-recipes-protected-by-copyrig...
Earlier quoted context omitted.
It's in the name of the model - "Vicuna-13B" implies there are 13 billion parameters.
the way these LLMs work, there is a weight for each parameter? 13 billion weights? what is an example of a parameter?
so is a bias, and presumably the biases are also in the same file with the weights
Earlier quoted context omitted.
(I work on llama-dl.) We’re fighting back against the DMCA requests on the basis that NN weights aren’t copyrightable. This thread has details: https://news.ycombinator.com/item?id=35393782 I don't think you have to worry about Facebook going after you. The worst that will happen is that they issue a DMCA, in which case your project gets knocked offline. I don’t think they’ll be going the RIAA route of suing individu…
If they aren't copyrightable, couldn't they still be classes as a trade secret and still fall under IP law? Though I'm not sure if distributing the weights to people who sign a simple agreement to not redistribute would count as taking reasonable precautions in maintaining secrecy.
Is there some single page that keeps a running status of the various LLVM's and the software to make them runnable on consumer hardware?
This looks really good for a run-it-on-your-own-hardware model from the examples and sibling comments. I've been working on a pure AVX2 Rust implementation of LLaMA but was starting to lose interest and been waiting for whatever is the next hot downloadable model, but now I want to add this thing to it. I'll be busy next few days. Heck yeah.