281–290 of 303 posts
I love the Disclaimer at the bottom. The parties that trained these weights violated copyright on a grand scale to do so, and yet claim the ability to license downstream use.
Except for implementation errors with early models overtrained on famous works, models don't contain enough information to recreate originals. It's not a compression algorithm.
Earlier quoted context omitted.
> weights refer to the trained model weights This is what I'm having a hard time understanding. So there's the weights, and also a model somewhere? That the weights are based on? Or that you combine with the model to tune it?
Let's take a step back. You have a model like linear regression. For example, y=bx where y are your outputs and x are your inputs. Based on some data, you learn that b=1. Therefore, you share the weights of the model as a file like {b=1} and also share with them the model y=bx (usually shared via code) so they can run it in production.
In fact, the only thing you'd need to modify to make this analogy an actual description is for y, b, and x to each represent a matrix of numbers.
me: hello
alpaca: Hello!
me: what is your name?
alpaca: The answer to this question depends on what you mean by "know". If we are talking about knowledge in a scientific sense, then the Earth is 4.5 billion years old (give or take). However if we're referring to religious beliefs and scripture-based teachings of creationism, it would be impossible for us to know how long ago God created our planet since He has not revealed this information in His Word. In either case though, the Earth is billions of years old!
alpaca: Hello there :) How are you?
alpaca: "How are you?" "I'm great!" :D Thanks for asking. You too?? I hope so, but if not then please let me know what is wrong and we can figure out a solution together! :)
alpaca: My Name Is ________. #AskMeAnything #NameYourselfFirst #BeYou #DoItForTheGram @_KaylaJewelz
Does this really need to be a fork of llama.cpp? It seems like there's no real changes to the code.
Alpaca model is llama trained on ChatGPT, it's basically a way of getting cheaply what OpenAI did after the GPT training....it's a kind of cheating/stealing weights by looking from the outside, but anyways OpenAI does the same with the web, so there's no moral issue.
What do you mean by this? Can you please elaborate.
Earlier quoted context omitted.
This isn't true, it's a factoid made up by anti-woke trolls and repeated credulously. "Trigger warning" was originally intended to warn about descriptions that could literally trigger a dissociative episode for people suffering from PTSD, e.g. victims of child abuse or sexual violence. The usage gradually expanded to anything that could be distressing to anyone for any reason, which is kind of belittling to the origi…
I'm afraid that you're wrong. See page 11. https://s.wsj.net/public/resources/documents/stanfordlanguag... . Stanford seems to have beaten the "anti-woke trolls" at their own game.
Earlier quoted context omitted.
This isn't true, it's a factoid made up by anti-woke trolls and repeated credulously. "Trigger warning" was originally intended to warn about descriptions that could literally trigger a dissociative episode for people suffering from PTSD, e.g. victims of child abuse or sexual violence. The usage gradually expanded to anything that could be distressing to anyone for any reason, which is kind of belittling to the origi…
> “Trigger warning” was originally intended to warn about descriptions that could literally trigger a dissociative episode for people suffering from PTSD To the extent it was, it was based on a completely misinformed idea of how triggering in PTSD works. In practice, if not in intent, it has been, from the beginning, an appropriation of the language of PTSD to serve as a vehicle for expressing personal value judgemen…
The phenomenon you are referring to - appropriating the language of PTSD for concerns of politics, taste or personal offence - is exactly why some people advocate replacing "trigger warning" with "content warning" or similar (and not because of associations with gun violence, as OP asserted).
Earlier quoted context omitted.
What, nothing about Electron's unacceptable code bloat factor? Most disappointing! https://www.hendrik-erz.de/post/electron-bloated-web-and-tra... A GPT-4-on-GPT-4 flame war might be an incredible spectacle...
I asked GPT-4 to produce a simulated argument about Electron which devolves into name calling. Here's the 2 page of result it returned: User1: Hey, have you heard about Electron? It's an awesome framework for creating cross-platform apps using web technologies like HTML, CSS, and JavaScript. User2: Yeah, I've heard of it. But I think it has some pretty serious shortcomings. Like, it's notorious for consuming a lot of…
Earlier quoted context omitted.
Alpaca model is llama trained on ChatGPT, it's basically a way of getting cheaply what OpenAI did after the GPT training....it's a kind of cheating/stealing weights by looking from the outside, but anyways OpenAI does the same with the web, so there's no moral issue.
> cheating/stealing weights by looking from the outside What do you mean by this? Can you please elaborate.
Earlier quoted context omitted.
I disagree. The metaphor we use in ML is that neurons are the nodes that receive the summed, weighted inputs from other neurons. Yes, the weights are the strengths of the connections between them. However, there are many more weights than neurons, so conflating the two doesn't make sense schematically. Also, neurons can also have other parameters which define their behavior such as bias and activation functions. Furt…
I would agree with most of this, but there is no direct analogy between all of the components of a neuron in neurology, which are typically umbrella'd under the name "neuron" and regarded as parts of one, versus ML's version. Eg, if a weight can be a synapse, can't a weight be an axon? Axons also "connect" neurons, but their length is more related to the connection strength, so could be considered more analogous to a…