Llama 2

Post by Tepix » Wed, Jul 19, 2023, 11:34 AM UTC

jug wrote: post #275

rajko_rad wrote: post #18

Hey HN, we've released tools that make it easy to test LLaMa 2 and add it to your own app! Model playground here: https://llama2.ai Hosted chat API here: https://replicate.com/a16z-infra/llama13b-v2-chat If you want to just play with the model, llama2.ai is a very easy way to do it. So far, we’ve found the performance is similar to GPT-3.5 with far fewer parameters, especially for creative tasks and interactions. Dev…

Still fails my hippo test! > Yes, hippos are excellent swimmers. They spend most of their time in the water, where they feed on aquatic plants and escape the heat of the savannah. In fact, hippos are one of the best swimmers among all land mammals. But that's fine. Most do. Hippos don't swim. They walk or hop/skip at best underwater.

Post by [deleted] » Wed, Jul 19, 2023, 11:35 AM UTC

andromaton wrote: post #647

They said 3.3MM hours at 350W to 400W. That's about $1.5MM in electricity.

Post by Tepix » Wed, Jul 19, 2023, 11:36 AM UTC

jeroen wrote: post #393

isoprophlex wrote: post #344

Earlier quoted context omitted.

Heh I have my own, the "french palindrome" test. > User: please reverse the following string: "élu par cette crapule". For example, "abc def" should become "fed cba". > Assistant: "par cette crapule elu" ChatGPT actually understands what I mean but still fails sometimes, outputting things like it's having a stroke, "eluu elule par cettep raprap"

I asked it "How do you reverse a string?" > To reverse a string, I use the built-in "reverse" function in Python. It takes a string as input and returns the string with all the characters in reverse order. For example, the input string "hello" would become "lohel" when reversed. We're not quite there yet.

Post by dTal » Wed, Jul 19, 2023, 11:51 AM UTC

Jaygles wrote: post #285

jug wrote: post #275

Earlier quoted context omitted.

Still fails my hippo test! > Yes, hippos are excellent swimmers. They spend most of their time in the water, where they feed on aquatic plants and escape the heat of the savannah. In fact, hippos are one of the best swimmers among all land mammals. But that's fine. Most do. Hippos don't swim. They walk or hop/skip at best underwater.

Google says that swimming is "the sport or activity of propelling oneself through water using the limbs". It doesn't constrain the propulsion to only be between the limbs and the water. Seems like pushing against the ground to move through the water fits the definition

Post by baobabKoodaa » Wed, Jul 19, 2023, 12:27 PM UTC

mafuy wrote: post #806

baobabKoodaa wrote: post #770

Earlier quoted context omitted.

You can evaluate a version of the model that has been trained on one set of data, and ship to production a different model that has been trained on the complete set of data. In many cases one can reasonably infer that the model which has seen all of the data will be better than the model which has seen only some of the data. I'm not claiming that's what happened here, nor am I interested in nitpicking "what counts as…

This is possible if you use e.g. train 1000 models on different subsets of data and verify that each and every one of them is performing well. In that case, you can reasonably infer that another model trained on all data would work well, too. But this is, of course, 1000 times more expensive to do. And if you only train 100, or 10, or 1 model, then the deduction becomes increasingly unstable. So from a practical poin…