Earlier quoted context omitted.
> Please write a function in JavaScript that takes in a string as input and returns true if it contains a valid roman numeral and false otherwise. Your question actually isn't worded concisely enough. You don't specify whether the string can merely contain the roman numeral (plus other, non-roman-numeral text), or must entirely consist of just the roman numeral. The way "if it contains" is used colloquially, could im…
I think that makes it a better test. An ideal model would recognize the ambiguity and either tell you what assumption it's making or ask a followup question.
Llama 2
441–450 of 860 posts
Re: Llama 2
#442Earlier quoted context omitted.
Dictionary definitions and language use in practice do not always overlap 100%. The true meaning of a word comes from its usage, not the dictionary.
The impact of this, I think is that the LLM is right, hippos do swim, because that's how people commonly describe what hippos do, such that it gets into the training set
Specifically I found these citations very helpful: https://news.ycombinator.com/item?id=36777376
So I think what we can say is that the average person would be wrong about hippos, because the hippo is not actually swimming but people do not realize that. We expect LLMs to behave more like an expert, so the standard is even higher and we should be more willing to say it is wrong.
Although the meaning of a word is defined by its usage, there are also common misconceptions that people have. It is not the case that every usage of a word is correct. Instead you would have to ask a variety of people what swimming is, and then describe to them what a hippo does (it does not float, it walks on the river bed), and then consider whether that fits with their conception of swimming.
I think what is happening here is that lots of people thought hippos swim, they have been corrected, and now they are feeling a bit defensive and trying to save face rather than say "huh that is interesting I did not know that hippos don't swim".
Re: Llama 2
#443Earlier quoted context omitted.
I asked it about cannibals. It said > I do not support or condone the practice of cannibalism, as it is harmful and exploitative towards the individuals who are consumed. Then it said that cannibals have inherent worth and dignity and that we should strive to appreciate what they do. Then it crashed and is now responding to all following inputs with just the letter "I"
I let it write some machine learning quote and tried to make it guess good hyperparameters, then it crashed and just kept repeating the word "Based".
Re: Llama 2
#444The very first question I asked it (an historical question, and not a trick question in any way) had an outright and obvious falsehood in the response:
(I also chose this question to see what degree of moralizing would be contained in the response, which luckily was none!)
Re: Llama 2
#445The benchmarks look amazing compared to other open source LLMs. Bravo Meta. Also allowing commercial use? Can be downloaded today? Available on Azure AI model catalog today? This is a very impressive release. However, if I were starting a company I would be a little worried about the Llama 2 Acceptable Use Policy. Some of the terms in there are a little vague and quite broad. They could, potentially, be weaponized in…
It's not even remotely open source
Re: Llama 2
#446Re: Llama 2
#447Earlier quoted context omitted.
Most, but not all things are strategic moves. Some moves are purely altruistic. Some moves are semi-altruistic - they don't harm the company, but help it increase its reputation or even just allows them to offer people ways to help in order to retain talent. (Which is also kind of strategic, but in a different way.) Also, some things are just mistakes and miscalculations.
>Some moves are purely altruistic. Like what?
Re: Llama 2
#448Key detail from release: > If, on the Llama 2 version release date, the monthly active users of the products or services made available by or for Licensee, or Licensee’s affiliates, is greater than 700 million monthly active users in the preceding calendar month, you must request a license from Meta, which Meta may grant to you in its sole discretion, and you are not authorized to exercise any of the rights under thi…
> Looks like they are trying to block out competitors But only existing competitors. If you don't yet have 700MM MAU, the impact of this is only that, after you reach 700MM MAU, you can't get future versions of the Llama models for free. You can still continue to use versions that were released before you reached that threshold. For reference, neither Instagram nor WhatsApp had 700MM MAU at the time Facebook decided…
Re: Llama 2
#449Earlier quoted context omitted.
Usually I don't like anti-competition clause like this, but the number seems to target only FANG level competitors. Maybe we should give it a good name and hopefully seeing OSS adopt this.
There are some minor restrictions in the license terms, probably making it OSS incompatible. One is using the model or its derivates to tune or train other models.
Re: Llama 2
#450Earlier quoted context omitted.
You're just being overly pedantic. They hold their breath, fully submerge, control their buoyancy, and propel themselves through water. Also known as swimming.
Nah, this is often not considered swimming in major publications and by zoos. National Geographic https://www.nationalgeographic.com/animals/mammals/facts/hip... > Hippos cannot swim or breathe underwater, and unlike most mammals they are so dense that they cannot float. Instead, they walk or run along the bottom of the riverbed. Because their eyes and nostrils are located on the top of their heads, they can still se…
GPT 3.5 (fails): https://flowch.ai/shared/90274999-8eaf-4046-9115-7f623264197...
GPT 4 (succeeds): https://flowch.ai/shared/73523ec6-4d1d-48a4-bb16-4e9cc01adf1...