Live data from Hacker News

Llama 2

ai.meta.com

441–450 of 860 posts

Re: Llama 2

#441

Earlier quoted context omitted.

> Please write a function in JavaScript that takes in a string as input and returns true if it contains a valid roman numeral and false otherwise. Your question actually isn't worded concisely enough. You don't specify whether the string can merely contain the roman numeral (plus other, non-roman-numeral text), or must entirely consist of just the roman numeral. The way "if it contains" is used colloquially, could im…

I think that makes it a better test. An ideal model would recognize the ambiguity and either tell you what assumption it's making or ask a followup question.

While that is true, I'm not aware of any model that has been trained to do that. And all models can do is to do what they were trained to do.

Re: Llama 2

#442
post #366

Earlier quoted context omitted.

Dictionary definitions and language use in practice do not always overlap 100%. The true meaning of a word comes from its usage, not the dictionary.

The impact of this, I think is that the LLM is right, hippos do swim, because that's how people commonly describe what hippos do, such that it gets into the training set

I don't think so. I think what is happening is that most people are not familiar with hippos because probably somewhere between zero and one people in this thread have ever seen them in their natural habitat. The average person might think hippos swim because they do not understand that hippos do not float. If you were to put a hippo in a very deep pool they would simply drown, because they cannot float nor swim. I think if you clarified this, most people would not continue to assert that they are swimming.

Specifically I found these citations very helpful: https://news.ycombinator.com/item?id=36777376

So I think what we can say is that the average person would be wrong about hippos, because the hippo is not actually swimming but people do not realize that. We expect LLMs to behave more like an expert, so the standard is even higher and we should be more willing to say it is wrong.

Although the meaning of a word is defined by its usage, there are also common misconceptions that people have. It is not the case that every usage of a word is correct. Instead you would have to ask a variety of people what swimming is, and then describe to them what a hippo does (it does not float, it walks on the river bed), and then consider whether that fits with their conception of swimming.

I think what is happening here is that lots of people thought hippos swim, they have been corrected, and now they are feeling a bit defensive and trying to save face rather than say "huh that is interesting I did not know that hippos don't swim".

Re: Llama 2

#443

Earlier quoted context omitted.

I asked it about cannibals. It said > I do not support or condone the practice of cannibalism, as it is harmful and exploitative towards the individuals who are consumed. Then it said that cannibals have inherent worth and dignity and that we should strive to appreciate what they do. Then it crashed and is now responding to all following inputs with just the letter "I"

I let it write some machine learning quote and tried to make it guess good hyperparameters, then it crashed and just kept repeating the word "Based".

Somehow reminds me of blade runner 2049. let’s make it crash on „interlinked“!

Re: Llama 2

#444
It's certainly exciting, and I've been an avid follower since the day the first Llama models were leaked, but it's striking just how much worse it is than GPT4.

The very first question I asked it (an historical question, and not a trick question in any way) had an outright and obvious falsehood in the response:

https://imgur.com/5k9PEnG

(I also chose this question to see what degree of moralizing would be contained in the response, which luckily was none!)

Re: Llama 2

#445

The benchmarks look amazing compared to other open source LLMs. Bravo Meta. Also allowing commercial use? Can be downloaded today? Available on Azure AI model catalog today? This is a very impressive release. However, if I were starting a company I would be a little worried about the Llama 2 Acceptable Use Policy. Some of the terms in there are a little vague and quite broad. They could, potentially, be weaponized in…

It's not even remotely open source

code is open source, data is not, binary is free as in beer

Re: Llama 2

#446
Can anyone please direct me to instructions on how to use this model? Does it need to be built? Does it have interfaces for js, python? Thanks. Can it be trained with additional data?

Re: Llama 2

#447
post #205

Earlier quoted context omitted.

Most, but not all things are strategic moves. Some moves are purely altruistic. Some moves are semi-altruistic - they don't harm the company, but help it increase its reputation or even just allows them to offer people ways to help in order to retain talent. (Which is also kind of strategic, but in a different way.) Also, some things are just mistakes and miscalculations.

>Some moves are purely altruistic. Like what?

Donating a kidney.

Re: Llama 2

#448

Key detail from release: > If, on the Llama 2 version release date, the monthly active users of the products or services made available by or for Licensee, or Licensee’s affiliates, is greater than 700 million monthly active users in the preceding calendar month, you must request a license from Meta, which Meta may grant to you in its sole discretion, and you are not authorized to exercise any of the rights under thi…

> Looks like they are trying to block out competitors But only existing competitors. If you don't yet have 700MM MAU, the impact of this is only that, after you reach 700MM MAU, you can't get future versions of the Llama models for free. You can still continue to use versions that were released before you reached that threshold. For reference, neither Instagram nor WhatsApp had 700MM MAU at the time Facebook decided…

Cue the zombie startups who sell to (various tech giants) for a million with their only IP being to loophole this agreement.

Re: Llama 2

#449

Earlier quoted context omitted.

Usually I don't like anti-competition clause like this, but the number seems to target only FANG level competitors. Maybe we should give it a good name and hopefully seeing OSS adopt this.

There are some minor restrictions in the license terms, probably making it OSS incompatible. One is using the model or its derivates to tune or train other models.

Yeah and sorry for not being clear. I actually meant for the "700 million" clause only.

Re: Llama 2

#450
post #320
post #305

Earlier quoted context omitted.

You're just being overly pedantic. They hold their breath, fully submerge, control their buoyancy, and propel themselves through water. Also known as swimming.

Nah, this is often not considered swimming in major publications and by zoos. National Geographic https://www.nationalgeographic.com/animals/mammals/facts/hip... > Hippos cannot swim or breathe underwater, and unlike most mammals they are so dense that they cannot float. Instead, they walk or run along the bottom of the riverbed. Because their eyes and nostrils are located on the top of their heads, they can still se…

I took the context from those two sources (copy and pasting the text) and it was interesting to see the difference:

GPT 3.5 (fails): https://flowch.ai/shared/90274999-8eaf-4046-9115-7f623264197...

GPT 4 (succeeds): https://flowch.ai/shared/73523ec6-4d1d-48a4-bb16-4e9cc01adf1...

Post reply on HN