Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Llama 2

ai.meta.com

Post reply on HN
Print view View original

301–310 of 860 posts

Re: Llama 2

#301

Post by minhazm »

gauravphoenix wrote: post #10

Why doesn't FB create an API around their model and launch OpenAPI competitor? It is not like they don't have resources, and the learnings (I am referring to actual learning from users' prompts) will improve their models over time.

They're going to license it to cloud providers and make money from that. This lets them avoid all the other headaches associated with becoming a cloud services provider while still getting some income to pay for this work.

https://blogs.microsoft.com/blog/2023/07/18/microsoft-and-me...

Re: Llama 2

#302

Post by blululu »

refulgentis wrote: post #53
rajko_rad wrote: post #18

Hey HN, we've released tools that make it easy to test LLaMa 2 and add it to your own app! Model playground here: https://llama2.ai Hosted chat API here: https://replicate.com/a16z-infra/llama13b-v2-chat If you want to just play with the model, llama2.ai is a very easy way to do it. So far, we’ve found the performance is similar to GPT-3.5 with far fewer parameters, especially for creative tasks and interactions. Dev…

Seeing a16z w/early access, enough to build multiple tools in advance, is a very unpleasant reminder of insularity and self-dealing of SV elites. My greatest hope for AI is no one falls for this kind of stuff the way we did for mobile.

Asking someone to beta test your product is more like asking them for a favor than the other way around. Finding a sympathetic person to try out your stuff and provide intelligent, relevant feedback in a timely fashion is not that easy.

Re: Llama 2

#304

Post by gpm »

jug wrote: post #275
rajko_rad wrote: post #18

Hey HN, we've released tools that make it easy to test LLaMa 2 and add it to your own app! Model playground here: https://llama2.ai Hosted chat API here: https://replicate.com/a16z-infra/llama13b-v2-chat If you want to just play with the model, llama2.ai is a very easy way to do it. So far, we’ve found the performance is similar to GPT-3.5 with far fewer parameters, especially for creative tasks and interactions. Dev…

Still fails my hippo test! > Yes, hippos are excellent swimmers. They spend most of their time in the water, where they feed on aquatic plants and escape the heat of the savannah. In fact, hippos are one of the best swimmers among all land mammals. But that's fine. Most do. Hippos don't swim. They walk or hop/skip at best underwater.

This test seems to be testing the ability of it to accurately convey fine details about the world.

If that's what you're looking for it's a useful test, but if you're looking for a language model and not a general knowledge model I'm not sure it's super relevant. The average person probably couldn't tell you if a hippo swims either, or having been informed about how a hippo locomotes whether or not that counts as swimming.

Re: Llama 2

#305

Post by mike_d »

jug wrote: post #275
rajko_rad wrote: post #18

Hey HN, we've released tools that make it easy to test LLaMa 2 and add it to your own app! Model playground here: https://llama2.ai Hosted chat API here: https://replicate.com/a16z-infra/llama13b-v2-chat If you want to just play with the model, llama2.ai is a very easy way to do it. So far, we’ve found the performance is similar to GPT-3.5 with far fewer parameters, especially for creative tasks and interactions. Dev…

Still fails my hippo test! > Yes, hippos are excellent swimmers. They spend most of their time in the water, where they feed on aquatic plants and escape the heat of the savannah. In fact, hippos are one of the best swimmers among all land mammals. But that's fine. Most do. Hippos don't swim. They walk or hop/skip at best underwater.

You're just being overly pedantic. They hold their breath, fully submerge, control their buoyancy, and propel themselves through water. Also known as swimming.

Re: Llama 2

#306

Post by amelius »

whimsicalism wrote: post #4

Key detail from release: > If, on the Llama 2 version release date, the monthly active users of the products or services made available by or for Licensee, or Licensee’s affiliates, is greater than 700 million monthly active users in the preceding calendar month, you must request a license from Meta, which Meta may grant to you in its sole discretion, and you are not authorized to exercise any of the rights under thi…

> If, on the Llama 2 version release date, the monthly active users of the products or services made available by or for Licensee, or Licensee’s affiliates, is greater than 700 million monthly active users (...)

I suggest we start doing a similar thing for FOSS projects. I.e., it's open source unless you are MegaCorp with profit > $1B, then you have to pay. Sounds fair to me, and might help FOSS to get some better funding.

Re: Llama 2

#308

Post by [deleted] »

jug wrote: post #275
rajko_rad wrote: post #18

Hey HN, we've released tools that make it easy to test LLaMa 2 and add it to your own app! Model playground here: https://llama2.ai Hosted chat API here: https://replicate.com/a16z-infra/llama13b-v2-chat If you want to just play with the model, llama2.ai is a very easy way to do it. So far, we’ve found the performance is similar to GPT-3.5 with far fewer parameters, especially for creative tasks and interactions. Dev…

Still fails my hippo test! > Yes, hippos are excellent swimmers. They spend most of their time in the water, where they feed on aquatic plants and escape the heat of the savannah. In fact, hippos are one of the best swimmers among all land mammals. But that's fine. Most do. Hippos don't swim. They walk or hop/skip at best underwater.

[deleted]

Re: Llama 2

#309

Post by codethief »

sebzim4500 wrote: post #263
derefr wrote: post #242

Earlier quoted context omitted.

You're expecting a language model (as opposed to a more general form of ML model) to be numerate? It has no idea that the token "$105,000" has a relationship "is less than" with the token "$140,000". It probably knows that the token "1" has the relationship "is less than" with the token "2" — but that's because it has "1" and "2" as reified concepts, each with many different facts and properties and relationships ass…

The problem with this kind of simplistic analysis is that if you ask llama which of those numbers is larger it will of course get it right. Clearly there is some understanding of the relative size of numbers, since it can compare numbers that could not possibly have been in the training set.

I think you're both right and, as always, the truth is to be found somewhere in the middle:

> Which number is greater, 105,000 or 140,000?

> 140,000 is greater than 105,000.

> How do you know?

> 140,000 is greater than 105,000 because 140,000 is 35,000 more than 105,000.

But compare this to:

> Which number is greater: 12345 or 112345?

> 112345 is greater than 12345.

> How do you know?

> 112345 has more digits than 12345.

> What about 123456 and 134567?

> 134567 is greater than 123456.

> How do you know?

> 134567 has more digits than 123456.

> But they have the same number of digits: Six.

> 134567 has more significant digits than 123456.

> What do you mean by that?

> 134567 has more leading zeros than 123456.

> But neither has any zero.

> 134567 has more digits in total than 123456.

> But that's not true. They have the same number of digits. Yet, it is true that 134567 is greater than 123456, as you say. But why?

> 134567 is greater than 123456 because it has more digits in total.

Another attempt, with smaller context size:

> Which number is greater, 123456 or 134567?

> 134567 is greater than 123456.

> How do you know?

> 134567 is greater because 123456 has 6 digits while 134567 has 7 digits.

> But 134567 has 6 digits

> 134567 has 7 digits.

Re: Llama 2

#310

Post by [deleted] »

alexeldeib wrote: post #24
whimsicalism wrote: post #4

Key detail from release: > If, on the Llama 2 version release date, the monthly active users of the products or services made available by or for Licensee, or Licensee’s affiliates, is greater than 700 million monthly active users in the preceding calendar month, you must request a license from Meta, which Meta may grant to you in its sole discretion, and you are not authorized to exercise any of the rights under thi…

https://blogs.microsoft.com/blog/2023/07/18/microsoft-and-me... I think this is effectively an Apple + Amazon + Google ban? (MS employee, just noticing interesting intersection of announcements and licensing).

[deleted]
Post reply on HN