Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Llama 2

ai.meta.com

Post reply on HN
Print view View original

371–380 of 860 posts

Re: Llama 2

#371

Post by stavros »

jimmySixDOF wrote: post #225
baby wrote: post #202

Earlier quoted context omitted.

I'm wondering how do people compare different models? I've been trying chatGPT 3.5, bing chat (chatgpt 4 I believe?), and bard, and now this one, and I'm not sure if there's a noticeable difference in terms of "this is better"

Try the Chat Arena with ELO ratings based on end user side by side blind tests. It run out of UC Berkley by lmsys the same team that released Vicuna. https://arena.lmsys.org/

That's a terrible system, it doesn't represent gaps in performance. If the first model is orders of magnitude better than the second, that system still says "99% as good" or whatever.

Re: Llama 2

#372

Post by alexeldeib »

zamadatix wrote: post #363
_2d30 wrote: post #291

Earlier quoted context omitted.

Yeah and look how they extended and extinguished that!

To be fair on that, both the US and EU governments launched antitrust cases around that with the US case narrowly avoiding having the company split up and the EU ruling resulting in requirements the browser be decoupled, followed by half a billion in fines for not doing so well enough. Not that the two situations are anything alike, but a "and look what happened with that" argument hardly points away from valid antit…

I think you and parent/GP all agree? A thing can be anti competitive, and a strategic failure.

Re: Llama 2

#373

Post by [deleted] »

0cf8612b2e1e wrote: post #212
itake wrote: post #109

Can someone reply with the checksums of their download? I will share mine once its finished.

Enormous complaint about this space: people seemingly never think to include checksums. Drives me wild when there is supposedly all of this concern about the right data and provenance, yet it is not easy to even confirm you have the genuine article.

[deleted]

Re: Llama 2

#375

Post by renewiltord »

CSMastermind wrote: post #332
jug wrote: post #275

Earlier quoted context omitted.

Still fails my hippo test! > Yes, hippos are excellent swimmers. They spend most of their time in the water, where they feed on aquatic plants and escape the heat of the savannah. In fact, hippos are one of the best swimmers among all land mammals. But that's fine. Most do. Hippos don't swim. They walk or hop/skip at best underwater.

There's a few prompts that I use with every model to compare them. One of the simplest ones is: > When does the bowl of the winds get used in the wheel of time books? LLaMA2 fails pretty hard: > The Bowl of the Winds is a significant artifact in the Wheel of Time series by Robert Jordan. It is first introduced in the third book, "The Dragon Reborn," and plays a crucial role in the series throughout the rest of the bo…

Interesting. Chat-GPT 4 has the following answer https://chat.openai.com/share/94ef3004-f944-4fc6-bbe5-597d54...

> When does the bowl of the winds get used in the wheel of time books?

> Mention the events leading up to it, the book number and name, and the chapter title if one exists.

> Response: In Robert Jordan's Wheel of Time series, the Bowl of the Winds is used in the 8th book, "The Path of Daggers." The bowl is used as a device to reverse a long-lasting, unnatural heatwave and restore the natural weather patterns.

I think that's right, actually, but it's been years (decades?) since I read that book.

Re: Llama 2

#376

Post by brucethemoose2 »

Dowwie wrote: post #365

Prompt: 5 Ounce (Pack of 6) is $33. 4 ounce pack of 6 is 15. which is the better deal? Llama 2: The 5 ounce pack of 6 is the better deal. It costs 33for6packs,whichis33for6packs,whichis5.50 per pack. The 4 ounce pack of 6 costs 15for6packs,whichis15for6packs,whichis2.50 per pack. So, the 5 ounce pack of 6 is the better deal. ChatGPT4: To figure out the best deal, we need to calculate the price per ounce for each opti…

Which one is that? 70b chat?

Re: Llama 2

#377

Post by lolinder »

amusingimpala75 wrote: post #281
GreedClarifies wrote: post #39

The benchmarks look amazing compared to other open source LLMs. Bravo Meta. Also allowing commercial use? Can be downloaded today? Available on Azure AI model catalog today? This is a very impressive release. However, if I were starting a company I would be a little worried about the Llama 2 Acceptable Use Policy. Some of the terms in there are a little vague and quite broad. They could, potentially, be weaponized in…

free != open source

Yes, but OP never said the words "open source", so I'm not sure why you're emphasizing that here.

Re: Llama 2

#378

Post by spacebanana7 »

feoren wrote: post #354
whimsicalism wrote: post #4

Key detail from release: > If, on the Llama 2 version release date, the monthly active users of the products or services made available by or for Licensee, or Licensee’s affiliates, is greater than 700 million monthly active users in the preceding calendar month, you must request a license from Meta, which Meta may grant to you in its sole discretion, and you are not authorized to exercise any of the rights under thi…

Maybe anti-Twitter? Aren't Elon and Zuck having a spat?

Twitter only has 300-400 million MAU [1] so I don’t think they’d be immediately affected.

Although I suppose they might have an aim of growing past 700m and therefore be deterred.

[1] https://www.statista.com/statistics/303681/twitter-users-wor...

Re: Llama 2

#379

Post by dontupvoteme »

gauravphoenix wrote: post #10

Why doesn't FB create an API around their model and launch OpenAPI competitor? It is not like they don't have resources, and the learnings (I am referring to actual learning from users' prompts) will improve their models over time.

Because their strategy is to give open source the capability to fight their competitors, which is great for us.
Post reply on HN