Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Meta Llama 3

llama.meta.com

Post reply on HN
Print view View original

71–80 of 965 posts

Re: Meta Llama 3

#71

Post by swores »

CuriouslyC wrote: post #64
swores wrote: post #54

Earlier quoted context omitted.

That's a different company's model, so while it may have been obvious it is not relevant to whether Claude 3 has been nerfed or not is it?

I use claude3 opus daily and I haven't noticed a change in its outputs, I think it's more likely that there's a discontinuity in the inputs the user is providing to claude which is tipping it over a threshold into a response type they find incorrect. When GPT4 got lobotomized, you had to work hard to avoid the new behavior, it popped up everywhere. People claiming claude got lobotomized seem to be cherry picking exam…

Oh my bad, sorry, I misinterpreted your previous comment as meaning "it was obvious with GPT4 and therefore if people say the same about Claude 3 it must equally be obvious and true", rather than what you meant which was half the opposite.

Re: Meta Llama 3

#72

Post by minimaxir »

refulgentis wrote: post #30
trevor-e wrote: post #11

Earlier quoted context omitted.

Why do people keep saying that Claude3 has been nerfed? Their CTO has said on Twitter multiple times that not a single byte has been changed since its launch, so I'm curious why I keep hearing this. edit: having trouble finding the tweet I saw recently, it might have been from their lead engineer and not the CTO.

Over yonder: https://x.com/alexalbert__/status/1780707227130863674 my $0.02: it makes me very uncomfortable that people misunderstand LLMs enough to even think this is possible

It is 100% possible for performance regressions to occur by changing the model pipeline and not the model itself. A system prompt is a part of said pipeline.

Prompt engineering is surprisingly fragile.

Re: Meta Llama 3

#73

Post by applecrazy »

nickthegreek wrote: post #17
bbig wrote: post #4

They've got a console for it as well, https://www.meta.ai/ And announcing a lot of integration across the Meta product suite, https://about.fb.com/news/2024/04/meta-ai-assistant-built-wi... Neglected to include comparisons against GPT-4-Turbo or Claude Opus, so I guess it's far from being a frontier model. We'll see how it fares in the LLM Arena.

And they even allow you to use it without logging in. Didnt expect that from Meta.

I imagine that is to compete with ChatGPT, which began doing the same.

Re: Meta Llama 3

#75

Post by matsemann »

bbig wrote: post #4

They've got a console for it as well, https://www.meta.ai/ And announcing a lot of integration across the Meta product suite, https://about.fb.com/news/2024/04/meta-ai-assistant-built-wi... Neglected to include comparisons against GPT-4-Turbo or Claude Opus, so I guess it's far from being a frontier model. We'll see how it fares in the LLM Arena.

> Meta AI isn't available yet in your country

Where is it available? I got this in Norway.

Re: Meta Llama 3

#76

Post by [deleted] »

refulgentis wrote: post #49
Anuiran wrote: post #14

Awesome, but I am surprised by the constrained context window as it balloons everywhere else. Am I missing something? 8k seems quite low in current landscape.

Honestly, I swear to god, been working 12 hours a day with these for a year now, llama.cpp, Claude, OpenAI, Mistral, Gemini: The long context window isn't worth much and is currently creating more problems than it's worth for the bigs, with their "unlimited" use pricing models. Let's take Claude 3's web UI as an example. We build it, and go the obvious route: we simply use as much of the context as possible, given ch…

[deleted]

Re: Meta Llama 3

#77

Post by sergiotapia »

The amount of open source stuff Facebook (Meta) has given us over the years is astounding. pytorch, dall-e, react, react native, graphql, cassandra, tor. Commoditized VR, love my quest 3. Just an incredible track record. We're lucky they release all this stuff for free. The Zuck is one of a kind.

Re: Meta Llama 3

#79

Post by CuriouslyC »

sroussey wrote: post #52
CuriouslyC wrote: post #15

Earlier quoted context omitted.

If it's limited to 8k context length then it's not competing with sonnet at all IMO. Sonnet has a 200k context length and it's decent at pulling stuff from it, with just an 8k context length this model won't be great for RAG applications, instead it'll be used for chat and transforming data from one type to another.

They explain that they will be releasing longer context lengths in the future. It’s better to make your RAG system work well on small context first anyway.

While that's true when you're dealing with a domain that's well represented in the training data and your return type isn't complicated, if you're doing anything nuanced you can burn 10k tokens just to get the model to be consistent in how it answers and structures output.

Re: Meta Llama 3

#80

Post by robertlagrant »

observationist wrote: post #67

https://github.com/meta-llama/llama3/blob/main/LICENSE Llama is not open source. It's corporate freeware with some generous allowances. Open source licenses are a well defined thing. Meta marketing saying otherwise doesn't mean they get to usurp the meaning of a well understood and commonly used understanding of the term "open source." https://opensource.org/license Nothing about Meta's license is open source. It's a…

What is "source" regarding an LLM? Public training data and initial parameters?
Post reply on HN