Live data from Hacker News

Meta Llama 3

llama.meta.com

251–260 of 965 posts

Re: Meta Llama 3

#251
post #4

They've got a console for it as well, https://www.meta.ai/ And announcing a lot of integration across the Meta product suite, https://about.fb.com/news/2024/04/meta-ai-assistant-built-wi... Neglected to include comparisons against GPT-4-Turbo or Claude Opus, so I guess it's far from being a frontier model. We'll see how it fares in the LLM Arena.

And they even allow you to use it without logging in. Didnt expect that from Meta.

Yeah, but not for image generation unfortunately

I've never had a FaceBook account, and really don't trust them regarding privacy

Re: Meta Llama 3

#252

Earlier quoted context omitted.

Where did you find this number? Not doubting it, just want to get a better idea of how precise the estimate may be.

It's a very plausible rumor, but it is misleading in this context, because the rumor also states that it's a mixture of experts model with 8 experts, suggesting that most (perhaps as many as 7/8) of those weights are unused by any particular inference pass. That might suggest that GPT-4 should be thought of as something like a 250B model. But there's also some selection for the remaining 1/8 of weights that are used…

What is the reason for settling on 7/8 experts for mixture of experts? Has there been any serious evaluation of what would be a good MoE split?

Re: Meta Llama 3

#253
post #213

I downloaded llama3:8b-instruct-q4_0 in ollama and said "hi" and it answered with 10 screen long rant. This is an exerpt. > You're welcome! It was a pleasure chatting with you. Bye for now!assistant > Bye for now!assistant > Bye!assistant

Do you know what prompt template that was using?

I got the same with id e78ffd993558, which has the following template

    {{ if .System }}system
    
    {{ .System }}{{ end }}{{ if .Prompt }}user
    
    {{ .Prompt }}{{ end }}assistant
    
    {{ .Response }}
Edit: And it's fixed now on 521fcff26037 with no change to the template that I can see.

Re: Meta Llama 3

#254

I just want to express how grateful I am that Zuck and Yann and the rest of the Meta team have adopted an open approach and are sharing the model weights, the tokenizer, information about the training data, etc. They, more than anyone else, are responsible for the explosion of open research and improvement that has happened with things like llama.cpp that now allow you to run quite decent models locally on consumer h…

Good thing that he's only 39 years old and seems more energetic than ever to run his company. Having a passionate founder is, imo, a big advantage for Meta compared to other big tech companies.

Re: Meta Llama 3

#255

It's by Facebook, currently hidden behind the veil of Meta, so what's the catch?

The "catch" is that they are releasing these models in order to commoditize the technology of their competitors.

By releasing these models for free, they drive down the price/advantage of competing companies.

Re: Meta Llama 3

#256
post #173
post #154

Earlier quoted context omitted.

Once benchmarks exist for a while, they become meaningless - even if it's not specifically training on the test set, actions (what used to be called "graduate student descent") end up optimizing new models towards overfitting on benchmark tasks.

Also, the technological leader focuses less on the benchmarks

Interesting claim, is there data to back this up? My impression is that Intel and NVIDIA have always gamed the benchmarks.

Re: Meta Llama 3

#257

I just want to express how grateful I am that Zuck and Yann and the rest of the Meta team have adopted an open approach and are sharing the model weights, the tokenizer, information about the training data, etc. They, more than anyone else, are responsible for the explosion of open research and improvement that has happened with things like llama.cpp that now allow you to run quite decent models locally on consumer h…

The world at large seems to hate Zuck but it’s good to hear from people familiar with software engineering and who understand just how significant his contributions to open source and raising salaries have been through Facebook and now Meta.

A person (or a company) can be two very different things at the same time. It's undeniable as you say that there have been a lot of high-profile open source innovations coming from Facebook (ReactJS, LLaMA, HHVM, ...), but the price that society at large paid for all of this is not insignificant either, and Meta hasn't meaningfully apologized for the worst of it.

Re: Meta Llama 3

#258

I just want to express how grateful I am that Zuck and Yann and the rest of the Meta team have adopted an open approach and are sharing the model weights, the tokenizer, information about the training data, etc. They, more than anyone else, are responsible for the explosion of open research and improvement that has happened with things like llama.cpp that now allow you to run quite decent models locally on consumer h…

[flagged]

Re: Meta Llama 3

#260

The amount of open source stuff Facebook (Meta) has given us over the years is astounding. pytorch, dall-e, react, react native, graphql, cassandra, tor. Commoditized VR, love my quest 3. Just an incredible track record. We're lucky they release all this stuff for free. The Zuck is one of a kind.

Yeah, I think Meta is the reason LLMs is widely available to everyone instead of reliant on something proprietary
Post reply on HN