They've got a console for it as well, https://www.meta.ai/ And announcing a lot of integration across the Meta product suite, https://about.fb.com/news/2024/04/meta-ai-assistant-built-wi... Neglected to include comparisons against GPT-4-Turbo or Claude Opus, so I guess it's far from being a frontier model. We'll see how it fares in the LLM Arena.
And they even allow you to use it without logging in. Didnt expect that from Meta.
Yeah, but not for image generation unfortunately
I've never had a FaceBook account, and really don't trust them regarding
privacy
Where did you find this number? Not doubting it, just want to get a better idea of how precise the estimate may be.
It's a very plausible rumor, but it is misleading in this context, because the rumor also states that it's a mixture of experts model with 8 experts, suggesting that most (perhaps as many as 7/8) of those weights are unused by any particular inference pass. That might suggest that GPT-4 should be thought of as something like a 250B model. But there's also some selection for the remaining 1/8 of weights that are used…
What is the reason for settling on 7/8 experts for mixture of experts? Has there been any serious evaluation of what would be a good MoE split?
I downloaded llama3:8b-instruct-q4_0 in ollama and said "hi" and it answered with 10 screen long rant. This is an exerpt. > You're welcome! It was a pleasure chatting with you. Bye for now!assistant > Bye for now!assistant > Bye!assistant
Do you know what prompt template that was using?
I got the same with id e78ffd993558, which has the following template
{{ if .System }}system
{{ .System }}{{ end }}{{ if .Prompt }}user
{{ .Prompt }}{{ end }}assistant
{{ .Response }}
Edit: And it's fixed now on 521fcff26037 with no change to the template that I can see.
I just want to express how grateful I am that Zuck and Yann and the rest of the Meta team have adopted an open approach and are sharing the model weights, the tokenizer, information about the training data, etc. They, more than anyone else, are responsible for the explosion of open research and improvement that has happened with things like llama.cpp that now allow you to run quite decent models locally on consumer h…
Good thing that he's only 39 years old and seems more energetic than ever to run his company. Having a passionate founder is, imo, a big advantage for Meta compared to other big tech companies.
Once benchmarks exist for a while, they become meaningless - even if it's not specifically training on the test set, actions (what used to be called "graduate student descent") end up optimizing new models towards overfitting on benchmark tasks.
Also, the technological leader focuses less on the benchmarks
Interesting claim, is there data to back this up? My impression is that Intel and NVIDIA have always gamed the benchmarks.
I just want to express how grateful I am that Zuck and Yann and the rest of the Meta team have adopted an open approach and are sharing the model weights, the tokenizer, information about the training data, etc. They, more than anyone else, are responsible for the explosion of open research and improvement that has happened with things like llama.cpp that now allow you to run quite decent models locally on consumer h…
The world at large seems to hate Zuck but it’s good to hear from people familiar with software engineering and who understand just how significant his contributions to open source and raising salaries have been through Facebook and now Meta.
A person (or a company) can be two very different things at the same time. It's undeniable as you say that there have been a lot of high-profile open source innovations coming from Facebook (ReactJS, LLaMA, HHVM, ...), but the price that society at large paid for all of this is not insignificant either, and Meta hasn't meaningfully apologized for the worst of it.
I just want to express how grateful I am that Zuck and Yann and the rest of the Meta team have adopted an open approach and are sharing the model weights, the tokenizer, information about the training data, etc. They, more than anyone else, are responsible for the explosion of open research and improvement that has happened with things like llama.cpp that now allow you to run quite decent models locally on consumer h…
The amount of open source stuff Facebook (Meta) has given us over the years is astounding. pytorch, dall-e, react, react native, graphql, cassandra, tor. Commoditized VR, love my quest 3. Just an incredible track record. We're lucky they release all this stuff for free. The Zuck is one of a kind.
Yeah, I think Meta is the reason LLMs is widely available to everyone instead of reliant on something proprietary