Meta Llama 3 • Hacker News Board

Re: Meta Llama 3

#161

Post by dheera » Thu, Apr 18, 2024, 5:11 PM UTC

matsemann wrote: post #75

bbig wrote: post #4

They've got a console for it as well, https://www.meta.ai/ And announcing a lot of integration across the Meta product suite, https://about.fb.com/news/2024/04/meta-ai-assistant-built-wi... Neglected to include comparisons against GPT-4-Turbo or Claude Opus, so I guess it's far from being a frontier model. We'll see how it fares in the LLM Arena.

> Meta AI isn't available yet in your country Where is it available? I got this in Norway.

[flagged]

Re: Meta Llama 3

#162

Post by reilly3000 » Thu, Apr 18, 2024, 5:12 PM UTC

I’m impressed by the benchmarks but really intrigued by the press release with the example prompt ~”Tell me some concerts I can go to on Saturday”. Clearly they are able to add their Meta data to context, but are they also crawling the web? Could this be a surface to exfiltrate Meta data in ways that scraping/ APIs cannot?

Re: Meta Llama 3

#163

Post by noiseinvacuum » Thu, Apr 18, 2024, 5:12 PM UTC

sergiotapia wrote: post #77

The amount of open source stuff Facebook (Meta) has given us over the years is astounding. pytorch, dall-e, react, react native, graphql, cassandra, tor. Commoditized VR, love my quest 3. Just an incredible track record. We're lucky they release all this stuff for free. The Zuck is one of a kind.

What does not get a lot of attention is the work they have done with OCP (Open Compute: https://www.ocp.org/en-us) to first launch it in 2012 and then nurture and grow it since then.

One project I am really excited to see grow is Overture Maps(https://overturemaps.org/), I think it'll have an impact, from end user perspective, far larger than perhaps all other projects.

Re: Meta Llama 3

#164

Post by SOVIETIC-BOSS88 » Thu, Apr 18, 2024, 5:12 PM UTC

resource_waste wrote: post #55

bbig wrote: post #4

They've got a console for it as well, https://www.meta.ai/ And announcing a lot of integration across the Meta product suite, https://about.fb.com/news/2024/04/meta-ai-assistant-built-wi... Neglected to include comparisons against GPT-4-Turbo or Claude Opus, so I guess it's far from being a frontier model. We'll see how it fares in the LLM Arena.

[flagged]

We are living in a post Dan Schneider world. Feet are off the table.

Re: Meta Llama 3

#165

Post by fnordlord » Thu, Apr 18, 2024, 5:13 PM UTC

danenania wrote: post #152

fnordlord wrote: post #95

Earlier quoted context omitted.

Do you mind my asking, if you're working on private codebases, how you go about using GPT/Claude as a code assistant? I'm just removing IP and pasting into their website's chat interface. I feel like there's got to be something better out there but I don't really know anyone else that's using AI code assistance at all.

I'm building Plandex ( https://github.com/plandex-ai/plandex ), a terminal-based AI coding tool which currently uses the OpenAI api--I'm working on support for Anthropic and OSS models right now and hoping I can ship it later today. You can self-host it so that data is only going to the model provider (i.e. OpenAI) and nowhere else, and it gives you fine-grained control of context, so you can pick and choose exactly…

Very cool! I'll take a look.

Re: Meta Llama 3

#166

Post by pzo » Thu, Apr 18, 2024, 5:13 PM UTC

cjbprime wrote: post #120

modeless wrote: post #89

I was curious how the numbers compare to GPT-4 in the paid ChatGPT Plus, since they don't compare directly themselves. Llama 3 8B Llama 3 70B GPT-4 MMLU 68.4 82.0 86.5 GPQA 34.2 39.5 49.1 MATH 30.0 50.4 72.2 HumanEval 62.2 81.7 87.6 DROP 58.4 79.7 85.4 Note that the free version of ChatGPT that most people use is based on GPT-3.5 which is much worse than GPT-4. I haven't found comprehensive eval numbers for the lates…

Has anyone prepared a comparison to Mixtral 8x22B? (Life sure moves fast.)

also curious how it compares to WizardLM 2 8x22B

Re: Meta Llama 3

#167

Post by dheera » Thu, Apr 18, 2024, 5:14 PM UTC

milansuk wrote: post #91

I don't see any explanation for why they trained 8B instead of 7B. I thought that If you have a 16GB GPU, you can put 14GB(7B*16bits) model into it, but how does it fit If the model is exactly 16GB?

Upgrade to a 24GB GPU?

Re: Meta Llama 3

#168

Post by kleiba » Thu, Apr 18, 2024, 5:14 PM UTC

dheera wrote: post #161

matsemann wrote: post #75

Earlier quoted context omitted.

> Meta AI isn't available yet in your country Where is it available? I got this in Norway.

[flagged]

What a silly, provocative comparison. China is a suppressive state that strives to control its citizens while the EU privacy protection laws are put in place to protect citizens. If you cannot access websites from "the free world" because of these laws, it means that the providers of said websites are threatening your freedom, not providing it.

Re: Meta Llama 3

#169

Post by Draiken » Thu, Apr 18, 2024, 5:15 PM UTC

flemhans wrote: post #99

niek_pas wrote: post #82

Earlier quoted context omitted.

Got the same in the Netherlands.

Probably the EU laws are getting too draconian. I'm starting to see it a lot.

Meta (and other privacy exploiting companies) have to actually... care? Even if it's just a bit more. Nothing draconian about it.

Re: Meta Llama 3

#170

Post by iosjunkie » Thu, Apr 18, 2024, 5:17 PM UTC

throwup238 wrote: post #23

bbig wrote: post #4

They've got a console for it as well, https://www.meta.ai/ And announcing a lot of integration across the Meta product suite, https://about.fb.com/news/2024/04/meta-ai-assistant-built-wi... Neglected to include comparisons against GPT-4-Turbo or Claude Opus, so I guess it's far from being a frontier model. We'll see how it fares in the LLM Arena.

> And announcing a lot of integration across the Meta product suite, ... That's ominous...

Spending millions/billions to train these models is for a reason and it's not just for funsies.