Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Meta AI releases Code Llama 70B

twitter.com

Post reply on HN
Print view View original

141–150 of 311 posts

Re: Meta AI releases Code Llama 70B

#141

Post by holoduke »

FrustratedMonky wrote: post #133
svara wrote: post #61

Earlier quoted context omitted.

It's aimed at OpenAI's moat. Making sure they don't accumulate too much of one. No one actually has to use this, it just needs to be clear that LLM as a service won't be super high margin because competition can simply start building on Meta's open source releases.

So. Strange as it seems, is Meta being more 'Open', than OpenAI that was created to be the 'open' option to fight off Meta and Google?

Meta is becoming the good guy. Its actually a smart move. Some extra reputation points wont hurt Meta.

Re: Meta AI releases Code Llama 70B

#142

Post by theLiminator »

Curious what's the current SOTA local copilot model? Are there any extensions in vscode that give you a similar experience? I'd love something more powerful than copilot for local use (I have a 4090, so I should be able to run a decent number of models).

Re: Meta AI releases Code Llama 70B

#144

Post by [deleted] »

crowcroft wrote: post #123
bk146 wrote: post #70

Can someone explain Meta's strategy with the open source models here? Genuine question, I don't fully undestand. (Please don't say "commoditize your complement" without explaining what exactly they're commoditizing...)

Meta's end goal is to have better AI than everyone else, in the medium term that means they want to have the best foundational models. How does this help. 1. They become an attractive place for AI researchers to work, and can bring in better staff. 2. They make it less appealing for startups to enter the space and build large foundation models (Meta would prefer 1,000 startups pop up and play around with other people…

[deleted]

Re: Meta AI releases Code Llama 70B

#147

Post by hackerlight »

ignoramous wrote: post #58
turnsout wrote: post #2

Given how good some of the smaller code models are (such as Deepseek Coder at 6.7B), I'll be curious to see what this 70B model is capable of!

AlphaCodium is the newest kid on the block that's SoTA pass@5 on coding tasks (authors claim at least 2x better than GPT4): https://github.com/Codium-ai/AlphaCodium As for small models, Microsoft has been making noise with the unreleased WaveCoder-Ultra-6.7b ( https://arxiv.org/abs/2312.14187 ).

Is this better than GPT4's Grimoire?

Re: Meta AI releases Code Llama 70B

#148

Post by famouswaffles »

eurekin wrote: post #120
skottenborg wrote: post #106

Earlier quoted context omitted.

I doubt personal passions would merit the company funding required for such big models.

Given how megacorps spend millions on a whim (Disney with all recent flops) or, when just a single person wants it (Ms Flight Simulator?) - I wouldn't be surprised to be honest... But sure, sounds more reasonable

Disney didn't spend millions on a whim. It's just the reality of box office that even millions in investment are no guarantee for returns.

Re: Meta AI releases Code Llama 70B

#149

Post by Philpax »

colesantiago wrote: post #132
Philpax wrote: post #91

Earlier quoted context omitted.

That may be true, but it's largely irrelevant. The ML framework in use has no bearing on whether or not you have the data required to reproduce the model being trained with that framework.

Do you and the GP have 350K GPUs and quality data to reproduce 1:1 whatever Facebook releases in their repos? Even if you want to reproduce the model and they give you the data, you would need to do this at Facebook scale, so you and the GP are just making moot points all around. https://about.fb.com/news/2023/05/metas-infrastructure-for-a... https://www.theregister.com/2024/01/20/metas_ai_plans/ The fact that these…

There are organisations that are capable of reproduction (e.g. EleutherAI), but yes, you're right, not having the data is largely irrelevant for most users.

The thing that bothers me more is that it's not actually an open-source licence; there are restrictions on what you can do with it, and whatever you do with the model is subject to those restrictions. It's still very useful and I'm not opposed to them releasing it under that licence (they need to recoup the costs somehow), but "open-source" (or even "open") it is not.

Re: Meta AI releases Code Llama 70B

#150

Post by Eisenstein »

theLiminator wrote: post #142

Curious what's the current SOTA local copilot model? Are there any extensions in vscode that give you a similar experience? I'd love something more powerful than copilot for local use (I have a 4090, so I should be able to run a decent number of models).

When this 70b model gets quantized you should be able to run it fine on your 4090. Check out 'TheBloke' on huggingface and the llamacpp to run the gguf files.
Post reply on HN