Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Meta AI releases Code Llama 70B

twitter.com

Post reply on HN
Print view View original

51–60 of 311 posts

Re: Meta AI releases Code Llama 70B

#51

Post by ttul »

austinpena wrote: post #5
colesantiago wrote: post #3

Llama is getting better and better, I heard this and Llama 3 will start to be good as GPT-4. Who would have thought that Meta, that has been chucking billions on the metaverse is on the forefront of Open Source AI. Not to mention their stock is up and they are worth $1TN, again. Not sure how I feel about this given the fact of all the scandals that have plagued them and the massive 1BN fine from the EU, Cambridge Ana…

I'm really curious what their goal is

If you want to employ the top ML researchers, you have to give them what they want, which is often the ability to share their discoveries with the world. Making Llama-N open may not be Zuckerberg‘s preference. It’s possible the researchers demanded it.

Re: Meta AI releases Code Llama 70B

#52

Post by Filligree »

michaelt wrote: post #44
Arainach wrote: post #11

Earlier quoted context omitted.

Disclaimer: I do not work at Meta, but I work at a large tech company which competes with them. I don't work in AI, although if my VP asks don't tell them I said that or they might lay me off. Multiple of their major competitors/other large tech companies are trying to monetize LLMs. OpenAI maneuvering an early lead into a dominant position would be another potential major competitor. If releasing these models slows…

Why? What benefit is there to grabbing market share from your competitors... in a business you don't even want to be in? By that logic you could justify any bizarre business decision. Should Google launch a social network, to hurt their competitor Facebook? Should Facebook, Amazon and Microsoft each launch a phone?

> Should Google launch a social network, to hurt their competitor Facebook?

I mean, Google did launch a social network, to hurt their competitor Facebook. It was a whole thing. It was even a really nice system, eventually.

Re: Meta AI releases Code Llama 70B

#53

Post by [deleted] »

b33j0r wrote: post #31

There is a bait and switch going on, and sam altman or mark zuckerberg are the first to tell you. “No one can compete with us, but it’s cute to try! Make applications though” —almost direct quote from Sam Altman. I have 64gb and an RTX 3090 and a macbook M3, and I already can’t run a lot of the newest models even in their quantized form. The business model requires this to be a subscription service. At least as of to…

[deleted]

Re: Meta AI releases Code Llama 70B

#54

Post by changoplatanero »

eigenvalue wrote: post #30
ramshanker wrote: post #14

Are these trained on internal Code bases or just the public repositories?

Would be a really bad idea to train on internal code I would think. Besides, there is no shortage of open source code (even open source created by Meta) out there.

Correct that it’s a bad idea to train on internal code. However surprisingly there is a shortage of open source code. These models are trained on substantially all the available open source code that these companies can get their hands on.

Re: Meta AI releases Code Llama 70B

#55

Post by wrsh07 »

austinpena wrote: post #5
colesantiago wrote: post #3

Llama is getting better and better, I heard this and Llama 3 will start to be good as GPT-4. Who would have thought that Meta, that has been chucking billions on the metaverse is on the forefront of Open Source AI. Not to mention their stock is up and they are worth $1TN, again. Not sure how I feel about this given the fact of all the scandals that have plagued them and the massive 1BN fine from the EU, Cambridge Ana…

I'm really curious what their goal is

Rule 5: commodify your complement

Content generation is complementary to most of meta's apps and projects

Re: Meta AI releases Code Llama 70B

#56

Post by lozenge »

blackoil wrote: post #33
Havoc wrote: post #23

Not sure who this is aimed at? The avg programmer probably doesn’t have the gear on hand to run this at the required pace Cool nonetheless

How feasible would it be too fine tune using internal code and have an enterprise copilot.

Considering a number of Saas offer this service, I'd say it's feasible.

Re: Meta AI releases Code Llama 70B

#57

Post by colesantiago »

fragmede wrote: post #26
colesantiago wrote: post #3

Llama is getting better and better, I heard this and Llama 3 will start to be good as GPT-4. Who would have thought that Meta, that has been chucking billions on the metaverse is on the forefront of Open Source AI. Not to mention their stock is up and they are worth $1TN, again. Not sure how I feel about this given the fact of all the scandals that have plagued them and the massive 1BN fine from the EU, Cambridge Ana…

Model available , not open source. These models aren't open source because we don't have access to the data sets, nor the full code to train them, so we can't recreate the models even if we had the GPU time available to recreate them.

Everyone using AI in production is using Pytorch by Meta.

Which is open source.

I do not know anybody important in the AI space apart from Google using TensorFlow.

Re: Meta AI releases Code Llama 70B

#58

Post by ignoramous »

turnsout wrote: post #2

Given how good some of the smaller code models are (such as Deepseek Coder at 6.7B), I'll be curious to see what this 70B model is capable of!

AlphaCodium is the newest kid on the block that's SoTA pass@5 on coding tasks (authors claim at least 2x better than GPT4): https://github.com/Codium-ai/AlphaCodium

As for small models, Microsoft has been making noise with the unreleased WaveCoder-Ultra-6.7b (https://arxiv.org/abs/2312.14187).

Re: Meta AI releases Code Llama 70B

#60

Post by michaelt »

kuczmama wrote: post #35
b33j0r wrote: post #31

There is a bait and switch going on, and sam altman or mark zuckerberg are the first to tell you. “No one can compete with us, but it’s cute to try! Make applications though” —almost direct quote from Sam Altman. I have 64gb and an RTX 3090 and a macbook M3, and I already can’t run a lot of the newest models even in their quantized form. The business model requires this to be a subscription service. At least as of to…

Realistically, what hardware would be required to run this? I assumed a RTX 3090 would be enough?

You can run a similarly sized model - Llama 2 70B - at the 'Q4_K_M' quantisation level, with 44 GB of memory [1]. So you can just about fit it on 2x RTX 3090 (which you can buy, used, for around $1100 each)

Of course, you can buy quite a lot of hosted model API access or cloud GPU time for that money.

[1] https://huggingface.co/TheBloke/Llama-2-70B-GGUF

Post reply on HN