Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Code Llama, a state-of-the-art large language model for coding

ai.meta.com

Post reply on HN
Print view View original

241–250 of 525 posts

Re: Code Llama, a state-of-the-art large language model for coding

#241

Post by sestinj »

lordnacho wrote: post #128

Copilot has been working great for me thus far, but it's limited by its interface. It seems like it only knows how to make predictions for the next bit of text. Is anyone working on a code AI that can suggest refactorings? "You should pull these lines into a function, it's repetitive" "You should change this structure so it is easier to use" Etc

You can use Continue for all of this, as easy as highlighting code and making the request. We also support using Code Llama: https://continue.dev/docs/walkthroughs/codellama

Re: Code Llama, a state-of-the-art large language model for coding

#242

Post by basch »

roughly wrote: post #106
vessenes wrote: post #34

Earlier quoted context omitted.

They are behind commercially, very behind. They also don't have the same economic setup and DNA as MS/OpenAI. Large corporate customers don't pay for access to the FB cloud, nor are they likely to -- Ellison has spent years building out Oracle Cloud, and he's on the FB board, for example. And I bet you didn't think of using Oracle's Cloud for your last project. So, your company DNA is free-to-all social based on ad m…

That’s interesting. I tend to lump FB, Amazon, Google, and MS in my head when thinking about the tech giants, but you’re right, FB is the only one of those not offering a commercial platform. For them, building out the capabilities of the LLMs is something to be done in the open with community involvement, because they’re not going to monetize the models themselves. They’re also getting a fantastic amount of press fr…

I'm in the camp that its a mistake for Meta to not be competing in the commercial compute space.

wrote about and diagramed it here - https://telegra.ph/Facebook-Social-Services-FbSS-a-missed-op...

Re: Code Llama, a state-of-the-art large language model for coding

#243

Post by lhl »

nabakin wrote: post #198
ilaksh wrote: post #177

Earlier quoted context omitted.

Maybe they used GPT-4 to train it. OpenAI terms of use don't allow that to be released commercially.

I've seen this argued a lot but is it fact? OpenAI was able to train on data from other platforms and surely, those platforms weren't letting their data go if they could help it. Unless some new laws have been passed, I don't think OpenAI can legally prevent others from using their data to train models. OpenAI can't have their cake and eat it too. After all, any content generated by AI can't be copyrighted.

It is indeed a fact that OpenAI's Terms of Use do state that you can't use their service to develop competing models: Section 2.c.iii - https://openai.com/policies/terms-of-use

Now of course, the terms are not the law (so don't govern the use of the generated data by any third party), they are an agreement between two parties. If you did click "agree" then that's a binding agreement and there could be legal/contractual repercussions (some of which are outlined in the terms).

Re: Code Llama, a state-of-the-art large language model for coding

#244

Post by oceanplexian »

roughly wrote: post #106
vessenes wrote: post #34

Earlier quoted context omitted.

They are behind commercially, very behind. They also don't have the same economic setup and DNA as MS/OpenAI. Large corporate customers don't pay for access to the FB cloud, nor are they likely to -- Ellison has spent years building out Oracle Cloud, and he's on the FB board, for example. And I bet you didn't think of using Oracle's Cloud for your last project. So, your company DNA is free-to-all social based on ad m…

That’s interesting. I tend to lump FB, Amazon, Google, and MS in my head when thinking about the tech giants, but you’re right, FB is the only one of those not offering a commercial platform. For them, building out the capabilities of the LLMs is something to be done in the open with community involvement, because they’re not going to monetize the models themselves. They’re also getting a fantastic amount of press fr…

FB is unlike the other BigTech(tm) since Zuck never sold out and has a controlling equity stake. Amazon, Google, and MS are all controlled by and beholden to institutional investors.

FB can release these for no other reason than Zuck’s ego or desire to kill OpenAI. Same deal as him going off on a tangent with the Metaverse thing.

Re: Code Llama, a state-of-the-art large language model for coding

#245

Post by oceanplexian »

GreedClarifies wrote: post #113
doomlaser wrote: post #100

Earlier quoted context omitted.

I watched a good talk from Yann LeCun who is Chief AI Scientist at Meta, and he explained that the thinking is that open source AI models will be the long-term winner, so it's best for them to work in that arena. https://www.youtube.com/watch?v=vyqXLJsmsrk

That's not a business strategy. Likely this is driven by ego. Yann wants to cement his position as a leader in AI and while he clearly does not appreciate LLMS at all, he realizes that he needs to make waves in this area. Mark needs a generative product and has invested tremendously in the infrastructure for AI in general (for recommendation). He needs researchers to use that infrastructure to create a generative pro…

It’s not just ego. It’s accelerationism. Giving this stuff away from free is probably going to accelerate AI a decade faster than if it was kept locked up behind closed doors at Google, OpenAI, etc. And if you’re an optimist then that actually might make the world a better place much faster.

Re: Code Llama, a state-of-the-art large language model for coding

#246

Post by lamp987 »

dangerwill wrote: post #103

It's really sad how everyone here is fawning over tech that will destroy you own livelihoods. "AI won't take your job, those who use AI will" is purely short term, myopic thinking. These tools are not aimed to help workers, the end goal is to make it so you don't need to be an engineer to build software, just let the project manager or director describe the system they want and boom there it is. You can scream that t…

"If software engineering becomes a solved problem"

It will simply move to a higher level of abstraction.

Remind me, how many programmers today are writing in assembly?

Re: Code Llama, a state-of-the-art large language model for coding

#247

Post by thewataccount »

sestinj wrote: post #241
lordnacho wrote: post #128

Copilot has been working great for me thus far, but it's limited by its interface. It seems like it only knows how to make predictions for the next bit of text. Is anyone working on a code AI that can suggest refactorings? "You should pull these lines into a function, it's repetitive" "You should change this structure so it is easier to use" Etc

You can use Continue for all of this, as easy as highlighting code and making the request. We also support using Code Llama: https://continue.dev/docs/walkthroughs/codellama

Any plans to support IntelliJ?

Re: Code Llama, a state-of-the-art large language model for coding

#249

Post by mediaman »

kapp_in_life wrote: post #147
nabakin wrote: post #138

Earlier quoted context omitted.

Looks like they aren't releasing a pretty interesting model too. In the paper they mention a "Unnatural Code Llama" which wipes the floor with every other model/finetune on every benchmark except for slightly losing to Code Llama Python on MBPP pass@100 and slightly losing to GPT-4 on HumanEval pass@1 which is insane. Meta says later on that they aren't releasing it and give no explanation. I wonder why given how inc…

Likely trained on internal code.

That model is trained on synthetically AI-generated code, not internal code.

It suggests that synthetic training could be the future in increasing capability of smaller models (and perhaps bigger ones too). AI will train AI.

Re: Code Llama, a state-of-the-art large language model for coding

#250

Post by UncleOxidant »

syntaxing wrote: post #185

TheBloke doesn’t joke around [1]. I’m guessing we’ll have the quantized ones by the end of the day. I’m super excited to use the 34B Python 4 bit quantized one that should just fit on a 3090. [1] https://huggingface.co/TheBloke/CodeLlama-13B-Python-fp16

If I don't want to run this locally is it runnable somewhere on huggingface?
Post reply on HN