Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Code Llama, a state-of-the-art large language model for coding

ai.meta.com

Post reply on HN
Print view View original

291–300 of 525 posts

Re: Code Llama, a state-of-the-art large language model for coding

#291

Post by emporas »

UncleOxidant wrote: post #250
syntaxing wrote: post #185

TheBloke doesn’t joke around [1]. I’m guessing we’ll have the quantized ones by the end of the day. I’m super excited to use the 34B Python 4 bit quantized one that should just fit on a 3090. [1] https://huggingface.co/TheBloke/CodeLlama-13B-Python-fp16

If I don't want to run this locally is it runnable somewhere on huggingface?

Replicate has already hosted Llama2 13B, the chat version. My guess is, in a short span of days or weeks they will host the code version too. They charge a dollar for 2000 generations if i am not mistaken.

https://replicate.com/a16z-infra/llama-2-13b-chat

Re: Code Llama, a state-of-the-art large language model for coding

#292

Post by fpgaminer »

lordnacho wrote: post #128

Copilot has been working great for me thus far, but it's limited by its interface. It seems like it only knows how to make predictions for the next bit of text. Is anyone working on a code AI that can suggest refactorings? "You should pull these lines into a function, it's repetitive" "You should change this structure so it is easier to use" Etc

https://docs.github.com/en/copilot/github-copilot-chat/using... can basically do that if you're in the beta.

Re: Code Llama, a state-of-the-art large language model for coding

#293

Post by GordonS »

thewataccount wrote: post #247
sestinj wrote: post #241

Earlier quoted context omitted.

You can use Continue for all of this, as easy as highlighting code and making the request. We also support using Code Llama: https://continue.dev/docs/walkthroughs/codellama

Any plans to support IntelliJ?

I'd also be really keen on this.

Re: Code Llama, a state-of-the-art large language model for coding

#294

Post by haldujai »

lhl wrote: post #243
nabakin wrote: post #198

Earlier quoted context omitted.

I've seen this argued a lot but is it fact? OpenAI was able to train on data from other platforms and surely, those platforms weren't letting their data go if they could help it. Unless some new laws have been passed, I don't think OpenAI can legally prevent others from using their data to train models. OpenAI can't have their cake and eat it too. After all, any content generated by AI can't be copyrighted.

It is indeed a fact that OpenAI's Terms of Use do state that you can't use their service to develop competing models: Section 2.c.iii - https://openai.com/policies/terms-of-use Now of course, the terms are not the law (so don't govern the use of the generated data by any third party), they are an agreement between two parties. If you did click "agree" then that's a binding agreement and there could be legal/contractu…

That seems like a likely explanation, probably won't get into legal trouble for using an OpenAI model for a research paper but redistributing said model may be upsetting enough for OpenAI trigger a legal challenge.

Unnatural language used davinci-002 although that was a while ago, they only say "similarly" in this paper and don't specify what they used. I can't see a reason why they wouldn't be releasing it if the unnatural prompts were generated by LLaMA2-family.

In any case, replicating this training seems trivial and very cheap compute-wise for anyone who wanted to do it.

Re: Code Llama, a state-of-the-art large language model for coding

#295

Post by blibble »

lamp987 wrote: post #290
blibble wrote: post #266

Earlier quoted context omitted.

due to the way LLMs work: it will be able to handle that level of abstraction in exactly the same way

LLM is not strong AI. It's not even AI. So no. You will always need that strong "I" at the top somewhere.

I think you're in for a nasty surprise

Re: Code Llama, a state-of-the-art large language model for coding

#297

Post by fredoliveira »

coder543 wrote: post #146
MertsA wrote: post #93

Earlier quoted context omitted.

I've been using this or something similar internally for months and love it. The thing that gets downright spooky is the comments believe it or not. I'll have some method with a short variable name in a larger program and not only does it often suggest a pretty good snippet of code the comments will be correct and explain what the intent behind the code is. It's just a LLM but you really start to get the feeling the…

I just don’t understand how anyone is making practical use of local code completion models. Is there a VS Code extension that I’ve been unable to find? HuggingFace released one that is meant to use their service for inference, not your local GPU. The instruct version of code llama could certainly be run locally without trouble, and that’s interesting too, but I keep wanting to test out a local CoPilot alternative tha…

There are a bunch of VSCode extensions that make use of local models. Tabby seems to be the most friendly right now, but I admittedly haven't tried it myself: https://tabbyml.github.io/tabby/

Re: Code Llama, a state-of-the-art large language model for coding

#298

Post by [deleted] »

lolinder wrote: post #7

Does anyone have a good explanation for Meta's strategy with AI? The only thing I've been able to think is they're trying to commoditize this new category before Microsoft and Google can lock it in, but where to from there? Is it just to block the others from a new revenue source, or do they have a longer game they're playing?

[deleted]

Re: Code Llama, a state-of-the-art large language model for coding

#299

Post by natch »

redox99 wrote: post #151
natch wrote: post #139

Why wouldn’t they provide a hosted version? Seems like a no brainer… they have the money, the hardware, the bandwidth, the people to build support for it, and they could design the experience and gather more learning data about usage in the initial stages, while putting a dent in ChatGPT commercial prospects, and all while still letting others host and use it elsewhere. I don’t get it. Maybe it was just the fastest o…

Probably the researchers at meta are only interested in research, and productionizing this would be up to other teams.

But Yann LeCun seems to think the safety problems of eventual AGI will be solved somehow.

Nobody is saying this model is AGI obviously.

But this would be an entry point into researching one small sliver of the alignment problem. If you follow my thinking, it’s odd that he professes confidence that AI safety is a non issue, yet from this he seems to want no part in understanding it.

I realize their research interest may just be the optimization / mathy research… that’s their prerogative but it’s odd imho.

Re: Code Llama, a state-of-the-art large language model for coding

#300

Post by [deleted] »

rvnx wrote: post #98

Amazing! It's great that Meta is making AI progress. In the meantime, we are still waiting for Google to show what they have (according to their research papers, they are beating others). > User: Write a loop in Python that displays the top 10 prime numbers. > Bard: Sorry I am just an AI, I can't help you with coding. > User: How to ask confirmation before deleting a file ? > Bard: To ask confirmation before deleting…

[deleted]
Post reply on HN