Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Code Llama, a state-of-the-art large language model for coding

ai.meta.com

Post reply on HN
Print view View original

301–310 of 525 posts

Re: Code Llama, a state-of-the-art large language model for coding

#301

Post by gorbypark »

I can't wait for some models fine tuned on other languages. I'm not a Python developer, so I downloaded the 13B-instruct variant (4 bit quantized Q4_K_M) and it's pretty bad at doing javascript. I asked it to write me a basic React Native component that has a name prop and displays that name. Once it returned a regular React component, and when I asked it to make sure it uses React Native components, it said sure and outputted a bunch of random CSS and an HTML file that was initializing a React project.

It might be the quantization or my lacklustre prompting skills affecting it, though. To be fair I did get it to output a little bit of useful code after trying a few times.

Re: Code Llama, a state-of-the-art large language model for coding

#302

Post by comechao »

mchiang wrote: post #223
syntaxing wrote: post #185

TheBloke doesn’t joke around [1]. I’m guessing we’ll have the quantized ones by the end of the day. I’m super excited to use the 34B Python 4 bit quantized one that should just fit on a 3090. [1] https://huggingface.co/TheBloke/CodeLlama-13B-Python-fp16

Ollama supports it already: `ollama run codellama:7b-instruct` https://ollama.ai/blog/run-code-llama-locally More models uploaded as we speak: https://ollama.ai/library/codellama

I'm testing it on my M2 Air (16GB). Quite fast!

Re: Code Llama, a state-of-the-art large language model for coding

#304

Post by int_19h »

brucethemoose2 wrote: post #50
ynniv wrote: post #40

Earlier quoted context omitted.

Every time a new model hits I'm waiting for his ggmls

ggml quantization is very easy with the official llama.cpp repo. Its quick and mostly dependency free, and you can pick the perfect size for your CPU/GPU pool. But don't get me wrong, TheBloke is a hero.

While we're at it, the GGML file format has been deprecated in favor of GGUF.

https://github.com/philpax/ggml/blob/gguf-spec/docs/gguf.md

https://github.com/ggerganov/llama.cpp/pull/2398

Re: Code Llama, a state-of-the-art large language model for coding

#305

Post by swader999 »

mymac wrote: post #132
ttul wrote: post #130

Earlier quoted context omitted.

That’s just one perspective… Another perspective is that LLMs enable programmers to skip a lot of the routine and boring aspects of coding - looking up stuff, essentially - so they can focus on the fun parts that engage creativity.

But it won't stop there. Why would it stop at some arbitrarily defined boundary? The savings associated with no longer having to pay programmers the amounts of money that they believe they are worth (high enough to result in collusion between employers) are just too tempting.

The answer to AI stealing your job is to go ahead and start a company, solve a hard problem, sell the solution and leverage AI to do this.

Re: Code Llama, a state-of-the-art large language model for coding

#306

Post by nvm0n2 »

lordnacho wrote: post #128

Copilot has been working great for me thus far, but it's limited by its interface. It seems like it only knows how to make predictions for the next bit of text. Is anyone working on a code AI that can suggest refactorings? "You should pull these lines into a function, it's repetitive" "You should change this structure so it is easier to use" Etc

Neither of those tasks require AI. IntelliJ IDEA will happily suggest both for you today, locally. It can find large chunks of duplicated code and automatically refactor them out to functions for you. And it has many inspections that suggest refactorings to make code clearer.

Re: Code Llama, a state-of-the-art large language model for coding

#307

Post by int_19h »

dangerwill wrote: post #103

It's really sad how everyone here is fawning over tech that will destroy you own livelihoods. "AI won't take your job, those who use AI will" is purely short term, myopic thinking. These tools are not aimed to help workers, the end goal is to make it so you don't need to be an engineer to build software, just let the project manager or director describe the system they want and boom there it is. You can scream that t…

Any improvement in tooling benefits capital owners the most, since the productivity gains mostly end up in their pockets.

But the answer to that is to deal with concentration of capital, not to eschew better tools.

Re: Code Llama, a state-of-the-art large language model for coding

#308

Post by Paradigma11 »

tyre wrote: post #64
vessenes wrote: post #34

Earlier quoted context omitted.

They are behind commercially, very behind. They also don't have the same economic setup and DNA as MS/OpenAI. Large corporate customers don't pay for access to the FB cloud, nor are they likely to -- Ellison has spent years building out Oracle Cloud, and he's on the FB board, for example. And I bet you didn't think of using Oracle's Cloud for your last project. So, your company DNA is free-to-all social based on ad m…

I don’t believe they’re going for the same hosted monetization as Oracle or Google. I’m sure they’ll play around with assistant AIs but you can imagine them leveraging their graph and data for this. Who is better positioned to answer a question like, “What should I get my friend Sophia for her birthday?” Facebook/Instagram already have huge volumes of data to specifically target ads. They can feed those into a chat i…

Medication for her new std?

Re: Code Llama, a state-of-the-art large language model for coding

#309

Post by [deleted] »

bbor wrote: post #109
coder543 wrote: post #26

Earlier quoted context omitted.

You've already downloaded and thoroughly tested the 7B parameter model of "code llama"? I'm skeptical.

It was made available internally, I believe. So this is one of the many Meta engineers on this site —- after all, Facebook is now less hated than Google here ;)

[deleted]

Re: Code Llama, a state-of-the-art large language model for coding

#310

Post by ShamelessC »

ilaksh wrote: post #20

Between this, ideogram.ai (image generator which can spell, from former Google Imagen team member and others), and ChatGPT fine-tuning, this has been a truly epic week. I would argue that many teams will have to reevaluate their LLM strategy _again_ for the second time in a week.

Did ideogram release a checkpoint?
Post reply on HN