Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Code Llama, a state-of-the-art large language model for coding

ai.meta.com

Post reply on HN
Print view View original

101–110 of 525 posts

Re: Code Llama, a state-of-the-art large language model for coding

#101

Post by roughly »

cvhashim04 wrote: post #88
tyre wrote: post #64

Earlier quoted context omitted.

I don’t believe they’re going for the same hosted monetization as Oracle or Google. I’m sure they’ll play around with assistant AIs but you can imagine them leveraging their graph and data for this. Who is better positioned to answer a question like, “What should I get my friend Sophia for her birthday?” Facebook/Instagram already have huge volumes of data to specifically target ads. They can feed those into a chat i…

> Who is better positioned to answer a question like, “What should I get my friend Sophia for her birthday?” Facebook/Instagram already have huge volumes of data to specifically target ads. They can feed those into a chat interface pretty easily. Interesting idea but sounds risky and intrusive in practice.

> Interesting idea but sounds risky and intrusive in practice.

That’s pretty much the entire Meta empire in a single sentence.

Re: Code Llama, a state-of-the-art large language model for coding

#102

Post by GreedClarifies »

roughly wrote: post #99
benvolio wrote: post #51

>The Code Llama models provide stable generations with up to 100,000 tokens of context. Not a bad context window, but makes me wonder how embedded code models would pick that context when dealing with a codebase larger than 100K tokens. And this makes me further wonder if, when coding with such a tool (or at least a knowledge that they’re becoming more widely used and leaned on), are there some new considerations tha…

I’ve found the utility of the coding LLMs gets a lot higher when you’ve got code comments and descriptive variable and function names - the LLM makes better inferences and suggestions. We’ve seen similar on data - properly tagged data and descriptive field names helps the LLM to produce much more useful responses. I’m secretly hoping the spread of these tools will finally lead my fellow developers to comment their co…

Commenting the code in this manner sounds like a job for an LLM, maybe with human assistance in the short run.

Re: Code Llama, a state-of-the-art large language model for coding

#103

Post by dangerwill »

It's really sad how everyone here is fawning over tech that will destroy you own livelihoods. "AI won't take your job, those who use AI will" is purely short term, myopic thinking. These tools are not aimed to help workers, the end goal is to make it so you don't need to be an engineer to build software, just let the project manager or director describe the system they want and boom there it is.

You can scream that this is progress all you want, and I'll grant you that these tools will greatly speed up the generation of code. But more code won't make any of these businesses provide better services to people, lower their prices, or pay workers more. They are just a means to keep money from flowing out of the hands of the C-Suite and investor classes.

If software engineering becomes a solved problem then fine, we probably shouldn't continue to get paid huge salaries to write it anymore, but please stop acting like this is a better future for any of us normal folks.

Re: Code Llama, a state-of-the-art large language model for coding

#104

Post by hiatus »

cvhashim04 wrote: post #88
tyre wrote: post #64

Earlier quoted context omitted.

I don’t believe they’re going for the same hosted monetization as Oracle or Google. I’m sure they’ll play around with assistant AIs but you can imagine them leveraging their graph and data for this. Who is better positioned to answer a question like, “What should I get my friend Sophia for her birthday?” Facebook/Instagram already have huge volumes of data to specifically target ads. They can feed those into a chat i…

> Who is better positioned to answer a question like, “What should I get my friend Sophia for her birthday?” Facebook/Instagram already have huge volumes of data to specifically target ads. They can feed those into a chat interface pretty easily. Interesting idea but sounds risky and intrusive in practice.

I think this suggestion lacks subtlety. More likely, around the time leading up to Sophia's birthday, you will see more ads for things (maybe even gift idea ads) that just so happen to be things Sophia would love (at least, according to their data).

Re: Code Llama, a state-of-the-art large language model for coding

#105

Post by rvnx »

megaman821 wrote: post #17
lolinder wrote: post #7

Does anyone have a good explanation for Meta's strategy with AI? The only thing I've been able to think is they're trying to commoditize this new category before Microsoft and Google can lock it in, but where to from there? Is it just to block the others from a new revenue source, or do they have a longer game they're playing?

Probably just talent acquisition. As Google and OpenAI start sharing and publishing less, they become less attractive to scientists. No scientist wants to fall into a black hole and not publish for 8 years.

The problem is also companies bragging about AI, but not releasing anything behind (like most of the recent Google announcements).

If nobody except the researcher can reproduce an AI paper, and there is no source-code, and no demos that the public can access, then it's almost like if it doesn't exist.

I wouldn't want to work in a company that would throw away my research and just use it for PR purposes.

Re: Code Llama, a state-of-the-art large language model for coding

#106

Post by roughly »

vessenes wrote: post #34
lolinder wrote: post #7

Does anyone have a good explanation for Meta's strategy with AI? The only thing I've been able to think is they're trying to commoditize this new category before Microsoft and Google can lock it in, but where to from there? Is it just to block the others from a new revenue source, or do they have a longer game they're playing?

They are behind commercially, very behind. They also don't have the same economic setup and DNA as MS/OpenAI. Large corporate customers don't pay for access to the FB cloud, nor are they likely to -- Ellison has spent years building out Oracle Cloud, and he's on the FB board, for example. And I bet you didn't think of using Oracle's Cloud for your last project. So, your company DNA is free-to-all social based on ad m…

That’s interesting. I tend to lump FB, Amazon, Google, and MS in my head when thinking about the tech giants, but you’re right, FB is the only one of those not offering a commercial platform. For them, building out the capabilities of the LLMs is something to be done in the open with community involvement, because they’re not going to monetize the models themselves.

They’re also getting a fantastic amount of press from all this, which is good for attracting talent and helping improve their image, at least among the nerd set.

Re: Code Llama, a state-of-the-art large language model for coding

#107

Post by redox99 »

modeless wrote: post #8

Interesting that there's a 34B model. That was missing from the original Llama 2 release. I wonder if it's still usable for general non-code chat tasks or if the code fine tuning destroyed that. It should be the best model that would still fit on 24GB gaming GPUs with quantization, because 70B doesn't fit.

I can't imagine it being better than Llama1 33B, after all this code finetuning.

Re: Code Llama, a state-of-the-art large language model for coding

#108

Post by BryanLegend »

nologic01 wrote: post #91
lolinder wrote: post #7

Does anyone have a good explanation for Meta's strategy with AI? The only thing I've been able to think is they're trying to commoditize this new category before Microsoft and Google can lock it in, but where to from there? Is it just to block the others from a new revenue source, or do they have a longer game they're playing?

Clearly the research team at Meta knows the domain as well anybody, has access to a data trove as large as anybody and their distribution capability is as large scale as anyone's. If their choice right now is not to try to overtly monetize these capabilities but instead commoditize and "democratize" what others are offering it suggests they think that a proprietary monetization route is not available to them. In othe…

Facebook could sure use the good will. They are winning plenty of mine here.

Re: Code Llama, a state-of-the-art large language model for coding

#109

Post by bbor »

coder543 wrote: post #26
ramesh31 wrote: post #24

Earlier quoted context omitted.

>Even the 7B model of code llama seems to be competitive with Codex, the model behind copilot It's extremely good. I keep a terminal tab open with 7b running for all of my "how do I do this random thing" questions while coding. It's pretty much replaced Google/SO for me.

You've already downloaded and thoroughly tested the 7B parameter model of "code llama"? I'm skeptical.

It was made available internally, I believe. So this is one of the many Meta engineers on this site —- after all, Facebook is now less hated than Google here ;)

Re: Code Llama, a state-of-the-art large language model for coding

#110

Post by tomr75 »

ilaksh wrote: post #61
naillo wrote: post #47

Feels like we're like a year away from local LLMs that can debug code reliably (via being hooked into console error output as well) which will be quite the exciting day.

Have you tried Code Llama? How do you know it can't do it already? In my applications, GPT-4 connected to a VM or SQL engine can and does debug code when given error messages. "Reliably" is very subjective. The main problem I have seen is that it can be stubborn about trying to use outdated APIs and it's not easy to give it a search result with the correct API. But with a good web search and up to date APIs, it can d…

Have you tried giving up to date apis as context?
Post reply on HN