Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Code Llama, a state-of-the-art large language model for coding

ai.meta.com

Post reply on HN
Print view View original

81–90 of 525 posts

Re: Code Llama, a state-of-the-art large language model for coding

#81

Post by hn_20591249 »

gaogao wrote: post #75
morkalork wrote: post #19

Earlier quoted context omitted.

Retention project to keep their top ML/AI staff engaged and not straying away? Working towards NLU that can solve content moderation once and for all? Contrast with tiktok which is clearly using word filters that are easily worked around with phrases like "un-alived" or "corn". They want to replace influencers and your friends with chatbots and keep you scrolling through an infinite feed of ads and AI generated conte…

A lot of top ML/AI talent has already bailed too, so some of it is probably them trying to keep open research closer to SOTA.

There has been some shuffling of seats but from what I am hearing FAIR is the best setup as far as staffing and funding that they have been in quite some time. Mark is pivoting hard to stay competitive in AI and is providing the resourcing to do so, the results speak for themselves.

Re: Code Llama, a state-of-the-art large language model for coding

#82

Post by brandall10 »

tyre wrote: post #57
coder543 wrote: post #46

Earlier quoted context omitted.

Yes, that's not a response to my comment. No one who has been using any model for just the past 30 minutes would say that it has "pretty much replaced Google/SO" for them, unless they were being facetious.

They said 7b llama which I read as the base LLaMa model, not this one specifically. All of these LLMs are trained on Stack Overflow so it makes sense that they’d be good out of the box.

The top level comment is specifically citing performance of code llama against codex.

Re: Code Llama, a state-of-the-art large language model for coding

#83

Post by adamgordonbell »

benvolio wrote: post #51

>The Code Llama models provide stable generations with up to 100,000 tokens of context. Not a bad context window, but makes me wonder how embedded code models would pick that context when dealing with a codebase larger than 100K tokens. And this makes me further wonder if, when coding with such a tool (or at least a knowledge that they’re becoming more widely used and leaned on), are there some new considerations tha…

Solutions exist that feed LLMS ctags, and seem to work well. The function signatures and symbols names for a code base are much smaller than the actual code.

Re: Code Llama, a state-of-the-art large language model for coding

#84

Post by [deleted] »

coder543 wrote: post #46
realce wrote: post #44

Earlier quoted context omitted.

Just sign up at meta and you'll get an email link in like 5 minutes

Yes, that's not a response to my comment. No one who has been using any model for just the past 30 minutes would say that it has "pretty much replaced Google/SO" for them, unless they were being facetious.

[deleted]

Re: Code Llama, a state-of-the-art large language model for coding

#86

Post by brucethemoose2 »

gabereiser wrote: post #74
brucethemoose2 wrote: post #59

Earlier quoted context omitted.

This sounds like a job for middleware. Condensing split code into a single huge file, shortening comments, removing whitespace and such can be done by a preprocessor for the llm.

So now we need an llmpack like we did webpack? Could it be smart enough to truncate comments, white space, etc?

You dont even need an llm for trimming whitespace, just a smart parser with language rules like ide code checkers already use. Existing llms are fine at summarizing comments, especially with language specific grammar constraints.

Re: Code Llama, a state-of-the-art large language model for coding

#87

Post by brandall10 »

lolinder wrote: post #7

Does anyone have a good explanation for Meta's strategy with AI? The only thing I've been able to think is they're trying to commoditize this new category before Microsoft and Google can lock it in, but where to from there? Is it just to block the others from a new revenue source, or do they have a longer game they're playing?

On Lex Fridman, Mark said the strategy is to attract talent while keeping the playing field level (not a fan of big tech moating this up).

Re: Code Llama, a state-of-the-art large language model for coding

#88

Post by cvhashim04 »

tyre wrote: post #64
vessenes wrote: post #34

Earlier quoted context omitted.

They are behind commercially, very behind. They also don't have the same economic setup and DNA as MS/OpenAI. Large corporate customers don't pay for access to the FB cloud, nor are they likely to -- Ellison has spent years building out Oracle Cloud, and he's on the FB board, for example. And I bet you didn't think of using Oracle's Cloud for your last project. So, your company DNA is free-to-all social based on ad m…

I don’t believe they’re going for the same hosted monetization as Oracle or Google. I’m sure they’ll play around with assistant AIs but you can imagine them leveraging their graph and data for this. Who is better positioned to answer a question like, “What should I get my friend Sophia for her birthday?” Facebook/Instagram already have huge volumes of data to specifically target ads. They can feed those into a chat i…

> Who is better positioned to answer a question like, “What should I get my friend Sophia for her birthday?” Facebook/Instagram already have huge volumes of data to specifically target ads. They can feed those into a chat interface pretty easily.

Interesting idea but sounds risky and intrusive in practice.

Re: Code Llama, a state-of-the-art large language model for coding

#89

Post by azeirah »

politelemon wrote: post #69
lolinder wrote: post #7

Does anyone have a good explanation for Meta's strategy with AI? The only thing I've been able to think is they're trying to commoditize this new category before Microsoft and Google can lock it in, but where to from there? Is it just to block the others from a new revenue source, or do they have a longer game they're playing?

> Microsoft But they're a partner in Llama too. Why is Microsoft in this space too, how do they benefit?

Microsoft is a hosting partner, there's an Azure service for hosted private LLaMa inference for business. Being a go-to hosting provider for SoTA AI is of course a very good thing for Microsoft.

Re: Code Llama, a state-of-the-art large language model for coding

#90

Post by brucethemoose2 »

ynniv wrote: post #68
brucethemoose2 wrote: post #50

Earlier quoted context omitted.

ggml quantization is very easy with the official llama.cpp repo. Its quick and mostly dependency free, and you can pick the perfect size for your CPU/GPU pool. But don't get me wrong, TheBloke is a hero.

Some of the newer models have slightly different architectures, so he explains any differences and shows a llama.cpp invocation. Plus you can avoid pulling the larger dataset.

Yeah. Keeping up wkth the changes is madness, and those FP16 weights are huge.
Post reply on HN