Code Llama, a state-of-the-art large language model for coding
1–10 of 525 posts
Re: Code Llama, a state-of-the-art large language model for coding
#2In your opinion, Why Meta does this?
Re: Code Llama, a state-of-the-art large language model for coding
#3Looks like that we need to request the access first
Re: Code Llama, a state-of-the-art large language model for coding
#4Code llama Python is very interesting. Specifically tuned for Python.
I wonder if we could make such specific LLMs (one that is proficient in all things Rust, another- all things Linux, all things genomics, all things physics modeling etc) and have them talk to each other to collaboratively solve problems.
That would be a crazy future thing! Putting machines truly to work..
Re: Code Llama, a state-of-the-art large language model for coding
#5Is there any place we can try those models? Are they available on HuggingFace?
Re: Code Llama, a state-of-the-art large language model for coding
#6It appears we do have a 34B version now, which never appeared for non fine tuned llama 2.
Re: Code Llama, a state-of-the-art large language model for coding
#7Does anyone have a good explanation for Meta's strategy with AI?
The only thing I've been able to think is they're trying to commoditize this new category before Microsoft and Google can lock it in, but where to from there? Is it just to block the others from a new revenue source, or do they have a longer game they're playing?
Re: Code Llama, a state-of-the-art large language model for coding
#8Interesting that there's a 34B model. That was missing from the original Llama 2 release. I wonder if it's still usable for general non-code chat tasks or if the code fine tuning destroyed that. It should be the best model that would still fit on 24GB gaming GPUs with quantization, because 70B doesn't fit.
Re: Code Llama, a state-of-the-art large language model for coding
#9Code llama Python is very interesting. Specifically tuned for Python. I wonder if we could make such specific LLMs (one that is proficient in all things Rust, another- all things Linux, all things genomics, all things physics modeling etc) and have them talk to each other to collaboratively solve problems. That would be a crazy future thing! Putting machines truly to work..
If you can find a large body of good, permissively licensed example code, you can finetune an LLM on it!
There was a similar attempt for Godot script trained a few months ago, and its reportedly pretty good:
https://github.com/minosvasilias/godot-dodo
I think more attempts havent been made because base llama is not that great at coding in general, relative to its other strengths, and stuff like Starcoder has flown under the radar.
Re: Code Llama, a state-of-the-art large language model for coding
#10Does anyone have a good explanation for Meta's strategy with AI? The only thing I've been able to think is they're trying to commoditize this new category before Microsoft and Google can lock it in, but where to from there? Is it just to block the others from a new revenue source, or do they have a longer game they're playing?
If you watch the Connect talks, I'll be speaking about this..