theBloke cannot rest :)
Code Llama, a state-of-the-art large language model for coding
21–30 of 525 posts
Re: Code Llama, a state-of-the-art large language model for coding
#22Does anyone have a good explanation for Meta's strategy with AI? The only thing I've been able to think is they're trying to commoditize this new category before Microsoft and Google can lock it in, but where to from there? Is it just to block the others from a new revenue source, or do they have a longer game they're playing?
If you watch the Connect talks, I'll be speaking about this..
Sorry—who are you and what are the Connect talks? I haven't heard of them and you don't have a bio.
Re: Code Llama, a state-of-the-art large language model for coding
#23It appears we do have a 34B version now, which never appeared for non fine tuned llama 2.
It would be interesting to understand if a ~30B Llama-2 model would be interesting and for what reasons.
Llama 34B is just big enough to fit on a 24GB consumer (or affordable server) GPU.
Its also just the right size for llama.cpp inference on machines with 32GB RAM, or 16GB RAM with a 8GB+ GPU.
Basically its the most desirable size for AI finetuning hobbyists, and the quality jump from llama v1 13B to llama v1 33B is huge.
Re: Code Llama, a state-of-the-art large language model for coding
#24Even the 7B model of code llama seems to be competitive with Codex, the model behind copilot https://ai.meta.com/blog/code-llama-large-language-model-cod...
>Even the 7B model of code llama seems to be competitive with Codex, the model behind copilot
It's extremely good. I keep a terminal tab open with 7b running for all of my "how do I do this random thing" questions while coding. It's pretty much replaced Google/SO for me.
Re: Code Llama, a state-of-the-art large language model for coding
#25Earlier quoted context omitted.
If you watch the Connect talks, I'll be speaking about this..
Sorry—who are you and what are the Connect talks? I haven't heard of them and you don't have a bio.
I guess that's what he is referring to: https://www.linkedin.com/posts/jspisak_home-fully-connected-...
Re: Code Llama, a state-of-the-art large language model for coding
#26Even the 7B model of code llama seems to be competitive with Codex, the model behind copilot https://ai.meta.com/blog/code-llama-large-language-model-cod...
>Even the 7B model of code llama seems to be competitive with Codex, the model behind copilot It's extremely good. I keep a terminal tab open with 7b running for all of my "how do I do this random thing" questions while coding. It's pretty much replaced Google/SO for me.
You've already downloaded and thoroughly tested the 7B parameter model of "code llama"? I'm skeptical.
Re: Code Llama, a state-of-the-art large language model for coding
#27Code llama Python is very interesting. Specifically tuned for Python. I wonder if we could make such specific LLMs (one that is proficient in all things Rust, another- all things Linux, all things genomics, all things physics modeling etc) and have them talk to each other to collaboratively solve problems. That would be a crazy future thing! Putting machines truly to work..
I think this is called "mixture of experts" and also there's a lot of speculation that it's how GPT-4 works, although probably with just a few large models rather than many small ones.
Re: Code Llama, a state-of-the-art large language model for coding
#28Can I feed this entire GitHub projects (of reasonable size) and get non-hallucinated up-to-date API refactoring recommendations?
Re: Code Llama, a state-of-the-art large language model for coding
#29Does anyone have a good explanation for Meta's strategy with AI? The only thing I've been able to think is they're trying to commoditize this new category before Microsoft and Google can lock it in, but where to from there? Is it just to block the others from a new revenue source, or do they have a longer game they're playing?
If you watch the Connect talks, I'll be speaking about this..
what is that?
Re: Code Llama, a state-of-the-art large language model for coding
#30Does anyone have a good explanation for Meta's strategy with AI? The only thing I've been able to think is they're trying to commoditize this new category before Microsoft and Google can lock it in, but where to from there? Is it just to block the others from a new revenue source, or do they have a longer game they're playing?
Maybe Meta is waking up to the endgame of humanity and has decided to stop playing the old game? Who knows :)
Maybe Meta think it can increase the stock price by claiming 40 billion avatars are real friends...