Even the 7B model of code llama seems to be competitive with Codex, the model behind copilot
https://ai.meta.com/blog/code-llama-large-language-model-cod...
Code Llama, a state-of-the-art large language model for coding
11–20 of 525 posts
Re: Code Llama, a state-of-the-art large language model for coding
#12Code llama Python is very interesting. Specifically tuned for Python. I wonder if we could make such specific LLMs (one that is proficient in all things Rust, another- all things Linux, all things genomics, all things physics modeling etc) and have them talk to each other to collaboratively solve problems. That would be a crazy future thing! Putting machines truly to work..
[deleted]
Re: Code Llama, a state-of-the-art large language model for coding
#13It appears we do have a 34B version now, which never appeared for non fine tuned llama 2.
It would be interesting to understand if a ~30B Llama-2 model would be interesting and for what reasons.
Re: Code Llama, a state-of-the-art large language model for coding
#14Is there any place we can try those models? Are they available on HuggingFace?
Partner integrations will follow. For now we just have the weights available.
But don't worry, this community moves fast!
Re: Code Llama, a state-of-the-art large language model for coding
#15Here is the paper:
https://ai.meta.com/research/publications/code-llama-open-fo...
Re: Code Llama, a state-of-the-art large language model for coding
#16Re: Code Llama, a state-of-the-art large language model for coding
#17Does anyone have a good explanation for Meta's strategy with AI? The only thing I've been able to think is they're trying to commoditize this new category before Microsoft and Google can lock it in, but where to from there? Is it just to block the others from a new revenue source, or do they have a longer game they're playing?
Probably just talent acquisition. As Google and OpenAI start sharing and publishing less, they become less attractive to scientists. No scientist wants to fall into a black hole and not publish for 8 years.
Re: Code Llama, a state-of-the-art large language model for coding
#18Does anyone have a good explanation for Meta's strategy with AI? The only thing I've been able to think is they're trying to commoditize this new category before Microsoft and Google can lock it in, but where to from there? Is it just to block the others from a new revenue source, or do they have a longer game they're playing?
Maybe Meta is waking up to the endgame of humanity and has decided to stop playing the old game? Who knows :)
Re: Code Llama, a state-of-the-art large language model for coding
#19Does anyone have a good explanation for Meta's strategy with AI? The only thing I've been able to think is they're trying to commoditize this new category before Microsoft and Google can lock it in, but where to from there? Is it just to block the others from a new revenue source, or do they have a longer game they're playing?
Retention project to keep their top ML/AI staff engaged and not straying away?
Working towards NLU that can solve content moderation once and for all? Contrast with tiktok which is clearly using word filters that are easily worked around with phrases like "un-alived" or "corn".
They want to replace influencers and your friends with chatbots and keep you scrolling through an infinite feed of ads and AI generated content?
Re: Code Llama, a state-of-the-art large language model for coding
#20Between this, ideogram.ai (image generator which can spell, from former Google Imagen team member and others), and ChatGPT fine-tuning, this has been a truly epic week.
I would argue that many teams will have to reevaluate their LLM strategy _again_ for the second time in a week.