Live data from Hacker News

Code Llama, a state-of-the-art large language model for coding

ai.meta.com

231–240 of 525 posts

Re: Code Llama, a state-of-the-art large language model for coding

#231
post #216

Earlier quoted context omitted.

Well look for yourself: https://g.co/bard/share/e8d14854ccab The rm answer is now "hardcoded" (aka, manually entered by reviewers), the same with the prime or fibonnaci. This is why we both see the same code across different accounts (you can make the test if you are curious).

Okay, so the entire point of the comment is "A current model which does well used to be bad!" With all due respect, is that a valuable thing to say? Isn't it true of them all?

[deleted]

Re: Code Llama, a state-of-the-art large language model for coding

#232
post #125

It's really sad how everyone here is fawning over tech that will destroy you own livelihoods. "AI won't take your job, those who use AI will" is purely short term, myopic thinking. These tools are not aimed to help workers, the end goal is to make it so you don't need to be an engineer to build software, just let the project manager or director describe the system they want and boom there it is. You can scream that t…

We have three options, IMO: 1. As a species decide to never build another LLM, ever. 2. Change the path of society from the unequal, capitalist one it’s taken the last 2-300 years. 3. Give up I know which I believe in :). Do you disagree?

Finish #2 first, or else people with access to more money and infrastructure will use LLMs to increase inequality even further.

Re: Code Llama, a state-of-the-art large language model for coding

#233

TheBloke doesn’t joke around [1]. I’m guessing we’ll have the quantized ones by the end of the day. I’m super excited to use the 34B Python 4 bit quantized one that should just fit on a 3090. [1] https://huggingface.co/TheBloke/CodeLlama-13B-Python-fp16

Ollama supports it already: `ollama run codellama:7b-instruct` https://ollama.ai/blog/run-code-llama-locally More models uploaded as we speak: https://ollama.ai/library/codellama

while it supports it, so far I've only managed to get infinite streams of near nonsense from the ollama models (codellama:7b-q4_0 and codellama:latest)

my questions were asking how to construct an indexam for postgres in c, how to write an r-tree in javascript, and how to write a binary tree in javascript.

Re: Code Llama, a state-of-the-art large language model for coding

#234

Earlier quoted context omitted.

Ollama supports it already: `ollama run codellama:7b-instruct` https://ollama.ai/blog/run-code-llama-locally More models uploaded as we speak: https://ollama.ai/library/codellama

while it supports it, so far I've only managed to get infinite streams of near nonsense from the ollama models (codellama:7b-q4_0 and codellama:latest) my questions were asking how to construct an indexam for postgres in c, how to write an r-tree in javascript, and how to write a binary tree in javascript.

Similarly, I had it emit hundreds of blank lines before cancelling it.

Re: Code Llama, a state-of-the-art large language model for coding

#236
Works nearly out of the box with llama.cpp, which makes it easy to try locally: https://github.com/ggerganov/llama.cpp/issues/2766

Here's some output from q4_0 quantization of CodeLlama-7b-Python (first four lines are the prompt):

    # prints the first ten prime numbers 
    def print_primes(): 
        i = 2 
        num_printed = 0 # end of prompt
        while num_printed 
It will be interesting to see how the larger models perform, especially after community tuning and with better context/prompting.

Re: Code Llama, a state-of-the-art large language model for coding

#237

Earlier quoted context omitted.

Ollama supports it already: `ollama run codellama:7b-instruct` https://ollama.ai/blog/run-code-llama-locally More models uploaded as we speak: https://ollama.ai/library/codellama

while it supports it, so far I've only managed to get infinite streams of near nonsense from the ollama models (codellama:7b-q4_0 and codellama:latest) my questions were asking how to construct an indexam for postgres in c, how to write an r-tree in javascript, and how to write a binary tree in javascript.

Same, just tried it and it would give me infinite amount of blank lines

Re: Code Llama, a state-of-the-art large language model for coding

#238

How are people using these local code models? I would much prefer using these in-context in an editor, but most of them seem to be deployed just in an instruction context. There's a lot of value to not having to context switch, or have a conversation. I see the GitHub copilot extensions gets a new release one every few days, so is it just that the way they're integrated is more complicated so not worth the effort?

You can use Continue as a drop-in replacement for Copilot Chat with Code Llama. We've released a short tutorial here: https://continue.dev/docs/walkthroughs/codellama. It should save you a lot of time context-switching; you can just highlight code and ask questions or make edits, all with keyboard shortcuts

Re: Code Llama, a state-of-the-art large language model for coding

#239

TheBloke doesn’t joke around [1]. I’m guessing we’ll have the quantized ones by the end of the day. I’m super excited to use the 34B Python 4 bit quantized one that should just fit on a 3090. [1] https://huggingface.co/TheBloke/CodeLlama-13B-Python-fp16

Ollama supports it already: `ollama run codellama:7b-instruct` https://ollama.ai/blog/run-code-llama-locally More models uploaded as we speak: https://ollama.ai/library/codellama

Isn't ollama terminal only? For code, that wouldn't be good.

Re: Code Llama, a state-of-the-art large language model for coding

#240

Earlier quoted context omitted.

Ollama supports it already: `ollama run codellama:7b-instruct` https://ollama.ai/blog/run-code-llama-locally More models uploaded as we speak: https://ollama.ai/library/codellama

while it supports it, so far I've only managed to get infinite streams of near nonsense from the ollama models (codellama:7b-q4_0 and codellama:latest) my questions were asking how to construct an indexam for postgres in c, how to write an r-tree in javascript, and how to write a binary tree in javascript.

still modifying the code completion (foundation / python models) to see what's causing the behavior.

Have had some good success with the instruct model:

codellama:7b-instruct

Post reply on HN