Earlier quoted context omitted.
One.
Two when you include -2, which I certainly think we should in this circumstance.
Negatives are not prime.
Code Llama, a state-of-the-art large language model for coding
441–450 of 525 posts
Re: Code Llama, a state-of-the-art large language model for coding
#442what is the cutoff knowledge of it? Also, what is the cheapest way to use it if I'm building a commercial tool on top of it?
Re: Code Llama, a state-of-the-art large language model for coding
#443Works nearly out of the box with llama.cpp, which makes it easy to try locally: https://github.com/ggerganov/llama.cpp/issues/2766 Here's some output from q4_0 quantization of CodeLlama-7b-Python (first four lines are the prompt): # prints the first ten prime numbers def print_primes(): i = 2 num_printed = 0 # end of prompt while num_printed It will be interesting to see how the larger models perform, especially afte…
I'd fail an interview candidate that suggested adding 1 each time for subsequent prime testing
You'd reject a candidate that is willing and legally able to work for free while also cloning themselves so they can pair program with every one of your employees at once?
Re: Code Llama, a state-of-the-art large language model for coding
#444Earlier quoted context omitted.
I'd fail an interview candidate that suggested adding 1 each time for subsequent prime testing
> "I'd fail an interview candidate that suggested adding 1 each time for subsequent prime testing" Congratulations! You must be that arrogant guy everybody hates interviewing with, the one with the superiority complex. How about instead of just failing people over literally nothing (wasting everybody's time and money) - just ask the candidate whether they could somehow reduce the search space by utilizing the propert…
Downvoting this is not enough. I'd pay $5 (reddit style) to have this properly killfiled if HN allowed for that. Besides, not "everybody hates them, only those inmature enough to still need intellectual babysitting.
Re: Code Llama, a state-of-the-art large language model for coding
#445Works nearly out of the box with llama.cpp, which makes it easy to try locally: https://github.com/ggerganov/llama.cpp/issues/2766 Here's some output from q4_0 quantization of CodeLlama-7b-Python (first four lines are the prompt): # prints the first ten prime numbers def print_primes(): i = 2 num_printed = 0 # end of prompt while num_printed It will be interesting to see how the larger models perform, especially afte…
For printing the first 10 prime numbers, there's a one line solution to this problem: print("1, 2, 3, 5, 7, 11... and so on!
That can't be, because primes are numbers greater than 1.
Re: Code Llama, a state-of-the-art large language model for coding
#446>The Code Llama models provide stable generations with up to 100,000 tokens of context. Not a bad context window, but makes me wonder how embedded code models would pick that context when dealing with a codebase larger than 100K tokens. And this makes me further wonder if, when coding with such a tool (or at least a knowledge that they’re becoming more widely used and leaned on), are there some new considerations tha…
> Not a bad context
A little understated, this is state of the art. GPT-4 only offers 32k.
Re: Code Llama, a state-of-the-art large language model for coding
#447Works nearly out of the box with llama.cpp, which makes it easy to try locally: https://github.com/ggerganov/llama.cpp/issues/2766 Here's some output from q4_0 quantization of CodeLlama-7b-Python (first four lines are the prompt): # prints the first ten prime numbers def print_primes(): i = 2 num_printed = 0 # end of prompt while num_printed It will be interesting to see how the larger models perform, especially afte…
I'd fail an interview candidate that suggested adding 1 each time for subsequent prime testing
[deleted]
Re: Code Llama, a state-of-the-art large language model for coding
#448Earlier quoted context omitted.
I'd fail an interview candidate that suggested adding 1 each time for subsequent prime testing
Finally we meet the lifeless drone that everybody complains about in the interviews. My suggestion for your next interview: decide to hire them just based on their leetcode score, but invite to the interview just to flex that you're still better at puzzle solving :-D Perfect
"Use and optimize for runtime."
"solution begins with ".
Copy solution from gpt, paste in leetcode, run, submit.
"faster"
Repeat.
Repeat.
Next question.
Re: Code Llama, a state-of-the-art large language model for coding
#449Earlier quoted context omitted.
But it won't stop there. Why would it stop at some arbitrarily defined boundary? The savings associated with no longer having to pay programmers the amounts of money that they believe they are worth (high enough to result in collusion between employers) are just too tempting.
Okay, think about it this way. This thing helps generate tons and tons of code. The more code people (or this thing) writes, the more shit there is to debug. More and more code, each calling each other means more and more insane bugs. We’re going to move from debugging some crap the last developer wrote to debugging an order of magnitude more code the last developer generated. It’s going to be wonderful for job prosp…
Until AI figures out debugging
Re: Code Llama, a state-of-the-art large language model for coding
#450Earlier quoted context omitted.
>Even the 7B model of code llama seems to be competitive with Codex, the model behind copilot It's extremely good. I keep a terminal tab open with 7b running for all of my "how do I do this random thing" questions while coding. It's pretty much replaced Google/SO for me.
What hardware do you have that lets you run 7b and do other stuff at the same time?
A 7B model at 8-bit quantization takes up 7 GB of RAM. Less if you use a 6-bit quantization, which is nearly as good. Otherwise it's just a question of having enough system RAM and CPU cores, plus maybe a small discrete GPU.