Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Code Llama, a state-of-the-art large language model for coding

ai.meta.com

Post reply on HN
Print view View original

341–350 of 525 posts

Re: Code Llama, a state-of-the-art large language model for coding

#341

Post by thewataccount »

alsobrsp wrote: post #338
Someone1234 wrote: post #315

Business opportunity: I'd pay money for NICE desktop software that can run all these different models (non-subscription, "2-year updates included, then discount pricing" modal perhaps). My wishlist: - Easy plug & play model installation, and trivial to change which model once installed. - Runs a local web server, so I can interact with it via any browser - Ability to feed a model a document or multiple documents and…

I have been using refact.ai on my laptop, it has been quite good. https://github.com/smallcloudai/refact/blob/main/README.md

Refact has worked for me. Hopefully exllama will support CodeLlama.

Re: Code Llama, a state-of-the-art large language model for coding

#342

Post by blibble »

jpeterson wrote: post #325
blibble wrote: post #284

Earlier quoted context omitted.

it's not that though, there's several other typical optimisations in there just not the super obvious one that demonstrates extremely basic understanding of what a prime number is

Having "extremely basic understanding" of prime numbers immediately at one's command is important for approximately 0% of software engineering jobs. If you instant-fail a candidate for this, it says a lot more about you and your organization than the candidate.

> If you instant-fail a candidate for this, it says a lot more about you and your organization than the candidate.

yes, we expect professional software developers to have basic maths skills

"what is a prime number" is taught to 7 year olds, it's not vector calculus

what else would you consider to be an unreasonable thing for an employer to require?

reading and writing skills of a typical 7 year old?

Re: Code Llama, a state-of-the-art large language model for coding

#343

Post by Our_Benefactors »

noduerme wrote: post #330
blibble wrote: post #284

Earlier quoted context omitted.

it's not that though, there's several other typical optimisations in there just not the super obvious one that demonstrates extremely basic understanding of what a prime number is

I'm mad at myself now that it has eaten 15 minutes of my time trying to come up with the right optimization. What's the trick? 2, +1, and then +2 from there on seems obvious but once you get to 9 is it worth building a list of nonprimes to skip?

https://stackoverflow.com/a/54544012/1336678

Common approach is to use square roots, this reduces the runtime. Recommend checking out project euler if you like solving hard math-code-o(n)-puzzles.

Re: Code Llama, a state-of-the-art large language model for coding

#344

Post by [deleted] »

blibble wrote: post #275
daemonologist wrote: post #236

Works nearly out of the box with llama.cpp, which makes it easy to try locally: https://github.com/ggerganov/llama.cpp/issues/2766 Here's some output from q4_0 quantization of CodeLlama-7b-Python (first four lines are the prompt): # prints the first ten prime numbers def print_primes(): i = 2 num_printed = 0 # end of prompt while num_printed It will be interesting to see how the larger models perform, especially afte…

I'd fail an interview candidate that suggested adding 1 each time for subsequent prime testing

[deleted]

Re: Code Llama, a state-of-the-art large language model for coding

#345

Post by thewataccount »

noduerme wrote: post #330
blibble wrote: post #284

Earlier quoted context omitted.

it's not that though, there's several other typical optimisations in there just not the super obvious one that demonstrates extremely basic understanding of what a prime number is

I'm mad at myself now that it has eaten 15 minutes of my time trying to come up with the right optimization. What's the trick? 2, +1, and then +2 from there on seems obvious but once you get to 9 is it worth building a list of nonprimes to skip?

I think they're suggesting simply doing +2

+1 is not a good idea since ~half of all numbers are effectively non-prime simply by being even numbers.

You can double the speed by using +2 without using any fancy tricks, just changing a single character.

Re: Code Llama, a state-of-the-art large language model for coding

#346

Post by xanderatallah »

julianeon wrote: post #318
Someone1234 wrote: post #315

Business opportunity: I'd pay money for NICE desktop software that can run all these different models (non-subscription, "2-year updates included, then discount pricing" modal perhaps). My wishlist: - Easy plug & play model installation, and trivial to change which model once installed. - Runs a local web server, so I can interact with it via any browser - Ability to feed a model a document or multiple documents and…

What I want is even simpler: just an API that you make requests to and receive answers back. Surprisingly hard to find, outside OpenAI that is.

We’re trying to do this at https://openrouter.ai

Re: Code Llama, a state-of-the-art large language model for coding

#347

Post by blibble »

maleldil wrote: post #333
blibble wrote: post #275

Earlier quoted context omitted.

I'd fail an interview candidate that suggested adding 1 each time for subsequent prime testing

I assume you meant that you should add 2? If yes, that's such a mind boggling basic thing to do that I agree with you, and it makes no sense that you're being crucified.

yes

Re: Code Llama, a state-of-the-art large language model for coding

#349

Post by worldsayshi »

ingridpan wrote: post #323
julianeon wrote: post #318

Earlier quoted context omitted.

What I want is even simpler: just an API that you make requests to and receive answers back. Surprisingly hard to find, outside OpenAI that is.

https://gradient.ai/ is doing that with llama2

Looks really promising. I wonder if the similar pricing to OpenAI means that Gradient is also(?) bleeding money even if they get a good customer base. Or are these prices sustainable over time?

Re: Code Llama, a state-of-the-art large language model for coding

#350

Post by irrational »

Someone1234 wrote: post #315

Business opportunity: I'd pay money for NICE desktop software that can run all these different models (non-subscription, "2-year updates included, then discount pricing" modal perhaps). My wishlist: - Easy plug & play model installation, and trivial to change which model once installed. - Runs a local web server, so I can interact with it via any browser - Ability to feed a model a document or multiple documents and…

I work for a Fortune 100 company with 80,000+ employees. All of us are explicitly forbidden from using any sort of AI/LLM tool without written permission from the head of legal AND the CEO. In other words, nobody is going to get permission.

The concerns are 2 fold - 1. We might inadvertently use someone else’s intellectual property. 2. Someone else might gain access to our intellectual property.

What you are describing would help alleviate the concern about issue 2, but I’m not sure if it would help alleviate the concerns with issue 1.

Post reply on HN