Live data from Hacker News

Code Llama, a state-of-the-art large language model for coding

ai.meta.com

331–340 of 525 posts

Re: Code Llama, a state-of-the-art large language model for coding

#331

Business opportunity: I'd pay money for NICE desktop software that can run all these different models (non-subscription, "2-year updates included, then discount pricing" modal perhaps). My wishlist: - Easy plug & play model installation, and trivial to change which model once installed. - Runs a local web server, so I can interact with it via any browser - Ability to feed a model a document or multiple documents and…

I’ve used llama.cpp easily for some local things, but it does lack a good ui.

Re: Code Llama, a state-of-the-art large language model for coding

#332

Works nearly out of the box with llama.cpp, which makes it easy to try locally: https://github.com/ggerganov/llama.cpp/issues/2766 Here's some output from q4_0 quantization of CodeLlama-7b-Python (first four lines are the prompt): # prints the first ten prime numbers def print_primes(): i = 2 num_printed = 0 # end of prompt while num_printed It will be interesting to see how the larger models perform, especially afte…

I'd fail an interview candidate that suggested adding 1 each time for subsequent prime testing

Finally we meet the lifeless drone that everybody complains about in the interviews.

My suggestion for your next interview: decide to hire them just based on their leetcode score, but invite to the interview just to flex that you're still better at puzzle solving :-D

Perfect

Re: Code Llama, a state-of-the-art large language model for coding

#333

Works nearly out of the box with llama.cpp, which makes it easy to try locally: https://github.com/ggerganov/llama.cpp/issues/2766 Here's some output from q4_0 quantization of CodeLlama-7b-Python (first four lines are the prompt): # prints the first ten prime numbers def print_primes(): i = 2 num_printed = 0 # end of prompt while num_printed It will be interesting to see how the larger models perform, especially afte…

I'd fail an interview candidate that suggested adding 1 each time for subsequent prime testing

I assume you meant that you should add 2? If yes, that's such a mind boggling basic thing to do that I agree with you, and it makes no sense that you're being crucified.

Re: Code Llama, a state-of-the-art large language model for coding

#334

Business opportunity: I'd pay money for NICE desktop software that can run all these different models (non-subscription, "2-year updates included, then discount pricing" modal perhaps). My wishlist: - Easy plug & play model installation, and trivial to change which model once installed. - Runs a local web server, so I can interact with it via any browser - Ability to feed a model a document or multiple documents and…

Did you try Oobabooga (https://github.com/oobabooga/text-generation-webui) yet?

Re: Code Llama, a state-of-the-art large language model for coding

#336

Business opportunity: I'd pay money for NICE desktop software that can run all these different models (non-subscription, "2-year updates included, then discount pricing" modal perhaps). My wishlist: - Easy plug & play model installation, and trivial to change which model once installed. - Runs a local web server, so I can interact with it via any browser - Ability to feed a model a document or multiple documents and…

What I want is even simpler: just an API that you make requests to and receive answers back. Surprisingly hard to find, outside OpenAI that is.

Oobabooga exposes an API.

Re: Code Llama, a state-of-the-art large language model for coding

#337
post #20

Between this, ideogram.ai (image generator which can spell, from former Google Imagen team member and others), and ChatGPT fine-tuning, this has been a truly epic week. I would argue that many teams will have to reevaluate their LLM strategy _again_ for the second time in a week.

Did ideogram release a checkpoint?

I can't find any info or Discord or forum or anything. I think it's a closed service that they plan to sell to make money.

Re: Code Llama, a state-of-the-art large language model for coding

#338

Business opportunity: I'd pay money for NICE desktop software that can run all these different models (non-subscription, "2-year updates included, then discount pricing" modal perhaps). My wishlist: - Easy plug & play model installation, and trivial to change which model once installed. - Runs a local web server, so I can interact with it via any browser - Ability to feed a model a document or multiple documents and…

I have been using refact.ai on my laptop, it has been quite good.

https://github.com/smallcloudai/refact/blob/main/README.md

Re: Code Llama, a state-of-the-art large language model for coding

#339
post #208

Curious if there are projects to enable working with these things self-hosted, tuned to a git repo as context on the cli, like a Unix filter - or with editors like vim? (I'd love to use this with Helix) I see both vscode and netbeans have a concept of "inference URL" - are there any efforts like language server (lsp) - but for inference?

https://github.com/runvnc/smartcat

Re: Code Llama, a state-of-the-art large language model for coding

#340
post #7

Does anyone have a good explanation for Meta's strategy with AI? The only thing I've been able to think is they're trying to commoditize this new category before Microsoft and Google can lock it in, but where to from there? Is it just to block the others from a new revenue source, or do they have a longer game they're playing?

I posit it is similar to how Adobe lets students pirate Photoshop, because when they join the workforce that is what they know and need their employers to buy Adobe services, which for corporate is very expensive.

Meta by democratizing AI access is generating more capable developers which will make the Metaverse a reality, where FB leads. They have already realized they have a losing gambit with Google, Apple, Microsoft (also X?) having an antagonistic monopoly against Meta product advancement

Post reply on HN