Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Code Llama, a state-of-the-art large language model for coding

ai.meta.com

Post reply on HN
Print view View original

381–390 of 525 posts

Re: Code Llama, a state-of-the-art large language model for coding

#381

Post by quickthrower2 »

mymac wrote: post #122

Never before in the history of mankind was a group so absolutely besotted with the idea of putting themselves out of a job.

The best interpretation of this is you mean eventually ML/AI will put programmers out of a job, and not Code LLama specifically.

However it is hard to tell how that might pan out. Can such an ML/AI do all the parts of the job effectively? A lot of non-coding skill bleed into the coder's job. For example talking to people who need an input to the task and finding out what they are really asking for, and beyond that, what the best solution is that solves the underlying problem of what they ask for, while meeting nonfunctional requirements such as performance, reliability, code complexity, and is a good fit for the business.

On the other hand eventually the end users of a lot of services might be bots. You are more likely to have a pricing.json than a pricing.html page, and bots discover the services they need from searches, negotiate deals, read contracts and sue each other etc.

Once the programming job (which is really a "technical problem solver" job) is replaced either it will just be same-but-different (like how most programmers use high level languages not C) or we have invented AGI that will take many other jobs.

In which case the "job" aspect of it is almost moot. Since we will be living in post-scarcity and you would need to figure out the "power" aspect and what it means to even be sentient/human.

Re: Code Llama, a state-of-the-art large language model for coding

#382

Post by thfuran »

roguas wrote: post #357
irrational wrote: post #350

Earlier quoted context omitted.

I work for a Fortune 100 company with 80,000+ employees. All of us are explicitly forbidden from using any sort of AI/LLM tool without written permission from the head of legal AND the CEO. In other words, nobody is going to get permission. The concerns are 2 fold - 1. We might inadvertently use someone else’s intellectual property. 2. Someone else might gain access to our intellectual property. What you are describi…

Change company. Honestly. If you go as far as to forbid your partners in crime (workers sigh..) to explore new uncharted territory at all - well ya know someone will/might just win by not doing that.

That's not banning all uncharted territory, it's banning specific legally fraught territory.

Re: Code Llama, a state-of-the-art large language model for coding

#383

Post by binreaper »

1024core wrote: post #314

If GPT-4's accuracy is 67% and this is 54%, how can these guys claim to be SOTA?

Seriously, I was expecting to read the article and them be on a level on-par with GPT-4 or higher. For all this chat of how long Google/Facebook have been in the AI space longer than OpenAI, their products don't speak to that..

Re: Code Llama, a state-of-the-art large language model for coding

#384

Post by ttyyzz »

irrational wrote: post #350
Someone1234 wrote: post #315

Business opportunity: I'd pay money for NICE desktop software that can run all these different models (non-subscription, "2-year updates included, then discount pricing" modal perhaps). My wishlist: - Easy plug & play model installation, and trivial to change which model once installed. - Runs a local web server, so I can interact with it via any browser - Ability to feed a model a document or multiple documents and…

I work for a Fortune 100 company with 80,000+ employees. All of us are explicitly forbidden from using any sort of AI/LLM tool without written permission from the head of legal AND the CEO. In other words, nobody is going to get permission. The concerns are 2 fold - 1. We might inadvertently use someone else’s intellectual property. 2. Someone else might gain access to our intellectual property. What you are describi…

It's basically the same thing in our company, too. They basically put a similar rule in place that prevents anyone from using e.g. Chat GPT. Little do they know that all software devs within the company are using co-pilot and the company is even paying for it. It's quite a funny situation tbh..

Re: Code Llama, a state-of-the-art large language model for coding

#385

Post by blibble »

daok wrote: post #374
blibble wrote: post #342

Earlier quoted context omitted.

> If you instant-fail a candidate for this, it says a lot more about you and your organization than the candidate. yes, we expect professional software developers to have basic maths skills "what is a prime number" is taught to 7 year olds, it's not vector calculus what else would you consider to be an unreasonable thing for an employer to require? reading and writing skills of a typical 7 year old?

You probably do not have a child of 7 years old because they do not know at that age what is a prime number. Second, basic math still that you never or rarely use or with very large time between usage might get rusty. You may understand the concept but not find the optimal solution. The way you are responding here shows quite a lot about how you are short sighted by instant-failing someone with a single question inst…

> You probably do not have a child of 7 years old because they do not know at that age what is a prime number.

it's part of the curriculum for children of this age where I grew up (I did check)

> The way you are responding here shows quite a lot about how you are short sighted by instant-failing someone with a single question instead of trying to asses the whole person as much as you can. On you side, you are wasting opportunity to have a great person that could be a key player in your team by bringing other set of skill on the table.

it may also be the case that I have more in depth knowledge about the roles that I've interviewed candidates for

most recently: hiring people to work for quants

not instantly knowing that even numbers (other than 2) are not prime is a very strong signal

Re: Code Llama, a state-of-the-art large language model for coding

#386

Post by appel »

luma wrote: post #379
jmorgan wrote: post #316

Earlier quoted context omitted.

A few folks and I have been working on an open-source tool that does some of this (and hopefully more soon!) https://github.com/jmorganca/ollama There's a "PrivateGPT" example in there that is similar to your third point above: https://github.com/jmorganca/ollama/tree/main/examples/priva... Would love to know your thoughts

I'd love to test this out as soon as you get Linux or Windows support going!

Me too! I starred the repo and am watching releases, excited to try it.

Re: Code Llama, a state-of-the-art large language model for coding

#387

Post by turnsout »

someplaceguy wrote: post #369
d0mine wrote: post #354

Earlier quoted context omitted.

Simple, concise, more efficient: def primes_upto(limit: int): """Generate prime numbers 2 3 5 7 11 13 17 19 23 29

Yeah, but yours was generated by the "post unoptimized code to HN and wait for someone to optimize it" model, which, although free and doesn't require a GPU, is a much slower model.

Someone should turn this into a product! You highlight the code you want to optimize, and it posts it to hn as a semi-contextually-appropriate comment to invite code golfing, and the highest rated reply gets posted back to your repo as a PR.

Re: Code Llama, a state-of-the-art large language model for coding

#388

Post by sangnoir »

ttyyzz wrote: post #384
irrational wrote: post #350

Earlier quoted context omitted.

I work for a Fortune 100 company with 80,000+ employees. All of us are explicitly forbidden from using any sort of AI/LLM tool without written permission from the head of legal AND the CEO. In other words, nobody is going to get permission. The concerns are 2 fold - 1. We might inadvertently use someone else’s intellectual property. 2. Someone else might gain access to our intellectual property. What you are describi…

It's basically the same thing in our company, too. They basically put a similar rule in place that prevents anyone from using e.g. Chat GPT. Little do they know that all software devs within the company are using co-pilot and the company is even paying for it. It's quite a funny situation tbh..

> Little do they know that all software devs within the company are using co-pilot and the company is even paying for it.

Just like annual sexual harassment training - it's mostly corporate CYA on liability. If it ever goes to court, they'll plead ignorance and blame the employees who should have known better as they were trained/informed on what they ought not to do.

Paying for co-pilot could bite them though, so I suspect it's a case were the one part of the organization isn't aware of what the other is doing

Re: Code Llama, a state-of-the-art large language model for coding

#389

Post by vunderba »

thewataccount wrote: post #247
sestinj wrote: post #241

Earlier quoted context omitted.

You can use Continue for all of this, as easy as highlighting code and making the request. We also support using Code Llama: https://continue.dev/docs/walkthroughs/codellama

Any plans to support IntelliJ?

Yeah this would be a crucial feature - interoperability with Jetbrains IDEs.

Re: Code Llama, a state-of-the-art large language model for coding

#390

Post by ttyyzz »

sangnoir wrote: post #388
ttyyzz wrote: post #384

Earlier quoted context omitted.

It's basically the same thing in our company, too. They basically put a similar rule in place that prevents anyone from using e.g. Chat GPT. Little do they know that all software devs within the company are using co-pilot and the company is even paying for it. It's quite a funny situation tbh..

> Little do they know that all software devs within the company are using co-pilot and the company is even paying for it. Just like annual sexual harassment training - it's mostly corporate CYA on liability. If it ever goes to court, they'll plead ignorance and blame the employees who should have known better as they were trained/informed on what they ought not to do. Paying for co-pilot could bite them though, so I…

All of your assumptions are exactly right. They (mostly managers with little to no IT background) want to cover their own asses in case shit hits the fan (unlikely scenario if you ask me, because the company is just overrating the value of their data. Nobody gives a fuck about us anyway...) and many parts of this company have developed their own habits... The company is just very big and I can understand why they might be afraid, but come on, nobody will take that policy seriously forever. You need to eventually put some reasonable rules in place that allow you to make use of such Innovations...
Post reply on HN