Live data from Hacker News

OpenAI Researchers Find That AI Is Unable to Solve Most Coding Problems

futurism.com

71–80 of 174 posts

Re: OpenAI Researchers Find That AI Is Unable to Solve Most Coding Problems

#71
post #28

Earlier quoted context omitted.

Where are the low level CEOs vs high level CEOs? I'll bet AI could do their jobs right now. Can SOMEONE please write AI software to replace these people?

Are you bothered by the fact that software engineers might be easier to automate?

It's the opposite. An LLM is better at CEO stuff than working code. A good developer + LLM instead of CEO can succeed. A good CEO + LLM instead of developer cannot succeed. (For a tech company)

Re: OpenAI Researchers Find That AI Is Unable to Solve Most Coding Problems

#72
post #35

> The models weren't allowed to access the internet How many software developers could solve most even simple programming problems (except 'Hello world') with zero shot style (you write in notepad then can compile only once and execute once) without access to internet (stackoverflow, google search, documentation), tools (terminal, debugger, linter, cli)? I think then it's not the best comparison to make any judgement…

Isn't this how interviews tend to work? So I think a good number of devs would, yes.

Interviews like leetcode on whiteboard only testing your reasoning not if your solution will execute out of the box in zero shot style. Humans solve problem in iterative way that's why fast feedback loop and access to tools is essential. When you start coding compiler or linter hints you that you forgot to close some braces or miss semicolon. Compiler tips you that API in new version changed, intellisense hints you what methods you can use in current context and what parameters you can use and their types. Once you execute program you get runtimes tips that maybe you missed installing some node or python package. When you installing packages you get hints that maybe one package has additional dependency and 2 package version are not compatible. Command line tools like `ls` tells you what's project structure etc.

Re: OpenAI Researchers Find That AI Is Unable to Solve Most Coding Problems

#73

I believe it. I couldn't even get o1 or claude 3.5 to write a tampermonkey script that would turn off auto-scroll to bottom in LibreChat, even when uploading the html and javascript as context. Apparently it has to do with overflow anchor or something in React? Idk. I gave up.

Unless it works by literally scrolling with JS, I bet some strategic bit of CSS should do it...

Re: OpenAI Researchers Find That AI Is Unable to Solve Most Coding Problems

#75
post #63

Half of the work is specification and iteration. I think there’s a focus on full SWE replacement because it’s sensational, but we’ll more end up with SWE able to focus on the less patterned or ambiguous work and made way more productive with the LLM handling subtasks more efficiently. I don’t see how full SWE replacement can happen unless non-SWE people using LLMs become technical enough to get what they need out of…

Everyone is a typist now, so I don't think it is farfetched that everyone is a SWE in the future.

Very few people are typist.

Most people can use a keyboard, but the majority of non-technical people type at a speed which is orders of magnitude less than a professional typist.

Another comment here mentions how they used colab while not being a SWE, but that is already miles ahead of what average people do with computers.

There's people who have used computers for decades and wouldn't be able to do a sum in a spreadsheet, nor know that is something spreadsheets can do.

Re: OpenAI Researchers Find That AI Is Unable to Solve Most Coding Problems

#76
post #65
post #50

Earlier quoted context omitted.

What would searching the Internet provide the models that they don’t already have? Most likely data sources such as stack overflow, documentation on the language it’s targeting, and a variety of relevant forum posts are already part of its training set. Unless someone else came along and said “here’s how to solve x problem step by step”, I don’t see how additional information past its cutoff point would help. (Perhap…

Why do programmers search for specific questions rather than always relying on their inherent knowledge? I’m a crappy hobbyist programmer but for me it is useful to see if someone has implemented exactly what I need, or debugged the problem I’m having. I don’t think it’s reasonable to expect programmers or LLMs to know everything about every library’s use in every context just from first principles.

But why would that information not be included in the wide crawl already encoded in the model weights before the knowledge cutoff? I believe the article mentions frontier models so we are talking about models trained on trillions of tokens here

Re: OpenAI Researchers Find That AI Is Unable to Solve Most Coding Problems

#77
post #56

Earlier quoted context omitted.

> unless non-SWE people using LLMs become technical enough to get what they need out of them Non-SWE person here. In the past year I've been able to use LLMs to do several tasks for which I previously would have paid a freelancer on Fiverr. The most complex one, done last spring, involved writing a Python program that I ran on Google Colab to grab the OCR transcriptions of dozens of 19th-century books off the Interne…

This is a good anecdote but most software engineering is not scripting. It’s getting waist (or neck) deep in a large codebase and many intricacies. That being said I’m very bullish on AI being able to handle more and more of this very soon. Cursor definitely does a great job giving us a taste of cross codebase understanding.

Seconded. Zed makes it trivial to provide entire codebases as context to Claude 3.5 Sonnet. That particular model has felt as good as a junior developer when given small, focused tasks. A year ago, I wouldn’t have imagined that my current use of LLMs was even possible.

Re: OpenAI Researchers Find That AI Is Unable to Solve Most Coding Problems

#78
post #67
post #36

I recently had to do a one-off task using SQL in a way that I wasn't too familiar with. Since I could explain conceptually what I needed but didn't know all the right syntax this seemed like a perfect use case to loop in Claude. The first couple back and forths went ok but it quickly gave me some SQL that was invalid. I sent back the exact error and line number and it responded by changing all of the aliases but repe…

Makes perfect sense why it couldn't answer your question, you didn't have the vocabulary of relational algebra to correctly prime the model. Any rudimentary field have their own corpus vocabulary to express ideas and concepts specific to that domain.

I honestly can't tell if this is a sarcastic reply or not

Re: OpenAI Researchers Find That AI Is Unable to Solve Most Coding Problems

#79
post #58
post #40

Earlier quoted context omitted.

I'm not convinced LLMs will evolve into general AI. The promises that it's just around the corner feels increasingly like a big scam.

I mean it’s been a couple of years! It may or may not happen but “scam” means intentional deceit. I don’t think anyone actually knows where LLMs are going with enough certainty to use that pejorative.

Is it intentional deceit to tell everyone it's leading to something when, as you correctly point out, nobody actually knows if it will?

Re: OpenAI Researchers Find That AI Is Unable to Solve Most Coding Problems

#80
post #35

> The models weren't allowed to access the internet How many software developers could solve most even simple programming problems (except 'Hello world') with zero shot style (you write in notepad then can compile only once and execute once) without access to internet (stackoverflow, google search, documentation), tools (terminal, debugger, linter, cli)? I think then it's not the best comparison to make any judgement…

You sound like someone who never used punch cards.

I think most developers could do that if they trained. As someone who learned how to program before the internet, its just a different mindset and would take some time to adjust.

I am doing that now where changes take a day to make it to staging and no local environment. You roll with it.

Post reply on HN