OpenAI Researchers Find That AI Is Unable to Solve Most Coding Problems • Hacker News Board

Re: OpenAI Researchers Find That AI Is Unable to Solve Most Coding Problems

#171

Post by boppo1 » Wed, Feb 26, 2025, 3:08 AM UTC

petesergeant wrote: post #52

deegles wrote: post #40

Earlier quoted context omitted.

I'm not convinced LLMs will evolve into general AI. The promises that it's just around the corner feels increasingly like a big scam.

Depends what you mean by evolve. I don't think we'll get general AI by simply scaling LLMs, but I think general AI, if it arrives, will be able to trace its lineage very much back to LLMs. Journeys through the embedding space very much feel like the way forward to me, and that's what LLMs are.

Is there a resource I can use to understand the difference between embedding space and latent space?

Re: OpenAI Researchers Find That AI Is Unable to Solve Most Coding Problems

#172

Post by fragmede » Wed, Feb 26, 2025, 8:21 AM UTC

johnnyanmac wrote: post #170

fragmede wrote: post #169

Earlier quoted context omitted.

I'm equally sure there are true believers who've drunk the Kool-aid and really believe AGI is right around the corner, just need to fix a few bugs and wait just a few more generations of Moore's law. What difference does the beliefs of a nameless engineer at an AI company make?

>What difference does the beliefs of a nameless engineer at an AI company make? Hopefully a manager and proper task scheduling. If I made these promises every sprint and kept saying "yea the task is only a week away from completion!" I'd be fired unless I fell down the rabbit hole to Alice in Wonderland. I'm using good faith to assume a lot of those AI engineers are smarter and better schedulers than I am. But that's…

but we're laymen with no attempts to define what AGI means in concrete terms, nevermind remotely come to any agreement over it, so the manager and proper task scheduling is gonna have much more concrete and discreet task in the sprint in jira. it's not like there's just one ticket with a billion points or umptuple XL that says AGI. That's not even gonna be an epic with a million tickets. (or maybe it is. I don't work there, lol)

The people in the trenches there are working on tactical specific things and aren't going to be fired for meeting their internal KPIs which aren't nebulously AGI.

Re: OpenAI Researchers Find That AI Is Unable to Solve Most Coding Problems

#173

Post by johnnyanmac » Wed, Feb 26, 2025, 8:55 AM UTC

fragmede wrote: post #172

johnnyanmac wrote: post #170

Earlier quoted context omitted.

>What difference does the beliefs of a nameless engineer at an AI company make? Hopefully a manager and proper task scheduling. If I made these promises every sprint and kept saying "yea the task is only a week away from completion!" I'd be fired unless I fell down the rabbit hole to Alice in Wonderland. I'm using good faith to assume a lot of those AI engineers are smarter and better schedulers than I am. But that's…

but we're laymen with no attempts to define what AGI means in concrete terms, nevermind remotely come to any agreement over it, so the manager and proper task scheduling is gonna have much more concrete and discreet task in the sprint in jira. it's not like there's just one ticket with a billion points or umptuple XL that says AGI. That's not even gonna be an epic with a million tickets. (or maybe it is. I don't work…

>so the manager and proper task scheduling is gonna have much more concrete and discreet task in the sprint in jira

Yes, that's the true meaning behind my words. The marketing is saying "were working on AGI as we speak!" and that's only bare bones true in the same way that someone is buying a house... While baeeot starting their savings, and unsure or where they are buying and what they want in it. It's barely an idea, per alone "around the corner".

Meanwhile, they are given small, unexciting, but important stepping stones to experiment. Nothing that makes line go up, because that means being truthful. Thars why I hate hype culture. It obscures true progress and honesty towards progress. A distraction because talking about a "thing" in a blue sky is more profitable than talking about the actual stepping stones.

Re: OpenAI Researchers Find That AI Is Unable to Solve Most Coding Problems

#174

Post by contractorwolf » Wed, Feb 26, 2025, 4:18 PM UTC

gar1t wrote: post #168

contractorwolf wrote: post #166

To all those devs saying "i tried it and it wasnt perfect the first time, so I gave up", I am reminded of something my father used to say: "A bad carpenter blames his tools" So AI not going to answer your question right on its first attempt in many cases. It is forced to make a lot of assumptions based on the limited info you gave it, some of those may not match your individual case. Learn to prompt better and it wil…

One of the reasons SO works is that the correct or best answer tends to move toward the top of the list. AI struggles to do this reliably - and so its closer to SO where the answers are randomly selected and you have to try a few to get the one that's correct. Also, I bet your father imagined the carpenter's toolbox full of well accepted useful tools. For many of us, non-bad carpenters, AI hasn't made the cut yet.

All I am saying is that if you are expecting it to fail for you, that is absolutely what it will do. You weren't good at typing on your first day either. I went from a decent engineer with 20 years experience to a 10x engineer able to take on any problem, in less than a year. All because I learned how to use the tool effectively.

Just dont give up, get back on that bike and keep peddling. I promise it will amaze you if you give it a chance.

This is a tool, just like all the other ones you have learned, but it will make you a far better engineer. It can fill all those gaps in your understanding of code. You can ask it all those questions you are unwilling to ask your colleagues, because you think you will sound dumb for not knowing. You can ask it to explain everything again if you still dont get it. It is powerful if you know how to use it.