Live data from Hacker News

Ask HN: How much of OpenAI code is written by AI?

news.ycombinator.com

21–30 of 69 posts

Re: Ask HN: How much of OpenAI code is written by AI?

#21
I think this is the wrong question.

The right question is how much human code can a human push now vs prior to AI.

Everything we've done in coding has been assisted.

Prior to this current generation of web applications, we had the advent of concepts like Object Orientated Programming and prior to that even C was a massive move up from Assembly and punch cards.

AI has written a lot of code. AI has written very little high velocity production code by itself (ie. for people with no coding background).

In Ruby on Rails, the concept of fast coding has been around for over 20 years, look up this concept of Scaffolding: https://www.rubyguides.com/2020/03/rails-scaffolding/

So to answer your question,

1. AI has pushed a lot of code 2. AI has pushed almost no code without the oversight of human software engineers 3. Software engineers are pushing a magnitude more code and producing more functional utility and solving more bugs than ever before

I don't know what the future holds, but I do think that this is not a new trend to use software to help humans build faster, and I don't think software has the ability to fully replace humans (yet).

Re: Ask HN: How much of OpenAI code is written by AI?

#22
post #5

Not OpenAI, but Anthropic CPO Mike Krieger said in response to a question of how much of Claude Code is written by Claude Code: "At this point, I would be shocked if it wasn't 95% plus. I'd have to ask Boris and the other tech leads on there." [0] https://www.lennysnewsletter.com/p/anthropics-cpo-heres-what...

Weasel words. No different than Nadella claiming 50%.

When you drill in you find out the real claims distill into something like "95% of the code, in some of the projects, was written by humans who sometimes use AI in their coding tasks."

If they don't produce data, show the study or other compelling examples, don't believe the claims; it's just marketing and marketing can never be trusted because marketing is inherently manipulative.

Re: Ask HN: How much of OpenAI code is written by AI?

#23

I absolutely believe that a large proportion of new code written is at least in-part AI generated, but that doesn't mean a large proportion of new code is 100% soup-to-nuts/pull-request-to-merge the result of decisions made by an agent and not a human. I doubt that very much. I think the difference between situations where AI-driven development works and doesn't is going to be largely down to the quality of the engin…

A large proportion of code written a quarter century ago was also in part AI generated. IntelliSense is AI and it's been around since the 90s.

Re: Ask HN: How much of OpenAI code is written by AI?

#24

> If AI is a threat to software engineering, I wouldn't expect many software engineers to actively accelerate that trend. There are two strong forces at play. Employees generally want to put in the least amount of effort possible and go home at 5. Employers want to save money and pay for fewer employees. AI creates a strong symbiosis here and both sides are focused on a short term win.

>Employees generally want to put in the least amount of effort possible and go home at 5.

Really?

In my experience coding engineers are coders because they enjoy the challenge. they like building things, breaking things and rebuilding things.

Its the white-collar 9-5 office workers that churn out power-point and word documents that want to do as little as possible.

Re: Ask HN: How much of OpenAI code is written by AI?

#25
post #5

Not OpenAI, but Anthropic CPO Mike Krieger said in response to a question of how much of Claude Code is written by Claude Code: "At this point, I would be shocked if it wasn't 95% plus. I'd have to ask Boris and the other tech leads on there." [0] https://www.lennysnewsletter.com/p/anthropics-cpo-heres-what...

It’s worth pointing out that the statement is about how much of Claude Code is written with it and not how much of the codebase of the whole company. In the more critical parts of the codebase where bugs can cause bigger problems, I expect a lot less code to be fully AI generated.

Re: Ask HN: How much of OpenAI code is written by AI?

#26

I think this is the wrong question. The right question is how much human code can a human push now vs prior to AI. Everything we've done in coding has been assisted. Prior to this current generation of web applications, we had the advent of concepts like Object Orientated Programming and prior to that even C was a massive move up from Assembly and punch cards. AI has written a lot of code. AI has written very little…

> Software engineers are pushing a magnitude more code and producing more functional utility and solving more bugs than ever before

Citation needed

Re: Ask HN: How much of OpenAI code is written by AI?

#27

> If AI is a threat to software engineering, I wouldn't expect many software engineers to actively accelerate that trend. I personally don't view it as a threat, but some people (non engineers?) obviously do. Software engineers have been automating away jobs for other people for nearly a century. It would be quite rich if the profession suddenly felt qualms about the process! (TBC I think automation is great and shou…

Software engineering has also been automating its own jobs for ages. The first thing we engineers do when asked to do a repetitive thing is find ways to automate it. I think the industry had qualms about losing their jobs. But honestly what are the examples of people losing their jobs to software ? Everybody says that this has happened many times yet examples are hard to come by.

> But honestly what are the examples of people losing their jobs to software?

And furthermore, what is the full causality chain that links the precise PR in provided example software to the employment termination decision? Lacking that, can you really assert the software 'automated' a dev out of the job?

Re: Ask HN: How much of OpenAI code is written by AI?

#28

> If AI is a threat to software engineering, I wouldn't expect many software engineers to actively accelerate that trend. There are two strong forces at play. Employees generally want to put in the least amount of effort possible and go home at 5. Employers want to save money and pay for fewer employees. AI creates a strong symbiosis here and both sides are focused on a short term win.

>Employees generally want to put in the least amount of effort possible and go home at 5. Really? In my experience coding engineers are coders because they enjoy the challenge. they like building things, breaking things and rebuilding things. Its the white-collar 9-5 office workers that churn out power-point and word documents that want to do as little as possible.

Sometime very soon we’ll cross a threshold where most people can do most of their coding through a tool like Claude and be more productive. It will feel like coding still, breaking and building things, but they will get more done in the same time. Everyone will switch.

Re: Ask HN: How much of OpenAI code is written by AI?

#30
I don't work for OpenAI and I doubt some random employee is going to come here and share what is likely a secret. I'm in the industry though so I have some idea of what's going on these days, both where I work and more broadly.

AI is getting better at writing code. However writing code is just some fraction of the work of many software engineers. AI doesn't work independently, it needs to be guided, its work needs to be reviewed, tested etc. There are some domains where it does better and some domains where it doesn't. There's a range of "AI" work between auto-complete style work, assisting in understanding a code base, and writing code from some spec or doing other types work.

All in all I would say it's a decent improvement to productivity for many situations. It's really hard to say how much and it's also not a zero sum game, as productivity improves there's more work.

Something to keep in mind is that if you look at a modern software project likely most of the code executing is not code written by the developers of that project. There's a huge stack of open source bits executing for almost any new project.

Specifically in OpenAI you also need to consider what type of software they are likely writing. Some of it may be more or less "vanilla" code and other is likely very specialized/performance critical. The vanilla code like API wrappers or simple front end pieces is likely more amenable to be written by AI whereas the more cutting edge algorithmic/scheduling/optimization work is almost certainly not done by AI. At least yet.

As software organizations become larger there's a lot of overhead and waste. It is possible that AI can enable smaller teams and that has a multiplicative effect because it lets you reduce that waste/overhead. There are likely also software engineers who will become better/adapt to new workflows and some who will not. It's really hard to say where things are going but overall my sense is that this like many other innovations will lead to more software and more jobs and not the other way around. There are many moving pieces here, not just AI itself but geopolitics, macro-economics, etc. Where are those new jobs going to get created, what new types of software/technology are going to be created etc. etc. History seems to show us that we'll adapt/evolve and grow.

Post reply on HN