Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

A Research Preview of Codex

openai.com

Post reply on HN
Print view View original

321–330 of 487 posts

Re: A Research Preview of Codex

#321

Post by Snuggly73 »

ofirpress wrote: post #299
Snuggly73 wrote: post #137

Earlier quoted context omitted.

I can be completely off base, but it feels to me like benchmaxxing is going on with swe-bench. Look at the results from multi swe bench - https://multi-swe-bench.github.io/#/ swe polybench - https://amazon-science.github.io/SWE-PolyBench/ Kotlin bench - https://firebender.com/leaderboard

Not sure what you mean by benchmaxxing but we think there's still a lot of useful signals you can infer from SWE-bench-style benchmarking. We also have SWE-bench Multimodal which adds a twist I haven't seen elsewhere: https://www.swebench.com/multimodal.html

I mean that there is the possibility that swe bench is being specifically targeted for training and the results may not reflect real world performance.

Re: A Research Preview of Codex

#322

Post by [deleted] »

MoonGhost wrote: post #271
geekraver wrote: post #233

Earlier quoted context omitted.

Same, mine is about to graduate with a CS masters from a great school. Couldn't get any internships, and is now incredibly negative about ever being able to find work, which doesn't help. We're pretty much looking at minimum wage jobs doing tech support for NGOs at this point (and the current wave of funding cuts from Federal government for those kind of orgs is certainly not going to help with that).

With so many graduates looking for a job why don't they bang together and do something. If not for money then just to show off their skills, something to put in the resume. It's not going to get any easier in next next few years, I think. Till the point when fresh grad using AI can make something valuable. After that it will be period when anybody can just ask AI to do something and it will find soft in its library o…

[deleted]

Re: A Research Preview of Codex

#323

Post by arewethereyeta »

criddell wrote: post #112
johnjwang wrote: post #80

Some engineers on my team at Assembled and I have been a part of the alpha test of Codex, and I'll say it's been quite impressive. We’ve long used local agents like Cursor and Claude Code, so we didn’t expect too much. But Codex shines in a few areas: Parallel task execution: You can batch dozens of small edits (refactors, tests, boilerplate) and run them concurrently without context juggling. It's super nice to run…

If you aren't hiring junior engineers to do these kinds of things, where do you think the senior engineers you need in the future will come from? My kid recently graduated from a very good school with a degree in computer science and what she's told me about the job market is scary. It seems that, relatively speaking, there's a lot of postings for senior engineers and very little for new grads. My employer has hired…

By the rate at which these things advance I would say the "Seniors" will come from there too. We are transforming into architects or going at higher levels at least. Teach your kids to be better architects instead, code is dying. My 2c at least

Re: A Research Preview of Codex

#324

Post by voidspark »

rowanG077 wrote: post #278
KaiserPro wrote: post #248

Earlier quoted context omitted.

> AI have shown to most capable in what we consider creative jobs no it creates shit thats close enough for people who are in a rush and dont care. ie, you need artwork for shit on temu, boom job done. You want to make a poster for a bake sale, boom job done. Need some free music that sounds close enough to be swifty, but not enough to get sued, great. But as an expression of creativity, most people cant get it to do…

> AI creates novel algorithms beating thousands of googlers. Random HNer on an AI post one day later > Its currently slightly more configurable clipart. It's so ridiculous at this point that I can just laugh about this.

Comparing music and algorithms is nonsense.

AI music is disposable generic soulless trash, even if it is technically correct, in accordance with the rules and conventions of music theory. AI generates Muzak. Totally generic and derivative.

There is no AI equivalent to Kurt Cobain, or James Brown, or Tori Amos.

Re: A Research Preview of Codex

#325

Post by koakuma-chan »

thomasahle wrote: post #237
sam0x17 wrote: post #171

Earlier quoted context omitted.

Hiring of juniors is basically dead these days and it has been like this for about 10 years and I hate it. I remember when I was a junior in 2014 there were actually startups who would hire cohorts of juniors (like 10 at a time, fresh out of CS degree sort of folks with almost no applied coding experience) and then train them up to senior for a few years, and then a small number will stay and the rest will go elsewhe…

> But at the same time, to be fair, this was a way easier task in the early 00s The best junior I've hired was a big contributor to an open source library we were starting to use. I think there's still lots of opportunity for honing your skill, and showing it off, outside of schools.

> The best junior I've hired was a big contributor to an open source library we were starting to use.

From my experience no one cares. You're lucky if recruiter even looks at your CV, not to mention your GitHub profile.

Re: A Research Preview of Codex

#326

Post by gitremote »

MoonGhost wrote: post #271
geekraver wrote: post #233

Earlier quoted context omitted.

Same, mine is about to graduate with a CS masters from a great school. Couldn't get any internships, and is now incredibly negative about ever being able to find work, which doesn't help. We're pretty much looking at minimum wage jobs doing tech support for NGOs at this point (and the current wave of funding cuts from Federal government for those kind of orgs is certainly not going to help with that).

With so many graduates looking for a job why don't they bang together and do something. If not for money then just to show off their skills, something to put in the resume. It's not going to get any easier in next next few years, I think. Till the point when fresh grad using AI can make something valuable. After that it will be period when anybody can just ask AI to do something and it will find soft in its library o…

> With so many graduates looking for a job why don't they bang together and do something. If not for money then just to show off their skills, something to put in the resume.

Young people are already doing that, but a lot of what they produce is what you expect from people who have no prior experience in designing and testing software for production environments.

Re: A Research Preview of Codex

#327

Post by username223 »

hintymad wrote: post #179
johnjwang wrote: post #80

Some engineers on my team at Assembled and I have been a part of the alpha test of Codex, and I'll say it's been quite impressive. We’ve long used local agents like Cursor and Claude Code, so we didn’t expect too much. But Codex shines in a few areas: Parallel task execution: You can batch dozens of small edits (refactors, tests, boilerplate) and run them concurrently without context juggling. It's super nice to run…

It looks we are in this interesting cycle: millions of engineers contribute to open-source on github. The best of our minds use the code to develop powerful models to replace exactly these engineers. In fact, the more code a group contributes to github, the easier it is for the companies to replace this group. Case in point, frontend engineers are impacted most so far. Does this mean people will be less incentivized…

> Does this mean people will be less incentivized to contribute to open source as time goes by?

Yes. I certainly don't intend to put any free code online until I can legally bar AI bros from using it without payment. As Mike Monteiro put it long ago, "F** you, pay me" (https://www.youtube.com/watch?v=jVkLVRt6c1U)

Re: A Research Preview of Codex

#328

Post by conn10mfan »

gitremote wrote: post #326
MoonGhost wrote: post #271

Earlier quoted context omitted.

With so many graduates looking for a job why don't they bang together and do something. If not for money then just to show off their skills, something to put in the resume. It's not going to get any easier in next next few years, I think. Till the point when fresh grad using AI can make something valuable. After that it will be period when anybody can just ask AI to do something and it will find soft in its library o…

> With so many graduates looking for a job why don't they bang together and do something. If not for money then just to show off their skills, something to put in the resume. Young people are already doing that, but a lot of what they produce is what you expect from people who have no prior experience in designing and testing software for production environments.

also they need to pay rent

Re: A Research Preview of Codex

#329

Post by Buttons840 »

jackphilson wrote: post #318
CuriouslyC wrote: post #296

Earlier quoted context omitted.

The people who will come out the other side are domain focused people with the engineering chops to understand the system end to end, and the customer skills to understand what needs to be built.

Yes. everyone will eventually have the job title of "problem solver"

Don't forget the very important role of managing the problem solvers--if you just let the problem solvers run amuck all sorts of problems might be solved.

Re: A Research Preview of Codex

#330

Post by asadm »

KaiserPro wrote: post #251
asadm wrote: post #38

Earlier quoted context omitted.

why not? OpenAI won't be stupid to look at my code and be that vulnerable legally. It ain't worth it.

They literally scraped half of youtube, made a library to extract the audio and released it as whisper. Of _course_ they are training on your shit.

thats publicly accessible shit. my code is trade secret and IP. I would litigate that shit if a line I wrote ends up in public model, easiest money to be made.
Post reply on HN