Live data from Hacker News

Code Is Cheap Now, and That Changes Everything

perevillega.com

51–60 of 62 posts

Re: Code Is Cheap Now, and That Changes Everything

#51

Code is not cheap. It's just heavily subsidised with VC money. But that won't last forever. Uber Eats also used to be dirt cheap. Surprise! it's not anymore. And even if you just pay API prices for Opus - as opposed to using a subsidized subscription - you can easily reach the point where the tokens for AI-generated code become comparable in price to just paying a junior dev salary for a manual implementation. AI is…

I doubt that all of the providers hosting open models on open platforms are losing money on serving inference. They have the benefit of not having to pay for training, but the models are open and aren't going away anytime soon.

Sadly, I have not been able to find any open model that comes close to Opus 4.6. So while they are much cheaper to deploy, they also aren't good enough for unsupervised agent execution. But you need a model that can run unsupervised for the claim "Code is Cheap" to become possible.

Re: Code Is Cheap Now, and That Changes Everything

#52

Code is not cheap. It's just heavily subsidised with VC money. But that won't last forever. Uber Eats also used to be dirt cheap. Surprise! it's not anymore. And even if you just pay API prices for Opus - as opposed to using a subsidized subscription - you can easily reach the point where the tokens for AI-generated code become comparable in price to just paying a junior dev salary for a manual implementation. AI is…

Hardware has always gotten cheaper every year, and always will. You will be able to run Opus 4.6 tier models locally with junkyard hardware in 2035.

Re: Code Is Cheap Now, and That Changes Everything

#53
post #46
post #17

Earlier quoted context omitted.

I find it amusing that software developers have no issue with having an LLM churn out slop code but have such a visceral reaction to slop articles.

I have no issue with with code generated by e.g. Claude because it's not "slop". On average, it's probably better than the code I would write. I say "on average" because AI doesn't make stupid mistakes, doesn't invert logical conditions. I know I do. Which I eventually fix, but it's better to not make them in the first place, hence "on average". And in cases that AI doesn't generate code up to my quality standards, I…

But that's my point. LLMs generate good prose "most of the time", certainly better than most people are capable of doing. Yet we frequently react with disgust when we see tell-tale signs of LLM-generated text in articles. Why? Because it indicates the person was probably too lazy to write it themselves and are simply chucking a half-formed thought over the wall? Why don't we hold generated code to the same standard?

Re: Code Is Cheap Now, and That Changes Everything

#54

Code is not cheap. It's just heavily subsidised with VC money. But that won't last forever. Uber Eats also used to be dirt cheap. Surprise! it's not anymore. And even if you just pay API prices for Opus - as opposed to using a subsidized subscription - you can easily reach the point where the tokens for AI-generated code become comparable in price to just paying a junior dev salary for a manual implementation. AI is…

Hardware has always gotten cheaper every year, and always will. You will be able to run Opus 4.6 tier models locally with junkyard hardware in 2035.

Citation needed. Hardware prices have gone up substantially in the past year.

Re: Code Is Cheap Now, and That Changes Everything

#55

Earlier quoted context omitted.

Hardware has always gotten cheaper every year, and always will. You will be able to run Opus 4.6 tier models locally with junkyard hardware in 2035.

Citation needed. Hardware prices have gone up substantially in the past year.

"global warming is not real because it's really cold today"

Re: Code Is Cheap Now, and That Changes Everything

#56

Earlier quoted context omitted.

Citation needed. Hardware prices have gone up substantially in the past year.

"global warming is not real because it's really cold today"

i guess my point was that it isn't a given that hardware will always be cheaper, considering that memory prices this past year have gone through the roof.

you may argue that it is an outlier and capacity will increase to meet demand, which it probably will, but who's to say that won't just mean further demand from unlimited money ai companies and then further increased consumer prices?

Re: Code Is Cheap Now, and That Changes Everything

#57

Earlier quoted context omitted.

I doubt that all of the providers hosting open models on open platforms are losing money on serving inference. They have the benefit of not having to pay for training, but the models are open and aren't going away anytime soon.

Sadly, I have not been able to find any open model that comes close to Opus 4.6. So while they are much cheaper to deploy, they also aren't good enough for unsupervised agent execution. But you need a model that can run unsupervised for the claim "Code is Cheap" to become possible.

I don't really think so. Maybe it's because the systems I build need to be reliable and understandable to humans, but I don't think Opus 4.6 is good enough to be unsupervised. I've spent a lot of time using it and I have to tell it no semi frequently and rewrite by hand/iterate with the model frequently. It's saves me a lot of time when used this way, I think, but I still have to give it overall structure and keep it scoped to small changes to prevent it from going down wrong paths and generating tons of unnecessary code (which is how you end up with unmaintainable slop). Less code is pretty much always better and these models made it really easy to ignore that until it's too late. This is on a healthy mix of greenfield and brownfield projects.

To that end, I've actually found Kimi K2.5 to be "good enough" for a lot of that, not quite as good at Opus 4.6, but good enough that it gets me like 80% of the value for a fraction of the cost and more speed.

Re: Code Is Cheap Now, and That Changes Everything

#58

Code is not cheap. It's just heavily subsidised with VC money. But that won't last forever. Uber Eats also used to be dirt cheap. Surprise! it's not anymore. And even if you just pay API prices for Opus - as opposed to using a subsidized subscription - you can easily reach the point where the tokens for AI-generated code become comparable in price to just paying a junior dev salary for a manual implementation. AI is…

Hardware has always gotten cheaper every year, and always will. You will be able to run Opus 4.6 tier models locally with junkyard hardware in 2035.

would opus 4.6 be relevant in 2035 ?

Re: Code Is Cheap Now, and That Changes Everything

#59
post #33

Interestingly, they landed on a conclusion which I have often argued against these days [0]. Code is absolutely cheap, and previously, it was the most important resource that we guarded. Entire job descriptions and functions were built to guard the engineer's time. Product owners, product managers, customer success, etc., all shielded the engineers who produced code because that was the scarcest resource. With that s…

According to Block. https://block.xyz/inside/from-hierarchy-to-intelligence. There will be three generalized roles in tech:

     Individual contributors (ICs) who build and operate capabilities, the model, the intelligence layer, and the interfaces. They are deep specialists and experts in a specific layer of the system. The world model provides the context that a manager used to provide, so ICs can make decisions about their layer without waiting to be told what to do.
     Directly Responsible Individuals (DRI) who own specific cross-cutting problems or opportunities and customer outcomes. A DRI might own the problem of merchant churn in a specific segment for 90 days, with full authority to pull resources from the world model team, the lending capability team, and the interface team as needed. DRIs may persist on certain problems or move elsewhere to solve new ones.
     Player-coaches who combine building with developing people. They replace the traditional manager whose primary job was information routing. A player-coach still writes code or builds models or designs interfaces. They also invest in the growth of the people around them. They don't spend their days in status meetings, alignment sessions, and priority negotiations. The world model handles alignment. The DRI structure handles strategy and priority. The player-coach handles craft and people.
To give a sports analogy. The player-coaches are the coach who rose through the ranks and now gets to choose and develop the other players on the team. The individual contributors are functional specialists e.g., defender, halfback, forward etc. The DRI "own" specific scenarios e.g.: penalty kicks, throw-in at the corner etc.

Re: Code Is Cheap Now, and That Changes Everything

#60
> AI is a nail gun. In the hands of someone unskilled, it’s dangerous. In the hands of a professional, it speeds them up enormously. And in the end, all anyone cares about is that a nail exists in that location.

This is very interesting. In the world of AI coding, it's not enough to put the nail on the right spot, at the right angle and flush with the surface. You also need to ensure each nail will remain in that exact position as the system evolves. Agents have a tendency to touch parts of the system they didn't have to, and catching those problems can be evry tricky.

Obvious caveat that as the system evolves, a prior nail may actually have to be removed. That's not the situation I'm talking about.

Post reply on HN