Code is not cheap. It's just heavily subsidised with VC money. But that won't last forever. Uber Eats also used to be dirt cheap. Surprise! it's not anymore. And even if you just pay API prices for Opus - as opposed to using a subsidized subscription - you can easily reach the point where the tokens for AI-generated code become comparable in price to just paying a junior dev salary for a manual implementation. AI is…
I doubt that all of the providers hosting open models on open platforms are losing money on serving inference. They have the benefit of not having to pay for training, but the models are open and aren't going away anytime soon.
Code Is Cheap Now, and That Changes Everything
51–60 of 62 posts
Re: Code Is Cheap Now, and That Changes Everything
#52Code is not cheap. It's just heavily subsidised with VC money. But that won't last forever. Uber Eats also used to be dirt cheap. Surprise! it's not anymore. And even if you just pay API prices for Opus - as opposed to using a subsidized subscription - you can easily reach the point where the tokens for AI-generated code become comparable in price to just paying a junior dev salary for a manual implementation. AI is…
Re: Code Is Cheap Now, and That Changes Everything
#53Earlier quoted context omitted.
I find it amusing that software developers have no issue with having an LLM churn out slop code but have such a visceral reaction to slop articles.
I have no issue with with code generated by e.g. Claude because it's not "slop". On average, it's probably better than the code I would write. I say "on average" because AI doesn't make stupid mistakes, doesn't invert logical conditions. I know I do. Which I eventually fix, but it's better to not make them in the first place, hence "on average". And in cases that AI doesn't generate code up to my quality standards, I…
Re: Code Is Cheap Now, and That Changes Everything
#54Code is not cheap. It's just heavily subsidised with VC money. But that won't last forever. Uber Eats also used to be dirt cheap. Surprise! it's not anymore. And even if you just pay API prices for Opus - as opposed to using a subsidized subscription - you can easily reach the point where the tokens for AI-generated code become comparable in price to just paying a junior dev salary for a manual implementation. AI is…
Hardware has always gotten cheaper every year, and always will. You will be able to run Opus 4.6 tier models locally with junkyard hardware in 2035.
Re: Code Is Cheap Now, and That Changes Everything
#55Earlier quoted context omitted.
Hardware has always gotten cheaper every year, and always will. You will be able to run Opus 4.6 tier models locally with junkyard hardware in 2035.
Citation needed. Hardware prices have gone up substantially in the past year.
Re: Code Is Cheap Now, and That Changes Everything
#56Earlier quoted context omitted.
Citation needed. Hardware prices have gone up substantially in the past year.
"global warming is not real because it's really cold today"
you may argue that it is an outlier and capacity will increase to meet demand, which it probably will, but who's to say that won't just mean further demand from unlimited money ai companies and then further increased consumer prices?
Re: Code Is Cheap Now, and That Changes Everything
#57Earlier quoted context omitted.
I doubt that all of the providers hosting open models on open platforms are losing money on serving inference. They have the benefit of not having to pay for training, but the models are open and aren't going away anytime soon.
Sadly, I have not been able to find any open model that comes close to Opus 4.6. So while they are much cheaper to deploy, they also aren't good enough for unsupervised agent execution. But you need a model that can run unsupervised for the claim "Code is Cheap" to become possible.
To that end, I've actually found Kimi K2.5 to be "good enough" for a lot of that, not quite as good at Opus 4.6, but good enough that it gets me like 80% of the value for a fraction of the cost and more speed.
Re: Code Is Cheap Now, and That Changes Everything
#58Code is not cheap. It's just heavily subsidised with VC money. But that won't last forever. Uber Eats also used to be dirt cheap. Surprise! it's not anymore. And even if you just pay API prices for Opus - as opposed to using a subsidized subscription - you can easily reach the point where the tokens for AI-generated code become comparable in price to just paying a junior dev salary for a manual implementation. AI is…
Hardware has always gotten cheaper every year, and always will. You will be able to run Opus 4.6 tier models locally with junkyard hardware in 2035.
Re: Code Is Cheap Now, and That Changes Everything
#59Interestingly, they landed on a conclusion which I have often argued against these days [0]. Code is absolutely cheap, and previously, it was the most important resource that we guarded. Entire job descriptions and functions were built to guard the engineer's time. Product owners, product managers, customer success, etc., all shielded the engineers who produced code because that was the scarcest resource. With that s…
Individual contributors (ICs) who build and operate capabilities, the model, the intelligence layer, and the interfaces. They are deep specialists and experts in a specific layer of the system. The world model provides the context that a manager used to provide, so ICs can make decisions about their layer without waiting to be told what to do.
Directly Responsible Individuals (DRI) who own specific cross-cutting problems or opportunities and customer outcomes. A DRI might own the problem of merchant churn in a specific segment for 90 days, with full authority to pull resources from the world model team, the lending capability team, and the interface team as needed. DRIs may persist on certain problems or move elsewhere to solve new ones.
Player-coaches who combine building with developing people. They replace the traditional manager whose primary job was information routing. A player-coach still writes code or builds models or designs interfaces. They also invest in the growth of the people around them. They don't spend their days in status meetings, alignment sessions, and priority negotiations. The world model handles alignment. The DRI structure handles strategy and priority. The player-coach handles craft and people.
To give a sports analogy. The player-coaches are the coach who rose through the ranks and now gets to choose and develop the other players on the team. The individual contributors are functional specialists e.g., defender, halfback, forward etc. The DRI "own" specific scenarios e.g.: penalty kicks, throw-in at the corner etc.Re: Code Is Cheap Now, and That Changes Everything
#60This is very interesting. In the world of AI coding, it's not enough to put the nail on the right spot, at the right angle and flush with the surface. You also need to ensure each nail will remain in that exact position as the system evolves. Agents have a tendency to touch parts of the system they didn't have to, and catching those problems can be evry tricky.
Obvious caveat that as the system evolves, a prior nail may actually have to be removed. That's not the situation I'm talking about.