Live data from Hacker News

Managing AI Coding Costs at Scale

databricks.com

201–210 of 268 posts

Re: Managing AI Coding Costs at Scale

#201
post #36

Earlier quoted context omitted.

> I work at a small startup How does a “small startup” end up with a multi million line “legacy” codebase? Something not mathing

You'd be surprised. I met a guy last week who was proud to tell me he had vibe coded an almost 2 million line code base. The app did not sound that complicated, so I'm assuming it's full of copy-pasta flavored slop.

Meanwhile I'm so proud that I'm keeping my hobby project under 10k lines and spend time trying to delete code for my own sanity

Re: Managing AI Coding Costs at Scale

#202

Earlier quoted context omitted.

Do you think Anthropic or OpenAI will eventually try to crack down on routing harnasses? Provide a more vertically integrated experience? They are already trying ro ship hardware products.

I will believe there is no moat when the revenues for Anthropic is not 70B. It seems like people want to throw away money and they don’t like switching

There is no evidence that Anthropic's revenue is 70B.

Re: Managing AI Coding Costs at Scale

#203
post #16

I would be really curious to hear from devs at Databricks what the experience of development is like internally. I work at a small startup with essentially unlimited AI spend budget - the entire point is that I should be turning to it at every opportunity since our human labor is so expensive relative to tokens. So generally it's like: - Spend most time prioritizing/discussing what to do. - Once that's agreed, use Fa…

Interesting. I would probably start with the QA plan first, or at least before implementation (and perhaps even before design.)

Re: Managing AI Coding Costs at Scale

#204
post #16

I would be really curious to hear from devs at Databricks what the experience of development is like internally. I work at a small startup with essentially unlimited AI spend budget - the entire point is that I should be turning to it at every opportunity since our human labor is so expensive relative to tokens. So generally it's like: - Spend most time prioritizing/discussing what to do. - Once that's agreed, use Fa…

> I probably spend like $80

mate, if youre not using subscription then youre spending waaaaaaay more. the plan itself with fable/sol will most likely have already cost more then $80 -- ime thats more like 500-2k/day of usage.

most harnesses let you see the usage in the status bar, i encourage you to enable it

Re: Managing AI Coding Costs at Scale

#205

I suspect that when it comes to hard complex software products, you’re better off ignoring agents and doing “trad coding”. What you lose in short term speed you gain in manageable complex codebases. If you have a 500k line codebase and even > 50% is written by agents, you are in a world of pain that won’t justify the costs longer term. Now of course, there are products that just involve lots of code but are not actua…

> if you have a 500k line codebase and even > 50% is written by agents, you are in a world of pain that won’t justify the costs longer term A bold claim to make with little to no supporting evidence

We are 7 years into a cycle of people baselessly claiming that "AI" will soon develop superhuman abilities and might just take over the world, before killing us all. I don't think there's any way to take part in this discourse without making somewhat unsupported claims.

Re: Managing AI Coding Costs at Scale

#207
post #16

I would be really curious to hear from devs at Databricks what the experience of development is like internally. I work at a small startup with essentially unlimited AI spend budget - the entire point is that I should be turning to it at every opportunity since our human labor is so expensive relative to tokens. So generally it's like: - Spend most time prioritizing/discussing what to do. - Once that's agreed, use Fa…

Does it not end. Like is there not a point with all this speedups and infinite intelligence that your software system is essentially done.

Re: Managing AI Coding Costs at Scale

#209

Earlier quoted context omitted.

It took me a few seconds of deliberating if The Homer was a reference to baseball or "The Odyssey" and then realized there was a footnote > software production has become a mass-produced commodity in every sense - it's much more expensive to produce software manually, but the quality is not the same. Agreed.

I believe “The Homer” is a reference to Season 2, Episode 15 of The Simpsons, “Oh Brother, Where Art Thou?” Homer reunites with his long lost brother, who runs car company Powell Motors. Homer is ultimately tasked by his brother with helping to design a car for the “average man” that ultimately bankrupts the company for being wildly overengineered and costing too much ($82,000 in 1991-money) . Here’s the car: https:/…

This monstrosity cost $82,000?!

https://amphetamem.es/meme?id=the-simpsons_02_15_490&text=Th...

Re: Managing AI Coding Costs at Scale

#210

Earlier quoted context omitted.

Whatever you are making this year as SWE you'll be making less next year if the current trend in improvement of AI coding aids is going to be sustained. Think about it : programmers used to derive a lot of their value from the fact that it was a hard skill to acquire. My kids can now 'vibe code' stuff faster (and better looking) than what I could come up with as the beginnings of a design plan. And then I still need…

There's a massive difference between your kids vibe coding something and an engineer using AI to implement something. If you're unable to discern the difference, that's something to reflect on :)

If he is unable to discern a difference, then a paying customer almost certainly won't.

We're entering a market of lemons in software. It's going to be interesting indeed.

Post reply on HN