Live data from Hacker News

Show HN: Why write code if the LLM can just do the thing? (web app experiment)

github.com

321–330 of 332 posts

Re: Show HN: Why write code if the LLM can just do the thing? (web app experiment)

#321
post #299

Earlier quoted context omitted.

I suspect you may be either underestimating how efficient our brains are at computing or severely underestimating how much energy these AI models take to train and run. Even including our system of comfort like refrigerated blueberries in January and AC cooling a 40° C heat down to 25° C (but excluding car commutes, because please work from home or take public transit) the human is still far far more energy efficient…

Wait hold on, let's put some numbers on this. Please correct my calculations if I'm wrong. 1. The human brain draws 12 - 20 watts [1, 2]. So, taking the lower end, a task taking one hour of our time costs 12 Wh. 2. An average ChatGPT query is between 0.34 Wh - 3 Wh. A long input query (10K tokens) can go up to 10 Wh. [3] I get the best results by carefully curating the context to be very tight, so optimal usage would…

In my go example we have a human and an AI model competing at the same task. A good AI model will perform much much much better and probably win the game, but if we measure the energy input into either player the AI model will consume a lot more energy. However a game of go is not automation, it won’t save us any time. The benefits of the AI model is it helps human go players improve their own game, finding new moves, new patterns, new proverbs, etc. Because of go playing AI models human go players now play their games better, but nor more efficiently, nor faster.

In your LLM coding example you have a human and an AI model collaborating on a single task, both spend some amount of energy (taking your assumptions at face value, compatible amount of energy) and produce a single outcome. In the go example it is easy to compare energy usage and the quality of the outcome is also easy to measure (simply who won the game). In your coding example the quality of the outcome is impossible to measure, and because the effort is collaborative, splitting the energy usage is complected.

When talking about automation my game of go example falls apart. A much better examples would be something like a loom, or a digital calculator. These tools help the human arrive at a particular outcome much faster and with much less effort then a human performing the task without the help of the machines. The time saved by using these tools are measured in several orders of magnitudes, and the energy spent is at par with a human. It is easy to see how a loom or a digital calculator are more efficient then a human.

I guess if we take into account the training cost of an LLM model we should also take into account the production costs of looms and digital calculators. I don‘t know how to do that, but I can’t imagine it would be anywhere close to that of an LLM model.

And we have an LLM model we have increased the productivity of, not 5000x[1], but by 5%-30%. To me this does not sound like a revolutionary technology. But I have my doubts of even the 5%-30% figure. We have preliminary research ranging anywhere from negative productivity increase to your cited 5%-30%. We will have to wait for more research, and possibly some meta-analysis before we can accurately assess the productivity boost of LLMs. But we will have to do a whole lot better then 5%-30% to sufficiently justify the huge energy consumption of AI[2].

Personally, I am not convinced by your back of the envelope calculations. It fails my sniff test that 9 Wh of matrix multiplication will consistently save you an hour of using your brain to perform the same task adequately. I know our brains are not super good at the logic required for coding (but neither are LLMs), but I know for a fact they are very efficient at it.

That said I refuse to accept your framing that we can simply ignore the energy used in training, on the bases that it is equally invalid as considering the energy used for evolving into our species, or that we can simply stop training new models and use the models we do have. That is simply not how things work. New models will get trained (unless the AI bubble bursts and the market looses interest) and the energy consumed by training is the bulk of the energy cost. And omitting it makes the case for AI comically easy to justify. I reject this framing.

Instead of calculating, instead I’m gonna do a thought experiment. Imagine a late 19th century where iron and steel production took an entire 2% of world’s energy consumption[3] (maybe an alternative reality where Iron working is simply that challenging and requires much higher temperatures to work). But the steam train could only carry the same load as a 20 mule team, and would only do it 5%-30% faster on average then the state of the art cargo carriages at the time without steam power. Would you accept the argument that we should simply ignore the fact that rail production takes a whopping 2% of global energy consumption, when factoring the energy consumption of the steam train, even when it only provides you with 5%-30% productivity boost. I don‘t think so.

---

1: I don‘t know how much the loom has increased productivity, but this is what I would guess without any way of knowing how to even find out.

2: That is, if you are only interested in the increased productivity. If you are interested in the LLM models for some other reason, those reason will have to be measured differently.

3: https://www.allaboutai.com/resources/ai-statistics/ai-enviro...

Re: Show HN: Why write code if the LLM can just do the thing? (web app experiment)

#322

Earlier quoted context omitted.

And yet that money is ultimately spent on more means to ends that are just as inconvenient from another perspective? My point was that there is no true end goal as long as whims continue. The need to craft yet more means is equally endless. The crafting is the primary human experience, not the using. The using of a means inevitably becomes transparent and boring.

It should finalize into introducing satisfaction to the whims directly, so the AI would be directly managing the chemicals in our brains that would trigger feelings of reward and satisfaction.

I think you're just describing drugs

Re: Show HN: Why write code if the LLM can just do the thing? (web app experiment)

#323

Earlier quoted context omitted.

Most of us actually drive a car to get somewhere. The car, and the driving, are just a modality. Which is the point.

If this was a good answer to mobility, people would prefer the bus over their car. It’s non-deterministic - when will it come? How quick will i get there? Will i get to sit? And it’s operated by an intelligent agent (driver). Every reason people prefer a car or bike over the bus is a reason non-deterministic agents are a bad interface. And that analogy works as a glimpse into the future - we’re looking at a fast appr…

Here in Switzerland the bus is the deterministic choice. Just saying.

Re: Show HN: Why write code if the LLM can just do the thing? (web app experiment)

#324

Earlier quoted context omitted.

It should finalize into introducing satisfaction to the whims directly, so the AI would be directly managing the chemicals in our brains that would trigger feelings of reward and satisfaction.

I think you're just describing drugs

Yes, but current drugs have many issues such as tolerance build up and withdrawals. If AI could figure out how to directly manage chemicals in the brain in such a way that it keeps working, it would be able to attain its goals of making people happy.

Re: Show HN: Why write code if the LLM can just do the thing? (web app experiment)

#325
post #299

Earlier quoted context omitted.

Wait hold on, let's put some numbers on this. Please correct my calculations if I'm wrong. 1. The human brain draws 12 - 20 watts [1, 2]. So, taking the lower end, a task taking one hour of our time costs 12 Wh. 2. An average ChatGPT query is between 0.34 Wh - 3 Wh. A long input query (10K tokens) can go up to 10 Wh. [3] I get the best results by carefully curating the context to be very tight, so optimal usage would…

In my go example we have a human and an AI model competing at the same task. A good AI model will perform much much much better and probably win the game, but if we measure the energy input into either player the AI model will consume a lot more energy. However a game of go is not automation, it won’t save us any time. The benefits of the AI model is it helps human go players improve their own game, finding new moves…

Sure, let's put some numbers on the thought experiment. Oversimplifying everything: say before AI, 100% of the world's energy enabled 100 units of productivity. Now, adding 2% more power for AI (which includes the training!), 102% buys us 105 units of productivity at the lower end? That's a good deal!

Of course, realistically speaking, the 5-30% boost is only across certain domains in knowledge work, not all work ever, so we're not gonna see a 105% boost globally. To get a fairer comparison, let's look at the US in 2024 where we have some broad data about AI power usage for and its overall productivity impact.

For power [1] indicates datacenters accounted for about 4.4% of all US power demand in 2024. From [2] it seems upto 20% of that was for AI workloads. That gives us 0.88% of total US power consumed by AI in 2024.

Now look at [2]. This is a St. Louis Fed study based on broad survey data which finds similar ~25% productivity boosts across multiple industries, which is comparable to other randomized studies on empirical data (some included in my previous links.) They estimate that current levels of AI usage in only the industries and roles exposed to it may already be improving total US labor productivity by upto 1.2%!

So we are probably already a bit better than breakeven!

Now consider that productivity will only keep increasing as people and companies learn to harness AI properly. As anecdotal evidence, notice how the sentiments about AI-based coding have shifted on this very forum; you see way more converts than skeptics.

Also consider that [3] found that people still use AI for a small part of their workday. As usage increases, so will productivity. Power consumption will go up too, but from all the above it looks very much like the tradeoff is very favorable to AI.

Yes we need more studies and data, but the ones we have so far are already sort of mind-blowing.

[1] https://www.pewresearch.org/short-reads/2025/10/24/what-we-k...

[2] https://www.wired.com/story/new-research-energy-electricity-...

[3] https://s3.amazonaws.com/real.stlouisfed.org/wp/2024/2024-02...

Re: Show HN: Why write code if the LLM can just do the thing? (web app experiment)

#326

This demo is pretty great, I love it! And it reminded me a little about NeuralOS, which appeared here a couple months ago [1]. NeuralOS is different though as they decided to just skip the UI part, too, and let the UI generate based on intent. Maybe together with your approach we can finally reproduce all the funny holodeck bugs from Star Trek! [1] https://github.com/yuntian-group/neural-os

Sneed

Re: Show HN: Why write code if the LLM can just do the thing? (web app experiment)

#327

You're still operating with layers of lexical abstraction and indirection. Models full of dated syntactic and semantic concepts about software that waste cycles. Ultimately useless layers of state that the goal you set out to test for inevitably complicates the process. In chip design land we're focused on streamlining the stack to drawing geometry. Drawing it will be faster when the machine doesn't have decades of p…

I'm not sure I follow this entirely, but if the assertion is that "everything is math" then yeah, I totally agree. Where I think language operates here is as the medium best situated to assign objects to locations in vector space. We get to borrow hundreds of millions of encodings/relationships. How can you plot MAN against FATHER against GRAPEFRUIT using math without circumnavigating the human experience?

When I write to an unknown audience, unable to know in advance what terms they rely on, I tend to circumlocute to build emotional subtext. They might only get some percent but it may be familiar enough terms to act as middleware to the rest.

The words Man, father, and grapefruit aren't essential to existence of man, father, grapefruit. All existed before language.

What you mean by "human experience" is "bird song my culture uses to describe shared space". Leave meaning to be debated in meat space and include the current geometry of the language in the model. Just make it mutable.

The machine can just focus on rendering geometry to the pixel limit of the machine using electrical theory; it doesn't need to care internally if it's text with meaning. It's only represented like that on the screen anyway. Compress the information required to just geometric representation and don't anthropomorphize machine state manipulation.

Re: Show HN: Why write code if the LLM can just do the thing? (web app experiment)

#328
Why generate code at all?

Because there are times when you use code in order to generate content. For instance, a complicated document in a content creating documentation. (Anything: graphics, music, corporate documents, ...).

Suppose that, on the spot, AI writes you a software suite in which you create a document.

Do you dare throw that suite away, hoping that AI will write a compatible one tomorrow which can still open and correctly handle all details of that complex document?

Re: Show HN: Why write code if the LLM can just do the thing? (web app experiment)

#329
post #281

Earlier quoted context omitted.

Bank tellers are deterministic though. They have a set protocol for each cases and escalate unknown cases to a more deterministic point of contact. It will be difficult to incorporate relative access or restrictions to features with respect to users current/known state or actions. Might as well write the entire web app at that point.

I think the bank teller's systems and processes are deterministic, but the teller itself is not. They could even rob the bank, if they wanted to. They could shoot the customers. They don't, generally, but they can. I think, if we can efficiently capture a way to "make" LLMs conform to a set of processes, you can cut out the app and just let the LLM do it. I don't think this makes any sense for maybe the next decade,…

The actual app is the set of processes.

Re: Show HN: Why write code if the LLM can just do the thing? (web app experiment)

#330

Earlier quoted context omitted.

I think this is well illustrated in a lot of science fiction. Irregular or abstract tasks are fairly efficiently articulated in speech, just like the ones you provided. Simpler, repetitive ones are not. Imagine having to ask your shower to turn itself on? Or your doors to open? Contextualized to "web-apps," as you have; navigating a list maybe requires an interface. It would be fairly tedious to differentiate between…

On a tangent but I still don't know why we don't have showers where you just press a button and it delivers water at the correct temperature. It seems like the simplest thing that everyone wants. A company that manufactures and installs this (a la SolarCity) should be an instant unicorn.

For what it's worth, Northern European showers typically have two independent controls: temperature and flow. Leave the temperature at what you think is good, and either wait a moment for hot water to reach the end of the pipe or install a recirculating loop.
Post reply on HN