Author here. I made these plots because I had been searching for them for months and never found quite what I wanted: how the cheapest way to reach a fixed capability level has moved over time. Artificial Analysis publishes enough data to reconstruct it. If someone knows of a source that already tracks this, with historical prices, please share.
What Happens When the Cost of Intelligence Drops 100x
61–70 of 151 posts
Re: What Happens When the Cost of Intelligence Drops 100x
#62Personally I still see LLMs as very advanced search engines which lack intelligence. To me it seems that the cost of getting data is reduced by LLMs, not the cost of intelligence. I mean: we tell the model what we want to achieve, and the model responds with the right data in de form of code in seconds. That's why 'stackoverflow programmers' will have a hard time competing with LLMs but engineers are still needed for…
Btw. an advanced search engine is probably the worst comparision i have read so far.
A LLM is a latent space which is capable of a lot of things a search engine can't do. It can apply different type of patterns and flows onto data, it can combine these etc.
My 'advanced search engine' was just able to create a working PR for exactly what i wanted it to solve (fixing a bug) by analysing the bug, finding a valid solution then commiting the solution itself.
Re: What Happens When the Cost of Intelligence Drops 100x
#63Re: What Happens When the Cost of Intelligence Drops 100x
#64Idiocy becomes rampant!
Even if its not intelligence, a LLM found a bug due to one error message, fixed it, created a PR and it solved it.
If an LLM is only able to do all of this after training on it and never achieving AGI, we already at the point were it is cheaper to teach one LLM one problem than teaching humans to do so.
Re: What Happens When the Cost of Intelligence Drops 100x
#65Jevons Paradox [1] > when technological improvements that increase the efficiency of a resource's use lead to a rise, rather than a fall, in total consumption of that resource. [1] - https://en.wikipedia.org/wiki/Jevons_paradox Las Vegas replaced the expensive incandescent lighting on the strip with cheaper to run LED equivalents. But the costs didn't come down because they were able to add more lights and larger dis…
I anticipate we will see something similar with intelligence. There is probably headroom to consume 100x as much intelligence in R&D. But that isn't most of the economy. Will run of the mill service jobs increase their use of intelligence by enough to offset the effect of cheaper prices? I think that's the real question.
Re: What Happens When the Cost of Intelligence Drops 100x
#66Jevons Paradox [1] > when technological improvements that increase the efficiency of a resource's use lead to a rise, rather than a fall, in total consumption of that resource. [1] - https://en.wikipedia.org/wiki/Jevons_paradox Las Vegas replaced the expensive incandescent lighting on the strip with cheaper to run LED equivalents. But the costs didn't come down because they were able to add more lights and larger dis…
Re: What Happens When the Cost of Intelligence Drops 100x
#67Re: What Happens When the Cost of Intelligence Drops 100x
#68Re: What Happens When the Cost of Intelligence Drops 100x
#69Re: What Happens When the Cost of Intelligence Drops 100x
#70With coding agents, cheap intelligence doesn't just mean producing the same software for less, but rather trying five implementations, letting agents run longer, touching larger scopes, and supervising fewer intermediate steps.
That changes which infrastructure matters. When attempts are expensive, you optimize for success, while when attempts are cheap, you start optimizing for how cheaply you can inspect, reject and recover from failure.
Git was an enormous enabler of cheap human experimentation, and I suspect we'll end up building analogous primitives around autonomous work.