Live data from Hacker News

What Happens When the Cost of Intelligence Drops 100x

catalystneuro.com

11–20 of 151 posts

Re: What Happens When the Cost of Intelligence Drops 100x

#11
100x seems like an underestimate. Even with no model improvements, we should see that sort of reduction. Looking at TSMC’s margins, Nvidia’s margins, and OAI/Anth (alleged) margins on inference, there is a room for a 100x reduction.

Right now all three of those are at abnormally high levels. Competition will come for all three.

Re: What Happens When the Cost of Intelligence Drops 100x

#12

I think a big one is robotics. A robot can today fold your laundry. It takes ~10mins per item. Seriously. It takes a long time to process the image find the corner move the claw to the corner of the shirt and attempt to straighten before folding. Robots right now generally move at glacial speeds. You might have seen robots doing flips in semi controlled environments but watch how slowly they open doors etc. processin…

You must not have been paying attention to development with robots, there are many videos of robots moving really fast in "non controlled environments"

Re: What Happens When the Cost of Intelligence Drops 100x

#13
A year ago I had an aha moment, when I realized that for my purposes, Gemini Flash was not only 9x cheaper, but 3x faster than Gemini Pro, while producing identical output. Who's the best model now!

For a lot of tasks, even small models have saturated them a while ago, and then going cheaper and faster is just pure gains.

For coding I also prefer to do it interactive/realtime, micro-prompting, surgical edits, which the small models can handle just fine.

And then at the top, the real question is consistency. Not "can they do it" but "reliably enough that you don't need to constantly double check everything." (In my experience, not quite there yet, although it's getting way better.)

Re: What Happens When the Cost of Intelligence Drops 100x

#14

I think a big one is robotics. A robot can today fold your laundry. It takes ~10mins per item. Seriously. It takes a long time to process the image find the corner move the claw to the corner of the shirt and attempt to straighten before folding. Robots right now generally move at glacial speeds. You might have seen robots doing flips in semi controlled environments but watch how slowly they open doors etc. processin…

Have LLMs improved at being able to process physics-based problems and environments? I remember that issue being discussed around generative gaming a while ago but I hadn't heard much about it recently.

Re: What Happens When the Cost of Intelligence Drops 100x

#15
Personally I still see LLMs as very advanced search engines which lack intelligence. To me it seems that the cost of getting data is reduced by LLMs, not the cost of intelligence. I mean: we tell the model what we want to achieve, and the model responds with the right data in de form of code in seconds.

That's why 'stackoverflow programmers' will have a hard time competing with LLMs but engineers are still needed for their intelligence.

Well that's just my 2 cents.

Re: What Happens When the Cost of Intelligence Drops 100x

#16
post #4

There’s still 50-500x cost reduction in “this is only an engineering problem” low hanging fruit from specialized chips to run the models + improved distillation. Entirely feasible that by 2031, Fable 5 (or greater) intelligence level models will run cool on smart phones, if not sooner.

I saw a 1B model yesterday that was fine tuned on Fable output. I found that hilarious, but it did actually make all the scores go up.

(Actually talking to it, it was about as coherent as you'd expect, i.e. 3/10)

The floor for "actually usable model" keeps dropping though. (Seems to be about 27B right now?)

Re: What Happens When the Cost of Intelligence Drops 100x

#17

I think a big one is robotics. A robot can today fold your laundry. It takes ~10mins per item. Seriously. It takes a long time to process the image find the corner move the claw to the corner of the shirt and attempt to straighten before folding. Robots right now generally move at glacial speeds. You might have seen robots doing flips in semi controlled environments but watch how slowly they open doors etc. processin…

Xiaomi robots do this in double digit seconds.

Still slow compared to humans, but Chinese robots will be as successful as Chinese EVs, phones and solar panels.

Re: What Happens When the Cost of Intelligence Drops 100x

#18
This means a great de-risking is happening for the costs of deploying somewhat autonomous agents. This has profound implications on the timeline of deployable personal agents. Cost was a significant factor for many people during the OpenClaw frenzy, specifically when they let their agents run somewhat wild. It will become much more palatable, or already has, to install whatever the next generation of token consuming autonomous systems will be.

Re: What Happens When the Cost of Intelligence Drops 100x

#20

I think a big one is robotics. A robot can today fold your laundry. It takes ~10mins per item. Seriously. It takes a long time to process the image find the corner move the claw to the corner of the shirt and attempt to straighten before folding. Robots right now generally move at glacial speeds. You might have seen robots doing flips in semi controlled environments but watch how slowly they open doors etc. processin…

You must not have been paying attention to development with robots, there are many videos of robots moving really fast in "non controlled environments"

Yes, I think I saw one in a video titled "Robocop"
Post reply on HN