Live data from Hacker News

Model intelligence is no longer the constraint for automation

latentintent.substack.com

151–156 of 156 posts

Re: Model intelligence is no longer the constraint for automation

#151
post #118
post #74

> It’s because the bottleneck isn’t in intelligence, but in human tasks: specifying intent and context engineering. So the bottleneck is intelligence. Junior engineers are intelligent enough to understand when they don't understand. They interrogate the intent and context of the tasks they are given. This is intelligence. Solving math questions is not intelligence, computers have been better than humans at that for l…

> Junior engineers are intelligent enough to understand when they don't understand. They interrogate the intent and context of the tasks they are given Eh, I wouldn't apply that as if it's a general thing. yes, the really good ones do. many will equally plough through into the mud with albeit admirable determination.

yeah so the LLMs are like a stupid junior

only they work for free and produce megabytes of stupid code per hour

Re: Model intelligence is no longer the constraint for automation

#152
post #16

Earlier quoted context omitted.

That's was the initial thinking of anyone which I explained this, it was also my speculation, but when you look in it's reasoning where it do the mistake, it correctly extract the digits out of the input token. As I say in another comments, most of the mistakes her happen when it recopy the answer it calculated from the summation table. You can avoid tokenization issue when it extract the answer by making it output a…

I recently saw someone that posted a leaked system prompt for GPT5 (and regardless of the truth of the matter since I can't confirm the authenticity of the claim, the point I'm making stands alone to some degree). A portion of the system prompt was specifically instructing the LLM that math problems are, essentially, "special", and that there is zero tolerance for approximation or imprecision with these queries. To s…

o/~ Mathematics keeps your intellect intact / many answers should be carefully exact

But for daily application, use a close approximation, round it off.. o/~

Re: Model intelligence is no longer the constraint for automation

#153
post #151
post #118

Earlier quoted context omitted.

> Junior engineers are intelligent enough to understand when they don't understand. They interrogate the intent and context of the tasks they are given Eh, I wouldn't apply that as if it's a general thing. yes, the really good ones do. many will equally plough through into the mud with albeit admirable determination.

yeah so the LLMs are like a stupid junior only they work for free and produce megabytes of stupid code per hour

a junior that can instantly fix a problem spotted by a senior even if it involves touching 10 files. no meat junior can do that.

Re: Model intelligence is no longer the constraint for automation

#154
post #125

Earlier quoted context omitted.

When the celibate classes have been able to sublimate what is arguably the strongest of all wants for as long as they have, I doubt there is any desire that could not be redirected with similar techniques.

Lol buddy if you really believe there are any "celibate classes" then you've fallen for the oldest con in the world.

Such cynicism! I’m proudly celibate, like my father before me, and my grandfather before him!

Re: Model intelligence is no longer the constraint for automation

#155

Earlier quoted context omitted.

Do you have a concrete example of what you mean? For example, the article above was insightful. But the authors pointing to 1,000s of disparate workflows that could be solved with the right context, without actually providing 1 concrete example of how he accomplishes this makes the post weaker.

Sure, concrete example. We do conversational AI for banks, and spend a lot of time on the compliance side. Biggest thing is we don't want the LLM to ever give back an answer that could violate something like ECOA. So every message that gets generated by the first LLM is then passed to a second series of LLM requests + a distilled version of the legislation. ex: "Does this message imply likelihood of credit approval (…

Thank you! Great example!

Re: Model intelligence is no longer the constraint for automation

#156
post #8

Earlier quoted context omitted.

Tic-tac-toe is solved and a draw can be forced 100% of the time...

.. and you can "program" a neural network — so simple it can be implemented by boxes full of marbles and simple rules about how to interact with the boxes — to learn by playing tictactoe until it always plays perfect games. This is frequently chosen as a lesson in how neural network training even works. But I have a different challenge for you: train a human to play tictactoe, but never allow them to see the game vis…

tic-tac toe is merely a visualization of a small arithmetic game "sum 3 digits to 15"

   618   
   753
   294
Post reply on HN