Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

K2-think: A parameter-efficient reasoning system

arxiv.org

Post reply on HN
Print view View original

1–9 of 9 posts

Re: K2-think: A parameter-efficient reasoning system

#4

Post by softwaredoug »

Can reasoners be optimizers?

Like does reasoning find a gradient to optimize a solution? Or are they just trying to expand state until finding what the LLMs world knowledge would say is highest probability?

For example, I can imagine an LLM reasoner might run out of state trying to perfectly solve for 50 intricate unit tests. Because it ping pongs between solving one case, then another, playing whack-a-mole and not converging.

Maybe there's an "oh duh" answer to this, but where I struggle with the limits of agentic work vs traditional ML.

Re: K2-think: A parameter-efficient reasoning system

#5

Post by ACCount37 »

softwaredoug wrote: post #4

Can reasoners be optimizers? Like does reasoning find a gradient to optimize a solution? Or are they just trying to expand state until finding what the LLMs world knowledge would say is highest probability? For example, I can imagine an LLM reasoner might run out of state trying to perfectly solve for 50 intricate unit tests. Because it ping pongs between solving one case, then another, playing whack-a-mole and not c…

They can be, in the same way humans can be optimizers.

In most cases, there's no explicit descent - and if any descent-like process happens at all, it's not exactly exposed or expressed as hard logic.

If you want it to happen consistently, you add scaffolding and get something like AlphaEvolve at home.

Post reply on HN