Earlier quoted context omitted.
> It's provable; if just chaining LLMs are a particular size into agentic systems could scale indefinitely, then you could use a 1-param LLM and get AGI. You can't. QED. Perhaps I missunderstand your reply, but that has not been my experience at all. There are 3 types of "agentic" behaviour that has worked for a while for me, and I don't know how else it would work without "agents": 1. Task decomposition - this was m…
I didn’t say they don’t work, I said there is an upper bound on the function they provide. If a discrete system can be composed of multiple LLMs the upper bound on the function they provide is by the function of the LLM, not the number of agents. Ie. We have agentic systems. Saying “wait till you see those agentic systems!” is like saying “wait til you see those c++ programs!” Yes. I see them. Mmm. Ok. I don’t think…
Actually o1, o3 are doing exactly this, and very well. I.e. explicitly: by proper orchestration the same LLM can do much better job. There is a price, but...
> you would expect to be able to build agentic systems out of much smaller LLMs
Good point, it should be possible to do it on a high-end pc or even embedded.