Anthropic has a definition: Workflows are systems where LLMs and tools are orchestrated through predefined code paths. Agents, on the other hand, are systems where LLMs dynamically direct their own processes and tool usage, maintaining control over how they accomplish tasks https://www.anthropic.com/engineering/building-effective-age... While I know it's a marketing term, I think a good distinction is that agents hav…
"An AI agent is a system that uses an LLM to decide the control flow of an application."
What gets left unsaid is whether current SOTA LLMs actually have the reasoning and planning capabilities to do this reliably. I would argue that except for code debugging tasks and simple research tasks (iterative Googling with a web browser and then formatting the results into a report format) they do not. That may change in 6 months, but right now the hype has gotten ahead of the capability.