As a manager you have to strike a balance between absolute productivity/efficiency and accountability diffusion: lose enough people to spread accountability and it ends up on your plate when things go wrong. "AI f*cK it up" does not sound like as good an argument for why your chain of command messed things up as "joe doe made a mistake".
Also, AI agents don't make for great office politics partner.
As much as AI is being portrayed as a human replacement there are many social aspects of organizations that AI cannot replace. AI don't vote, AI don't get promotions for siding with different parties in office politics. AI can't get fired