I too used to think that CEOs were a waste of resources, and that they had minimal if any impact on most companies. But I think people grossly underestimate how important CEOs are, because the vast majority of them do a decent job. When you swap out somebody who does a decent job for another person who performs at about the same level it's not really that noticeable. That said, you'll come to appreciate those "decent…
I'll second this comment. Armchair evaluation of CEOs suffers from survivorship bias. Decent/good CEO keeps the business moving. A bad CEO can sink a company. Boards/owners (dependant on corporate structure) can mitigate results.
Which interestingly is the same effect as swapping out somebody who does nothing for someone else who does nothing.