There is a middle ground that is quite common across Europe: a private company that has the government as a shareholder. I think it is reasonable for subsidies to be structured just like private investments rather than a donation. The public should reap the rewards of the money they invest in their country through taxes, just like wealthy investors do.
It's a question of perspective. I've spent my life in countries where I've seen my taxes being spent relatively well, I feel the benefits of it daily both as a private citizen and a founder. Everywhere I've lived, when transport, utilities, healthcare and education, even part of the media, were publicly managed, they were simply better and cheaper.
But I understand that this is not universal and that most governments don't operate effectively for their taxpayers. And that, yes, if the whole system is set up for it, private solutions can also thrive and be superior. I suppose it's hard to privatize public services effectively in an ecosystem that doesn't support private enterprise as much.