Conclusion: If you keep any cryptocurrency on an exchange or online service that can or is capable of controlling your private keys - MOVE all your cryptos to your own deterministic wallet YESTERDAY!
Storing your coins might be the best solution in theory, but in practice unless you're very savvy about the whole stack - hardware, OS, software and blockchain tech, it's hard to be sure you're not making a dumb mistake and exposing your whole stack.
Even hardware wallet can have vulnerabilities, and any form of "paper wallet" can be physically lost or destroyed.
My opinion is that you should hedge to make any loss tolerable, instead of trying to prevent it completely.