Think about what we want as a society though. If you did commit a crime, we want to convict you. The reason the 5th protects you from compelled self-incrimination is to prevent unjust interrogation and investigation techniques from the cops[0], not to make the overall likelihood of conviction lower, although it incidentally has this effect.
From a policy standpoint the ideal world would be one where all criminals are convicted and no innocents are convicted. In our system we try [see 0 again] to err on the side of letting criminals go rather than convicting innocents.
One of the interesting things about the new normal of everything being recorded always and everywhere is how this might change our laws. Laws are supposed to accomplish something, speeding law is supposed to improve road safety for example. If automatic enforcement instead imposes massive taxes on everyone while not improving road safety, society (should) modify the law since it didn't get them to where they wanted to go.
Sorry, long winded way of saying, our electronic artifacts aren't really all that different than letters. If I wrote an email to my friend demonstrating premeditation in murdering your puppy, you and everyone else have an interest in that email being valid evidence. That's a wholly separate discussion from the encryption debate. I definitely you're right that we need to think about it but I just wanted to play devils advocate here for why we might want to think twice.
[0] Yes, shit still happens, but the system is SUPPOSED to limit these abuses.