I recently left ProtonMail and went back to Fastmail. My reason was that they will never be able to fully support IMAP and now CalDAV because of the encryption they use. I grew to accept that email is not for secure messaging and my paranoia of "I'm being watched" just went away. If you need secure messaging, use something other than email.
For me it was their app just being so far behind Fastmail. If they had a better app I'd gladly pay. I just can't stomach gmail anymore and Fastmail was next best.
Based on comments over in /r/protonmail there's some redesigns coming for the apps that should hopefully improve on the creature comforts.