Android is an unacceptable security risk, and I am not super fond of Apple or their limits. I was considering switching wholly to an LTE-enabled Windows tablet (I have a Surface, but I've been eyeing a Latitude) and then just getting a dumbphone for phone calls and texts.
As a Windows Mobile user, I've actually found not having the latest of every app available on my phone kind of refreshing. Other people seem annoyed I can't join them on the latest app, but it's a perfect excuse not to download said app.