Earlier quoted context omitted.
Sure, but there's a bit of apples and oranges here - for example, any modern internet-connected app would also need a server backend.
Also I just installed Daylio which is a cool little diary application. They have no web app, it's mobile app only. It backs up your data to Google Drive. It has no server component, no signup, etc. Admittedly there are limitations of not having a server backend but for a MVP that's another way to go.
Simple apps can definitely get away without a remote backend, and for things like single-player games they can get away without any web presence at all. So yeah, there's definitely no one true solution.