The point of the article is that for team work with unclearity you are more creative by working in a physical space together.
If your work can be done in isolation and doesn't require a team to deal with any uncertainty, then by all means work fully remote. However, if your work is about innovation and collaboration, then it's going to be more effective to spend time together.
I think it's telling that you talk about 'looking at a clock'. If that's how you spend your office time, then indeed there might be something off. E.g. a controlling manager who wants their minions to be visible and on the clock.
Personally I work one or two days from home. Some team members more, a few even fully remote (but it's noticable that they are more task oriented and less included in any new concepts/roadmaps/designs/etc). The majority of the people spend the same one or two days together in the office where all kinds of formal and informal interactions happen that further the collaborative creative process.