Nearly all of my "unplayed" Steam games have been played plenty by me, just not through Steam. Sometimes I think about how my Steam account contributes to statistics that are used to drive narratives like this where "not time-tracked by Steam" = "unplayed game bought by an insane collector." But chances are that narrative is overwhelmingly right most of the time, so whatever.
Just to clarify, I have the same usage and it's because I "pirate" games and only buy the ones that I play more than once/couple hours. I don't trust and nor like the refund policies/processes and all kinds of fences they implement, and often even after I have bought a game I will keep using the pirated version because it is more convenient (offline play, no need to login and it's already installed... when games are…
Steam is pretty reasonable. If you bought a game in the past 14 days and played fewer than 2 hours, you can get a refund for any reason. You need only go to your recent purchases, “report a problem”, and with a couple of clicks you’re done.
If works incredibly well and with no hassle, I have done it a number of times for games which ran like crap on my machine or plain weren’t fun.
I’ve heard GOG is even better with their returns, though I have never tried it. And they sell games which are DRM-free, so even better than a pirated version.