I am my DVD player's user. The copyright holder does not come to my house to operate my DVD player. It will not allow me to play discs not encoded for my region. This program is not written for my preference or use, but in opposition to me. It also does not allow me to bypass certain segments of videos. Again - it opposes me.
If it was written for me - the user - it would allow me to bypass all content and jump directly to the first title of every disc I inserted. The producers of this software have explicitly made it hostile to the user. I'm not saying this is not within their rights - I'm just saying it is.
But this is a rat hole. My point was that this is not what Linus was saying. He was merely describing the purpose of one software component. A kernel is a hardware abstraction - a platform for building applications without concern for the details of components - including the version of the kernel itself. He was arguing against breaking that contract by introducing a change which fit the whims of the contributor but would break an unknown number of binaries compiled against that contract.
tl;dr - "user" is not the same as "user-space"