I like those axes. I also enjoy conversations with someone where I disagree, and I wouldn't downvote purely based on disagreement, but generally due to some other factor.
Perhaps I'm only acknowledging that I'm less likely to downvote someone that I agree with? For example, if someone speculates wildly but it's consistent with my own experience, I'm not likely to downvote. If someone speculates wildly and it's inconsistent with my experience, I'm far more likely to downvote.
Probably where we disagree is whether it's OK to downvote a comment that someone put effort into. I've seen someone ask a question about a particular technology, and someone who clearly has very little experience with that technology posts a long screed where they're ~~talking out their ass~~ sharing their opinion in a way that sounds authoritative. Or maybe they're repeating business-level talking points instead of getting down to technical brass tacks.
I hope that gives an idea what I mean. I don't want to see comments like that on HN, regardless of how much effort or how well-meaning the comment is.