I think that if there is voting, one should sort of do some type of spreading algorithm where the color you vote on, is sort of a much weaker vote for the surrounding colors. There is just too many colours, especially in this color space, and it is sort of hard for humans to really differentiate them. Thus spread out the vote based on average human visual perception differentiability capabilities. Also this color spa…
It is exactly the opposite of a weak vote for nearby colors.
Of course, "nearby colors" depends on which axis (or axes) of the color space is/are changing, the rates of change, and what is the criterion for ordering the aspects of color.
Historically, voting on colors is a strong tradition in color science.
Because color is a property of human perception not a property of the external world...turn out the lights and the apple isn't red any more.