Earlier quoted context omitted.
What Chomsky is arguing is that, yes, in an important objective sense there is such a thing as “faciness” that our brains recognize. In the same way, I hope we’d all agree there’s objectively a color red—even accepting that it’s the structure of our optical and neural systems that are the basis for this fact.
It's odd to me that you chose color as an example of something objective, since so much about perception is subjective. Even if we think about it in more quantitative terms, with red being defined as having a dominant wavelength approximately 625–740 nanometres, it's a bit of an arbitrary definition isn't it? If we observe a wavelength of 624, objectively we might say it's not red, but someone may still observe it as…
We, of course, might disagree, but color-blind people learn which traffic lights are red, green, or yellow, regardless of their perceptual faculties. Because the color is not just what you see, but what you say.