Earlier quoted context omitted.
I think it is a bad idea to say this about him without providing a concrete example on how he made you uncomfortable. I'm sure I have accidentally made someone uncomfortable before. Does that make me a bad person? I hope not.
Of course it doesn't make you a bad person. In fact, there's a good chance you're a good person, and if you have accidentally made someone uncomfortable, it was through something they could easily put their finger on; you said something, you reminded them of something, etc. This doesn't sound like it's that. He does, after all, call it 'inexplicable'; literally unable to be interpreted or expanded upon. It was a 'gut…
I am not saying that the OP or anyone here is being racist. We need to provide more context to these statements if we are going to say these in public. Otherwise, some groups of people will be at the receiving end of these kind of statements more often than the rest of us.