It's all very well when it works to your advantage but "vibes" also do the opposite.
People who instantly take against you tend to see every mistake and interpret every event the worst possible way and eventually decide that their initial feelings were right. Once again intuition triumphs. You don't get a chance to prove you're no worse than anyone else - there's just a period of time where they look for evidence to confirm their vibe.
I remember going to work in a country where my apparent origin was seen in a positive way and realising that if I'd been from somewhere in Eastern Europe I'd have been automatically disrespected. I remember going to an interview for a flat share and the moment I said I was from Zimbabwe one guy said that "South Africans" (sic) "drink and party too much." Since I'm white I'd never been on the opposite side of prejudice before and it was highly interesting.
Oh yes, I agree, it is information that's telling you something but because one doesn't usually have a way of putting it into words it's not clear what the message is. People who are different from you are sometimes just nervous and not sure how to present themselves.
I have, however, had to fix the terrible work of grifters (e.g. no unit tests, every minor change breaks something silently) and nobody ever cottoned onto them even though they were quite obvious. The feelings they gave management were "good ones" despite them being terrible for the business. I, as the person fixing stuff after said grifter left suddenly, was blamed for everything that was wrong.