Maybe "value fit" should be used instead of cultural fit. Do your values align with the core values of the company.
The top NYTimes comment below illustrates some of the warts of a "cultural fit".
"Hiring managers who would never in a million years describe themselves or even privately consider themselves to be racist or sexist or ageist commonly use cultural-fit criteria to perpetrate racism, sexism, or agism in the workplace. I was recently in a meeting with two other managers to compare notes on a group of candidates whom we'd all just interviewed for a mid-level job. My top pick was a supremely well-qualified 45-year-old black woman who outscored all the other candidates on the skills test, was the only one to arrive on time for the interview, and was the only one who dressed professionally for the interview. It's a corporate job in Midtown. She was poised, amiable, and direct during my conversation with her, asked well-informed questions about the work and the company, and she was also the only candidate who sent a thank you letter after the interview. The other two hiring managers - both of whom, incidentally, were white women who were wearing Black Lives Matter pins - didn't think my top candidate "would be a good fit" or "feel comfortable." We hired a young white guy for the gig. He fits in the gang really well at happy hour, but his job performance is extremely poor. My two managerial colleagues have scheduled a meeting for next week to discuss what we're going to do about him. The good candidate is working for someone else now."