I've been a victim of this. People in crypto hate you for trying to do things the right way (connecting crypto to real economic value instead of engaging in tribal maximalism and hypemongering popular projects) and people outside of crypto hate you for being involved in crypto which they think is all scams.
The irony is that only the scammers on both sides win.