“Show me the man and I’ll show you the crime” - Lavrentiy Beria
Essentially, in modern society, if you do not feel like a criminal, it's because you are walking on eggshells around your government. Just about every modern government has laws on the books which are just plain ethically, morally, or constitutionally unjustified.
The DMCA, the PATRIOT act, the listing of cryptography under non-exportable munitions, the War on Drugs, the US foreign drone strike program, whistleblower laws, same-sex marriage laws or even death penalties, (soon to be) Article 13, social credit systems, mass surveillance, threat of ostracization/deplatformization if you fall outside of or in the middle of the now-split Overton window, the militarization of police in some developing countries coupled with a growing propaganda-driven movement to disarm citizens in order to increase the power gap, neoliberalist consumerist lifestyles propped up by military coups, dictatorships, and pollution sinks in developing countries.
I could keep going. But what it boils down to, is that if you don't find yourself at odds with the way things are being run in most parts of the developed world (not just the US) then you're either living under a rock, or complicit. If you're in the UK, it also means you like your sex without salt.
And, as ignorance is not an excuse in a society where you have plenty access to such information, you are still complicit.
I think a bit of guilt over the way our lifestyles impact the health of the earth and the lives of other people is certainly in order. I think some guilt over allowing our brand new rebel government to turn into the world's largest bully and largest perpetrator/denier of climate change, some guilt over not participating in activities which put you directly at odds against your government for the sake of knowledge or ethics, is entirely in order. Guilt gets things done.