Just because there isn't a single event to point at and say 'that is the cause' doesn't mean that the damage wasn't done.
Auto accidents probably kill a few orders of magnitude more people than a nuclear accident, yet you don't see the evangelical preachings against cars like you do nuclear.
The other forms of power need to be well managed also, and they historically have not. I don't need to go into detail about the huge amounts of pollution the power industry has generated.
What is worse? A handful of accidents that kill a few hundred people? Or several thousand people dying from various cancers and respiratory illnesses cause by decades of pollution from coal plants? Not to mention the dangers of mining it.
Current where I live there is a huge push towards natural gas due to the increased supply/decreased costs thanks to fracking. I don't think we have even begun to understand the environmental impact of fracking, yet industry has unanimously declared it safe. Another huge mismanagement of our environment, in my opinion.