I think the big fear of nuclear power is because we don't know how to handle catastrophic risks.
With coal power you will have a few dead mine workers. It's only mine workers that are affected and they have a definite risk in front of their eyes. You can rise the worker protection regulations for making this safer. You have the problem of air pollution through fine particles and sulfur. You can solve this with filters. The CO2 Problem isn't caused by one coal plant alone, so that problem is ignored.
With nuclear on the other hand you have a history of failures that were tried to be covered up, while being told that nuclear is 100% safe. The failures were unforeseen and led to a few catastrophes we weren't prepared to handle. We're more scared of the things we don't know than of the things we do know. And then the effects were very far reaching. The area around Chernobyl still isn't habitable today, more than half of the boars caught in Bavaria still aren't deemed safe for consumption because of radioactive contamination from Chernobyl. Fukushima and Chernobyl had a huge effect on the people living around them and both were in relatively low populated areas, so effects at a catastrophe in a nuclear power plant more near to a big city would be far greater.
I'm not saying that nuclear power is creating more damage than coal power, I just want to show why people fear nuclear power more.