Earlier quoted context omitted.
The decay products of uranium are not well contained at uranium mines. They are in massive tailing piles, just as the radioactive elements in coal end up in ash. Less gets said about these mine-related radioactive elements because they are typically in other countries, often countries where the people have darker skins.
Yes the radioactive decay products of the naturally occurring ore already in the ground naturally are still in the tailings. But they were there already before. With the removal of the uranium the net radioactive material left would be lower the the initial levels though no?
In any case, these are exactly the same daughters as from the decay of uranium in coal, so the argument you are making there is equivalent to an argument that could be made about coal ash.