As correctly pointed out by other readers, this is a non-issue and complete overreaction. All feeding into misconceptions and irrational fear of radiation. The "safety professional" was out of his depth and clearly undereducated about the risks of radiation and uranium ore in particular. Hence, the true risk of a "dirty bomb" -- is psychological, i.e. it would be a weapon of mass disruption (not destruction), triagin…
I imagine there are some radiation-sources which are harmless outside the body because the dead cells of your skin would easily absorb and block them, but would wreak havoc if they were ingested or inhaled as dust.
Sometimes this is presented as a question where you have three or four cookies, which emit things like alpha/beta/gamma radiation and possibly neutrons, and you have to decide which cookie to eat, which to put into your pocket, which to put in a lead box, etc.