The Fukushima accident was a rare event, dumped a small amount of waste compared to ongoing industrial operations, and the most worrying part of the waste that it dumped decays on the timescale of decades, and not millenia.
I don't have stats about what gets directly into the oceans, but when we mine gold, copper, and other ores, we create entire ponds called "tailings ponds" full of arsenic, cyanide, mercury, and all sorts of other nasty substances. These ponds leak into the environment on a regular basis. Short of seeping into the environment, many of these substances NEVER GO AWAY. THIS IS A HUGE PROBLEM.
Nuclear waste comes in small quantities, in neat, easy to handle packages, and the most dangerous elements in it will decay relatively quickly. Over the entire lifetime of the nuclear industry, less than 80,000 tons of radioactive waste have been produced. Meanwhile, one mine alone produced 237,000 tons of arsenic trioxide over its lifetime. This substance is just sitting in the abandoned mine now.
The most worrying part of the nuclear waste story, to me, is that NIMBYism and fear has blocked attempts to produce permanent, safe facilities for permanent sequestration, so it's stored almost as poorly as our super toxic tailings. At least there's less of it, and efforts are made to clean it up when it gets into the environment.