Many herbicides are harmful in some way, but most are safe if used properly (i.e. respecting the correct dosage for each target, respecting the safety interval, etc).
Buying organic is not safer, though, because one can still use herbicides in organic farming, as long as they aren't synthetic. Sometimes the safer organic option won't be as safe as the synthetic one.
Some herbicides are dangerous, and if safer solutions were available farmers would use them - if only their crops would survive that substance. That is one of the points of glyphosate-resistant varieties.
Be it as it may, the danger will always be greater for farmers than consumers. Integrated Farming accounts for this as well, and the list of available pest management substances is constantly being updated. I don't know how well IF works in the US, but in the EU (Portugal) at least I get updates every now an then.
I still use glyphosate and will keep using it for weed control. In an olive field, I use a shredder for most of the field, and leave herbicides for plantation lines only. This means that only about 30% of the total area is actually sprayed with herbicides in some orchards.
I'd reserve the ban on allegedly dangerous substances for personal use. And I would start with home spray insecticides.