You don't have to stop use to stop infringing use. If you just want to protect your trademark, explicitly license it to them for free or a trivial amount.