The idea that it is copyright infringement if you train a neural network on copyright data means Waymo, Bing, Google are all illegal. If you include any copyrighted information in your web crawler neural network or if your training data for your autonomous software includes pictures of billboards or t-shirts or anything in the real world that is copyrighted you are a copyright infringer.
If you're a rideshare or cab driver and you also happen to see / recognize billboards nobody is going to hassle you for storing those in your neural net or suggest law should do so. If you're a designer and you take "billboards or t-shirts or anything in the real world that is copyrighted" as stored in your head as the basis for something you're working on, you will need to consider ways in which your derivative work…
The creators of stable diffusion didn't create it with the intent helping people infringe on copyrights either. But some people will use it for that purpose.