Earlier quoted context omitted.
The big reason I don't want someone else scanning my phone (and a year later, my laptop) is that last I checked, software is not perfect, and I don't need the FBI getting called on me cause my browser cache smelled funny to some Apple PhD's machine-learning decision. It's the same reason I don't want police having any opportunistic information about me - both of these have an agenda, and so innocent people get pulled…
The chance of you getting enough false positives to reach the flagging threshold is one in a trillion. And then the manual review would catch the error easily. The FBI won’t be called on you.
What if it really was a very private photo?