Maybe it's difficult to justify a takedown if simultaneously they're responding to requests from search engines with full content for indexing, as part of their business model. Either the full content is available to be indexed, or it isn't - which is it?
It's also a lot harder to actually shut a site down if they care to actually not be shut down, see: KiwiFarms for example. I've never seen a more coordinated attempt to remove a site from the Internet and yet they're not only still there and appear to be quite active, but their infrastructure seems to be stronger than ever as a result. So it's damned if you do, damned if you don't.
To be clear, I’m not defending Josh’s character or the content on KF, just trying to illuminate something I find fascinating.