I do a similar thing with web crawlers that do not respect the robots.txt https://github.com/cl-test-grid/cl-test-grid/blob/873b2fa978... I don't know if this snippet is really effective, can be improved a little, especially that I noticed a couple of new crawlers that ignore `User-agent: * Disallow: /path` in robots.txt, and do not fix that even after reported.
I'll look into implementing this, nice tip :) archive.org is the worst offender for me; not only do they ignore robots.txt, there is absolutely no way to get something removed once they archived it (despite the data including accidentally leaked PII for example - which can cause actual harm to someone).
A little trick to spam the spammers (2021)
141–150 of 231 posts
Re: A little trick to spam the spammers (2021)
#142Earlier quoted context omitted.
I suspect spammers might have given up on that. I get almost nothing for webmaster at a domain that receives plenty of spam and phishing attacks on other email addresses, and a constant barrage of spam into the web contact form.
I can assure you that they have not.
Re: A little trick to spam the spammers (2021)
#143Re: A little trick to spam the spammers (2021)
#144Re: A little trick to spam the spammers (2021)
#145I run marketing email databases. This is cute, but it doesn't actually do anything in most systems - either the employees all already get the marketing emails or there is a system-wide rule to suppress against the email domain. If you actually want to (potentially) break something, try submitting some obscure characters or malformed html into some fields. Blank spaces in emails can particularly be a nuisance. And if…
How do you sleep at night?
Re: A little trick to spam the spammers (2021)
#146I run marketing email databases. This is cute, but it doesn't actually do anything in most systems - either the employees all already get the marketing emails or there is a system-wide rule to suppress against the email domain. If you actually want to (potentially) break something, try submitting some obscure characters or malformed html into some fields. Blank spaces in emails can particularly be a nuisance. And if…
How do you sleep at night?
Re: A little trick to spam the spammers (2021)
#147Earlier quoted context omitted.
I'll look into implementing this, nice tip :) archive.org is the worst offender for me; not only do they ignore robots.txt, there is absolutely no way to get something removed once they archived it (despite the data including accidentally leaked PII for example - which can cause actual harm to someone).
Are you mixing up archive.org (the Internet Archive, a nonprofit company headquartered in San Francisco) with archive.is/archive.ph/archive.today, which ignores robots.txt, and is a for-profit company with unknown owners and an unknown location?
Re: A little trick to spam the spammers (2021)
#148Earlier quoted context omitted.
I'll look into implementing this, nice tip :) archive.org is the worst offender for me; not only do they ignore robots.txt, there is absolutely no way to get something removed once they archived it (despite the data including accidentally leaked PII for example - which can cause actual harm to someone).
I want archive.org to ignore robots.txt and make it as difficult as possible to remove pages from it; it would be a broken archive tool if this were not the case.
Re: A little trick to spam the spammers (2021)
#149Earlier quoted context omitted.
I'll look into implementing this, nice tip :) archive.org is the worst offender for me; not only do they ignore robots.txt, there is absolutely no way to get something removed once they archived it (despite the data including accidentally leaked PII for example - which can cause actual harm to someone).
Just send them a DMCA request, that's their takedown mechanism. Is it a good one? No, but that's how they do it. You see it posted about all over in their forums. ex: https://archive.org/post/1022869/site-removal-request
Re: A little trick to spam the spammers (2021)
#150Earlier quoted context omitted.
I'll look into implementing this, nice tip :) archive.org is the worst offender for me; not only do they ignore robots.txt, there is absolutely no way to get something removed once they archived it (despite the data including accidentally leaked PII for example - which can cause actual harm to someone).
I want archive.org to ignore robots.txt and make it as difficult as possible to remove pages from it; it would be a broken archive tool if this were not the case.