Live data from Hacker News

Ask HN: Someone is proxy-mirroring my website, can I do anything?

news.ycombinator.com

101–110 of 310 posts

Re: Ask HN: Someone is proxy-mirroring my website, can I do anything?

#101

Earlier quoted context omitted.

Seems like it would be fairly easy to use this pseudo selector, and apply it to every element on the page. Making them show up as empty to the user

You could add a data attribute to the html tag of the document with the current URL, I.E. then hide the full page with: html {display: none;} html[data-path*="saashub.com"] {display:block;}

This seems quite elegant and easy. Obviously in addition to other measures, but I like it.

Re: Ask HN: Someone is proxy-mirroring my website, can I do anything?

#102

What about a slightly alternative approach, where instead of trying to block the abuser, you try to make it clear to end users what the real website is? E.g. in your logo image, include the real domain name "saashub.com". Have some introduction text on your home page "Here at saashub.com, we compare SaaS products ...." When your images are hotlinked, replace them with text like "This is a fraudulent website, find us…

Not sure if this would help since:

> 4) Use absolute URLs everywhere - they are rewriting everything www.saashub.com to their domain name.

Re: Ask HN: Someone is proxy-mirroring my website, can I do anything?

#103

Earlier quoted context omitted.

You could add a data attribute to the html tag of the document with the current URL, I.E. then hide the full page with: html {display: none;} html[data-path*="saashub.com"] {display:block;}

This seems quite elegant and easy. Obviously in addition to other measures, but I like it.

Honestly this is my favorite HN post in a while I've had a lot of fun thinking over this challenge.

Re: Ask HN: Someone is proxy-mirroring my website, can I do anything?

#105
Some "less technical" suggestions after being inspired by other creative suggestions here:

Put brandings/personalizations/signatures in your pages that are not easy to remove to remove automatically. Include your site URL if possible. The idea is that if a visitor sees these on a different site, it becomes obvious that the content doesn't belong there.

Write an article page about these things happening, specifically mentioning the mirroring site URLs, and see if they will also blindly mirror it.

Re: Ask HN: Someone is proxy-mirroring my website, can I do anything?

#106
post #82
post #77

Earlier quoted context omitted.

For 2) you mean you loaded it from the adversary's proxy site, just to clarify?

Yes, constructed the honeypot URL using the proxy site and called it (thousands of times) so I can get them to fetch it from my server through their IP so I can log it.

They literally proxy your website? I thought they'd cache it... that makes more sense now in your statement that you hit their website with a specially formatted url. Since they pass that through to you you can filter on that.

Also: since you say 4k-5k IPs... any of them from cloud providers? And specific location?

Re: Ask HN: Someone is proxy-mirroring my website, can I do anything?

#107
Other posts mentioned ways to detect, like:

  - "bait urls" that other crawlers won't touch
  - trigger by request volume and filter out legit crawlers
  - find something unique about the headers in their requests that you can identify them with
One additional suggestion is to not block them, but rather, serve up different content to them. Like have a big pool of fake pages and randomly return that content. If they get a 200/OK and some content they are less likely to check that anything is wrong.

Another idea is to serve them something that you can then report as some type of violation to Google, or something (think SafeSearch) that gets their site filtered.

Re: Ask HN: Someone is proxy-mirroring my website, can I do anything?

#108
One strategy tip: don't play cat and mouse. As you've demonstrated, if you change one thing, they will figure it out and change one thing. Not only does that not work, but you are training them that it's worth trying to beat your latest change.

Instead, plot a few different changes and throw them in all at once. Preferably in a way where they will have to solve all of the changes at the same time to figure out what happened and get things working again. Also, favor changes that are harder to detect. E.g., pure IP blocks are easier to detect than tarpitting and returning fake/corrupted content. The longer their feedback loops, the more likely it is that they'll just give up and go be a parasite somewhere else.

Re: Ask HN: Someone is proxy-mirroring my website, can I do anything?

#109
One thing you can do is add a canonical to each page, which will help solve the the Bing/Google issue until they realise it's there. Do it before they add one.

You're already using Cloudflare, you could try talking to their support or just turning up settings to make it more strict for bots.

Re: Ask HN: Someone is proxy-mirroring my website, can I do anything?

#110
post #102

What about a slightly alternative approach, where instead of trying to block the abuser, you try to make it clear to end users what the real website is? E.g. in your logo image, include the real domain name "saashub.com". Have some introduction text on your home page "Here at saashub.com, we compare SaaS products ...." When your images are hotlinked, replace them with text like "This is a fraudulent website, find us…

Not sure if this would help since: > 4) Use absolute URLs everywhere - they are rewriting everything www.saashub.com to their domain name.

Embed the welcome text in an image then!
Post reply on HN