Live data from Hacker News

Ask HN: Someone is proxy-mirroring my website, can I do anything?

news.ycombinator.com

241–250 of 310 posts

Re: Ask HN: Someone is proxy-mirroring my website, can I do anything?

#241

Earlier quoted context omitted.

As soon as you have a few of their IPs, look them up on ipinfo.io/1.2.3.4 and you'll find they probably belong to a handful of hosting firms. You can get each firm's entire IP list on that page and add all of those CIDRs to your block list. Saves you needing to make 30K web requests. In most countries in the western world, there are 3-4 major ISPs and this is where 99% of your legit traffic comes from. Regular people…

The site seems to be hosted on OVH cloud. OP should report this to them. https://www.ovh.com/abuse/ Found the hosting information from here: https://host.io/us.to

THIS ^^

Re: Ask HN: Someone is proxy-mirroring my website, can I do anything?

#243
post #166

Earlier quoted context omitted.

As the OP mentioned, JS is stripped and URLs are being written, so I doubt either of those approaches will work.

Making js essential is not that hard, right? Just "display: none" on the root element, which is removed by js :) More sophisticated options can been found in other comments.

It's trivial to strip that "display: none" out, too.

Re: Ask HN: Someone is proxy-mirroring my website, can I do anything?

#244
post #229

Earlier quoted context omitted.

I've been surfing without javascript since 2015. Most websites continue to work fine without it (though some aesthetic breakage is pretty standard). About 25% of sites become unusable, usually due to some poorly implemented cookie consent popup. I don't feel like I'm missing out on anything by simply refusing to patronize these sites. I will selectively turn JS on in some specific cases where dynamic content is requi…

> Most websites continue to work fine without it > About 25% of sites become unusable These two statements seem pretty contradictory. 75% feels like a low threshold for "most."

Most is more than half.

Re: Ask HN: Someone is proxy-mirroring my website, can I do anything?

#245
post #142
post #71

Same thing happened to me and my service ( https://next-episode.net ) almost 2 years ago. I wrote a HN post about it as well: https://news.ycombinator.com/item?id=26105890 , but to spare you all the irrelevant details and digging in the comments for updates - here is what worked for me - you can block all their IPs, even though they may have A LOT and can change them on each call: 1) I prepared a fake URL that no leg…

Might I suggest a spin on this: instead of blocking the IPs, consider serving up different content to those IPs. You could make a page that shames their domain name for stealing content. You could make a redirect page that redirects people to your website. Or you could make a page with absolutely disgusting content. I think it would discourage them from playing the cat and mouse game with you and fixing it by getting…

"Or you could make a page with absolutely disgusting content." You've never heard of Rule 34, have you...

Re: Ask HN: Someone is proxy-mirroring my website, can I do anything?

#246
post #71

Same thing happened to me and my service ( https://next-episode.net ) almost 2 years ago. I wrote a HN post about it as well: https://news.ycombinator.com/item?id=26105890 , but to spare you all the irrelevant details and digging in the comments for updates - here is what worked for me - you can block all their IPs, even though they may have A LOT and can change them on each call: 1) I prepared a fake URL that no leg…

Once you have their IP addresses you can make them serve anything you want. Set your imagination free.

For starters: copyright-infringing material.

Re: Ask HN: Someone is proxy-mirroring my website, can I do anything?

#247
post #27

1. Create fake url endpoint. And go to that endpoint in the adversary's website, when your server gets request, flag the ip. Do this nonstop with a script. 2. Create fake html elements and put unique strings inside. And you can search that string in search engines for finding similar fake sites on different domains. 3. Create fake html element and put all request details in encrypted format. Visit adversary's website…

[deleted]

Re: Ask HN: Someone is proxy-mirroring my website, can I do anything?

#248
post #41
post #27

1. Create fake url endpoint. And go to that endpoint in the adversary's website, when your server gets request, flag the ip. Do this nonstop with a script. 2. Create fake html elements and put unique strings inside. And you can search that string in search engines for finding similar fake sites on different domains. 3. Create fake html element and put all request details in encrypted format. Visit adversary's website…

I like how you think. These are all great ideas! Reminds me of a time some real estate website hotlinked a ton of images from my website. After I asked them to stop and they ignored me I added an nginx rewrite rule to send them a bunch of pictures of houses that were on fire. For some reason they stopped using my website as their image host after that.

Signal boosting suggestion #1 here. Great idea.

Additionally if they decide to blackhole the fake/honeypot url, since you mentioned they pass along the user agent, you could mixin some token in a randomized user agent string that your scraper uses so that you could duck-type the request on your end to signal when to capture the egress ip.

Re: Ask HN: Someone is proxy-mirroring my website, can I do anything?

#249
post #245
post #142

Earlier quoted context omitted.

Might I suggest a spin on this: instead of blocking the IPs, consider serving up different content to those IPs. You could make a page that shames their domain name for stealing content. You could make a redirect page that redirects people to your website. Or you could make a page with absolutely disgusting content. I think it would discourage them from playing the cat and mouse game with you and fixing it by getting…

"Or you could make a page with absolutely disgusting content." You've never heard of Rule 34, have you...

obviously somebody too young to have seen the method of using an http redirect to the goatse hello.jpg for unwanted requests

edit: or when somebody embed-links your image inside some forum, replace the original filename with the contents of hello.jpg

Re: Ask HN: Someone is proxy-mirroring my website, can I do anything?

#250

One strategy tip: don't play cat and mouse. As you've demonstrated, if you change one thing, they will figure it out and change one thing. Not only does that not work, but you are training them that it's worth trying to beat your latest change. Instead, plot a few different changes and throw them in all at once. Preferably in a way where they will have to solve all of the changes at the same time to figure out what h…

I love it, also add a randomness, there is nothing more frustrating than a problem that only reproducers sometimes!
Post reply on HN