Live data from Hacker News

Ask HN: Someone is proxy-mirroring my website, can I do anything?

news.ycombinator.com

261–270 of 310 posts

Re: Ask HN: Someone is proxy-mirroring my website, can I do anything?

#261
post #244

Earlier quoted context omitted.

> Most websites continue to work fine without it > About 25% of sites become unusable These two statements seem pretty contradictory. 75% feels like a low threshold for "most."

Most is more than half.

In casual conversation, I would never interpret most as being solely more than half. However, it seems like perhaps most people agree with you :)

https://english.stackexchange.com/questions/55920/is-most-eq...

Re: Ask HN: Someone is proxy-mirroring my website, can I do anything?

#262

My networking knowledge isn't great, so apologies if this is wrong. But if it's not wrong, it could help. FIND THE IP FOR THE DOMAIN PS > ping sukuns.us.to Pinging sukuns.us.to [45.86.61.166] with 32 bytes of data: Reply from 45.86.61.166: bytes=32 time=319ms TTL=39 ... REVERSE DNS TO FIND HOST https://dnschecker.org/ip-whois-lookup.php?query=45.86.61.166 Apparently it's "Dedipath". And that WHOIS lookup gives an abu…

Abuse contacts never work. I've never had any success hounding them about malicious sites they host.

Re: Ask HN: Someone is proxy-mirroring my website, can I do anything?

#263
Um, so I clicked the second link, and was redirected to a not-safe-for-work website.

Luckily, I am at home, and my children are at school.

I have no idea what happened, or why I got redirected, but I can certainly suggest not taking up the idea to serve disgusting content (given I clicked a link that someone on HN posted, I shouldn't be subjected to that).

Re: Ask HN: Someone is proxy-mirroring my website, can I do anything?

#264
post #189

Earlier quoted context omitted.

One possibility: Serve different content, but only if the user agent is a search engine scraper. Wait a bit to poison their search rankings, then block them.

... be careful with this. Assuming you've monetized your content with ads, depending on your ads provider, this may have deleterious effects on your account with that provider, as they may then assume you're trying to game ads revenue.

The mirror is almost certainly running their own ads, given they strip the JavaScript out.

Re: Ask HN: Someone is proxy-mirroring my website, can I do anything?

#265
post #39

Look at your traffic logs and see if you can't fingerprint the scraper. Should be relatively easy since they're mirroring your entire site. Then instead of blocking the fingerprint, poison the data. Introduce errors that are hard to detect. Maybe corrupt the URLs, or use the incorrect description or category. Be creative, but make it kind of shit. It's easy to work around blocks. Working around poisoned data is much…

This... there are definitely aspects of the proxy that they aren't configuring or are unaware of. i.e. ssl_cipher, http_x_requested_with, http_accept... and the order of all headers supplied... the casing of all headers supplied... TLS client HELO. It is relatively easy, if you have enough signals, to essentially create a fingerprint that they won't understand how it works. Yet it will be effective at blocking it reg…

This is some really cool anti-scraping inside baseball. Is it safe to say that Cloudflare uses these techniques for weeding out bots?

Re: Ask HN: Someone is proxy-mirroring my website, can I do anything?

#266

Earlier quoted context omitted.

As soon as you have a few of their IPs, look them up on ipinfo.io/1.2.3.4 and you'll find they probably belong to a handful of hosting firms. You can get each firm's entire IP list on that page and add all of those CIDRs to your block list. Saves you needing to make 30K web requests. In most countries in the western world, there are 3-4 major ISPs and this is where 99% of your legit traffic comes from. Regular people…

The site seems to be hosted on OVH cloud. OP should report this to them. https://www.ovh.com/abuse/ Found the hosting information from here: https://host.io/us.to

Consider reaching out to Afraid.org first, https://freedns.afraid.org/contact/

They are the ones providing the subdomain

Re: Ask HN: Someone is proxy-mirroring my website, can I do anything?

#267

Um, so I clicked the second link, and was redirected to a not-safe-for-work website. Luckily, I am at home, and my children are at school. I have no idea what happened, or why I got redirected, but I can certainly suggest not taking up the idea to serve disgusting content (given I clicked a link that someone on HN posted, I shouldn't be subjected to that).

[deleted]

Re: Ask HN: Someone is proxy-mirroring my website, can I do anything?

#268
post #229

Earlier quoted context omitted.

Show me one website that today really works without javascript.

I've been surfing without javascript since 2015. Most websites continue to work fine without it (though some aesthetic breakage is pretty standard). About 25% of sites become unusable, usually due to some poorly implemented cookie consent popup. I don't feel like I'm missing out on anything by simply refusing to patronize these sites. I will selectively turn JS on in some specific cases where dynamic content is requi…

Same, I even wrote a chrome extension to enable js on the current domain using a keyboard shortcut; but it has gotten to be more of a pain especially on landing pages.

Re: Ask HN: Someone is proxy-mirroring my website, can I do anything?

#269
post #244

Earlier quoted context omitted.

Most is more than half.

In casual conversation, I would never interpret most as being solely more than half. However, it seems like perhaps most people agree with you :) https://english.stackexchange.com/questions/55920/is-most-eq...

In my entirely casual understanding of English most means the set that has more members than any other. When the comparison is binary (sites that work vs sites that don't) then "more than half" is both necessary and sufficient as a definition.

When comparing more than two options most could be significantly less than half (e.g. if I have two red balls, and one ball each of blue, purple, green, orange, pink, and yellow, then the color I have the most of is red, despite representing only one quarter of the total balls.)

That said, any attribute attaining more than half of the pie must be most.

Re: Ask HN: Someone is proxy-mirroring my website, can I do anything?

#270
post #27

1. Create fake url endpoint. And go to that endpoint in the adversary's website, when your server gets request, flag the ip. Do this nonstop with a script. 2. Create fake html elements and put unique strings inside. And you can search that string in search engines for finding similar fake sites on different domains. 3. Create fake html element and put all request details in encrypted format. Visit adversary's website…

I read once a suggestion to serve gzipped requests which, gzipped, are tiny, but un-gzipped are enormous. Like GBs of 0s. Not sure how you actually do it and if it serves your purpose but sounded neat.

It's called a "zip bomb" (popularized by Silicon Valley [1]), and there is a good guide (and pre-generated 42kB .zip file to blow up most web clients) at https://www.bamsoftware.com/hacks/zipbomb/

[1] https://www.youtube.com/watch?v=jnDk8BcqoR0

Post reply on HN