Live data from Hacker News

A Facebook crawler was making 7M requests per day to my stupid website

coding.napolux.com

401–410 of 416 posts

Re: A Facebook crawler was making 7M requests per day to my stupid website

#401
post #168

Earlier quoted context omitted.

I just had an idea: if you control your own name server I believe you could use a BIND view to send all their own traffic to themselves based on the source address. By the way, if someone discovers how to trigger this issue it would be easy to use it as a DOS pseudo-botnet.

You could just probably send an HTTP redirect to their own site, no need to play with DNS for that

Except then you'd still have to deal with all the traffic.

Re: A Facebook crawler was making 7M requests per day to my stupid website

#402
post #210

Earlier quoted context omitted.

A single company does not get a /12 prefix. 2a00::/12 is almost half of the space currently allocated to all of RIPE NCC. Facebook seems to have 2a03:2880::/29 out of that /12, and a /40 through ARIN (2620:0:1c00::/40)

ugh why is ipv6 impossible to understand :/

Is the notation the problem here? IPs have 16 bytes now, so the notation is a bit more compact: hex instead of decimal numbers, and :: is a shortcut meaning "replace with as many zeros as necessary to fill the address to 16 bytes"

Re: A Facebook crawler was making 7M requests per day to my stupid website

#404
post #179

Earlier quoted context omitted.

The question isn't about pricing. The fact that you pay for your own bandwidth and metal is a problem.

Paying for your bandwidth and metal isn't a problem per-se as long as prices are reasonable (which they are with the old-school bare-metal providers). After all, those services do cost money to provide. The problem happens when prices are extortionate (or the pricing model is predatory, ie pay per MB transferred instead of a flat rate per 1Gbps link) and relatively minor traffic translates to a major bill. This parti…

You're still not getting it. I'm not arguing about whether it should be free or how much it should cost. I'm saying that when you have to pay for someone else's request, it's ripe for abuse. Instead, a system where the requester pays would be similar to how postage works in the US. Although I think it's highly unlikely that would make sense in a digital world.

Re: A Facebook crawler was making 7M requests per day to my stupid website

#406

Earlier quoted context omitted.

Side question: how did you get in contact with facebook? I've an ad account that was suspended last year and gave up trying to contact them.

Really? I've never had problems contacting them by email. They're one of the easiest tech companies to talk to.

What is their email? I've never found one that they'd respond to.

Re: A Facebook crawler was making 7M requests per day to my stupid website

#407

Earlier quoted context omitted.

Side question: how did you get in contact with facebook? I've an ad account that was suspended last year and gave up trying to contact them.

Try their live chat.

Do they actually have a live chat available for smaller advertisers? When I looked last year there wasn't

Re: A Facebook crawler was making 7M requests per day to my stupid website

#408

Earlier quoted context omitted.

Side question: how did you get in contact with facebook? I've an ad account that was suspended last year and gave up trying to contact them.

Similar experience, closed ad account because of “suspicious activity”, at least ten support tickets (half closed automatically), four lame apologies (our system says no, sry) and then finally, “there was an error in our system, you’re good to go”

I lost it because there was some sort of UI bug in the ad preview page that led the page to reload a bunch of times really quick, and boom, I'm apparently a criminal. You're lucky though, I never got it back and I had to change my business credit card because they somehow kept charging me after suspension.

Re: A Facebook crawler was making 7M requests per day to my stupid website

#409

Earlier quoted context omitted.

Try their live chat.

Do they actually have a live chat available for smaller advertisers? When I looked last year there wasn't

They do, I have used it a couple of times. Go go facebook.com/business/help click on get started button at the bottom for "find answers or contact support". Follow through, you will see a button called "chat with a representative".

Re: A Facebook crawler was making 7M requests per day to my stupid website

#410

Earlier quoted context omitted.

Nobody is forcing you to use GPL code. It is stinking of entitlement to demand that you get to use other people's code regardless of what they think about it.

I don't feel entitled to it, I just consider the prevalence of copyleft bad for the developer community. License however you want, doesn't mean I'm entitled for criticizing it. What might be stinking of entitlement is the idea users have an inalienable right to source code.

What about the prevalence of proprietary software? You can’t use that for anything without making a contract with the author either.
Post reply on HN