Company withdrawing from Facebook as analytics show 80% of ad clicks from bots
11–20 of 381 posts
Re: Company withdrawing from Facebook as analytics show 80% of ad clicks from bots
#12"We built a page logger. Any time a page was loaded, we'd keep track of it. You know what we found? The 80% of clicks we were paying for were from bots." How do you tell if it's a bot? Just by user-agent string or repeated slamming by IP address, or is there some other technique?
A combination of things. Off the top of my head:
* IP address ranges. Are they all from, e.g., EC2 instances?
* Are images and other content (e.g. CSS) linked from the page loaded? How long does the client take to do so? Are other pages being viewed in line with what you've seen from other users?
* What combinations of user agents are you seeing?
* What's in the headers being sent by the browser? Any foreign language support, or oddities when it comes to not accepting compressed content? Is the referer header always the same? Does it always vary?
* Do you see "normal" user behaviour that indicates activity such as clicking the back button, then clicking the ad again a few seconds later once their brain has kicked in? (nb: not sure if this is possible for Facebook with the way their site works).
* Are there any patterns in the page access times? Is there anything to indicate a cron job is kicking off once an hour at the same time?
Re: Company withdrawing from Facebook as analytics show 80% of ad clicks from bots
#13Has anyone else analyzed their referrals and also seen a significant proportion of bots?
It's also worth noting that Facebook has given refunds for click fraud in the past. That is if you can actually get a hold of someone in support who will talk to you, which isn't easy.
Re: Company withdrawing from Facebook as analytics show 80% of ad clicks from bots
#14I'd love to see someone try and find out though. Any IP doing automated requests of that nature is fair game for a bit of probing IMO.
Re: Company withdrawing from Facebook as analytics show 80% of ad clicks from bots
#15Wow, even if this is a little true the implications are big. Is this similar, or related to other ad space inflation? I'm reminded of Google (and others)(1) sending out free $75 adwords coupons to easily allow the costs of bids to inflate since it's not my own real money (thereby increasing the percentage of real cash being made on the ads)? (1)Edited and clarified
Re: Company withdrawing from Facebook as analytics show 80% of ad clicks from bots
#16Earlier quoted context omitted.
The main technique is to notice a pattern that is only explainable by bot activity. Generally speaking, in addition to the patterns you mentioned (invalid user-agent strings, rapid succession of same-IP access) there are also other patterns, such as failure to load referenced CSS or image files, or 100% failure on Captcha challenges.
"failure to load referenced CSS or image files" -- is there a way for bots (in particular, mechanize in perl/python) to also download those files? "100% failure on Captcha challenges" -- are captchas generally deployed on click-through ads?
Very much so, after all your browser does without you having to tell it to do so. It all depends on whether the hassle is worth it for the bot writer.
Re: Company withdrawing from Facebook as analytics show 80% of ad clicks from bots
#17"We built a page logger. Any time a page was loaded, we'd keep track of it. You know what we found? The 80% of clicks we were paying for were from bots." How do you tell if it's a bot? Just by user-agent string or repeated slamming by IP address, or is there some other technique?
They said that for 80% of their clicks , Javascript was off. Now there will be plenty of users who have disabled Javascript but nowhere near 80%. Although they stated they built their own analytics software, so there's also a chance that it wasn't working as they thought it was.
Re: Company withdrawing from Facebook as analytics show 80% of ad clicks from bots
#18Wow, even if this is a little true the implications are big. Is this similar, or related to other ad space inflation? I'm reminded of Google (and others)(1) sending out free $75 adwords coupons to easily allow the costs of bids to inflate since it's not my own real money (thereby increasing the percentage of real cash being made on the ads)? (1)Edited and clarified
Re: Company withdrawing from Facebook as analytics show 80% of ad clicks from bots
#19What benefit could a 3rd party conceivably get out of faking clicks on Facebook ads? Is there a rev share at all with publishers, like with adsense?
Re: Company withdrawing from Facebook as analytics show 80% of ad clicks from bots
#20Earlier quoted context omitted.
The main technique is to notice a pattern that is only explainable by bot activity. Generally speaking, in addition to the patterns you mentioned (invalid user-agent strings, rapid succession of same-IP access) there are also other patterns, such as failure to load referenced CSS or image files, or 100% failure on Captcha challenges.
"failure to load referenced CSS or image files" -- is there a way for bots (in particular, mechanize in perl/python) to also download those files? "100% failure on Captcha challenges" -- are captchas generally deployed on click-through ads?