Live data from Hacker News

Bots are getting good at mimicking engagement

joindatacops.com

11–20 of 312 posts

Re: Bots are getting good at mimicking engagement

#11

Is there any incentive for a company to remove fake traffic[0] from its stats and analytics? I guess there is no incentive in most markets. Facebook, etc make only a token effort to reject non-troublesome bot traffic. [0] bots and other automated traffic which cannot generate revenue or human ad views

In theory if you have a lot of fake traffic then ads on your site will have an even worse conversion rate than normal?

Re: Bots are getting good at mimicking engagement

#12

Is there any incentive for a company to remove fake traffic[0] from its stats and analytics? I guess there is no incentive in most markets. Facebook, etc make only a token effort to reject non-troublesome bot traffic. [0] bots and other automated traffic which cannot generate revenue or human ad views

I guess the answer is no, and there's a couple quotes in there near the end:

  One rep I had known for years finally admitted the truth off the record. "Dude, we know," he said. "Everyone knows. But if we filtered it all out properly, our revenue would drop 40% overnight, and investors would have a meltdown."

Re: Bots are getting good at mimicking engagement

#13
Interesting. You didn’t give specifics on what anti-bot measures sites implemented, so I’ll add:

Bot prevention measures can be good, but the more hoops you make your users jump though (CAPTCHA etc), the more legitimate users will drop off. Those have significant impacts on conversion rates.

I would think fixing this should involve the analytics and attribution side rather than adding friction to your e commerce flow.

Especially as bot tech continues to get better and more indistinguishable from real traffic.

Re: Bots are getting good at mimicking engagement

#14
post #8

What is really mind blowing is that, if understood correctly, bots would be used to check the availability of a product, that sounds so a "hacky" method, like "seriously people are doing that in 2025".

Yeah, their list of recommendations could use another point: expose the public data in a simple, structured way.

I'm working right now on an inventory management system for a clinic which would really benefit from pulling the prices and availability from a very specialised online shop. I wish I could just get a large, fully cached status of all items in a json/CSV/whatever format. But they're extremely not interested, so I'm scraping the html from 50 separate categories instead. They'll get a few daily bot hits and neither of us will be happy about it.

If people are scraping data that you're not selling, they're not going to stop - just make it trivially accessible instead in a way that doesn't waste resources and destroy metrics.

Re: Bots are getting good at mimicking engagement

#15
Would like to see the script. From reading it's impossible to tell if the methodology is sound. Would legitimate users with adblockers or disabling JS get counted is false positives, for example?

That said, 73% doesn't come as a surprise. If anything I expect it to be higher.

I guess this quote sums up the situation

> When I tried to bring this up with a few major ad platforms, the conversation always followed a predictable script. The sales reps were incredibly friendly until I mentioned click fraud or bot traffic. Then, the tone shifted instantly to corporate-speak: "Our AI detection is industry leading" and "We take ad fraud very seriously." It was a polite but firm wall, a clear signal to stop asking questions.

> One rep I had known for years finally admitted the truth off the record. "Dude, we know," he said. "Everyone knows. But if we filtered it all out properly, our revenue would drop 40% overnight, and investors would have a meltdown."

Re: Bots are getting good at mimicking engagement

#17
I’m puzzled by this: I thought it was well-understood, at least in the industry, that traffic numbers were at least mostly nonsense, and that ad click metrics especially were suuuper shady, typically more than half fraud; yet OP, in the business of “accurate ad spend analytics”, only just discovered this!?

It just doesn’t ring true. That aspect of the story isn’t novel at all, and someone in that line of work should surely have known all this, right?

Now the section on categorising different bot patterns, that’s more interesting, and I haven’t seen so much said about it.

Re: Bots are getting good at mimicking engagement

#18

Is there any incentive for a company to remove fake traffic[0] from its stats and analytics? I guess there is no incentive in most markets. Facebook, etc make only a token effort to reject non-troublesome bot traffic. [0] bots and other automated traffic which cannot generate revenue or human ad views

In theory if you have a lot of fake traffic then ads on your site will have an even worse conversion rate than normal?

if you have a lot of fake traffic then ads on your site will have an even worse conversion rate than normal?

Yes, if you only count purchase/sale conversions

Maybe no, if you also count clickthrough and view conversions, perhaps even lead conversions sometimes (because fake sign ups are possible).

But you’re right. Purchase conversions are one incentive

Re: Bots are getting good at mimicking engagement

#19

I’m puzzled by this: I thought it was well-understood, at least in the industry, that traffic numbers were at least mostly nonsense, and that ad click metrics especially were suuuper shady, typically more than half fraud; yet OP, in the business of “accurate ad spend analytics”, only just discovered this!? It just doesn’t ring true. That aspect of the story isn’t novel at all, and someone in that line of work should…

50k to 47 conversions seems like a noticeable increase in fakeness to me at least. that's going from more than half fraud to essentially only fraud with a rounding error amount of real users

Re: Bots are getting good at mimicking engagement

#20
post #8

What is really mind blowing is that, if understood correctly, bots would be used to check the availability of a product, that sounds so a "hacky" method, like "seriously people are doing that in 2025".

Yeah, their list of recommendations could use another point: expose the public data in a simple, structured way. I'm working right now on an inventory management system for a clinic which would really benefit from pulling the prices and availability from a very specialised online shop. I wish I could just get a large, fully cached status of all items in a json/CSV/whatever format. But they're extremely not interested…

I wonder if LLM agents will know to go for apis and data or if they'll keep naively scraping in the future. A lot of traffic could come down to "find me x product online" chats eventually
Post reply on HN