Live data from Hacker News

The Guardian Is Being Swamped with 'Dark Traffic'

uk.businessinsider.com

11–20 of 70 posts

Re: The Guardian Is Being Swamped with 'Dark Traffic'

#11
post #8

Funny how the tone suggests that this is something malicious being done to the guardian.

...yet when you read it, it sounds like the explanation is that someone clicks on a link in an app, which opens that link using Chrome (or whatever the WWW intent app is) and somewhere en route the referrer is lost.

The collar doesn't match the cuffs in this article, methinks.

Re: The Guardian Is Being Swamped with 'Dark Traffic'

#12
Much could also be fake traffic, intended to defraud advertisers or others measuring audiences.

Even assuming The Guardian itself is not a knowing participant in such schemes, its sites could receive such traffic when fraudsters try to make the full behavior of their sources look more legitimate.

Re: The Guardian Is Being Swamped with 'Dark Traffic'

#13

"""The Atlantic first identified "dark social" traffic back in 2012 to describe traffic coming messaging apps that had been stripped of referrer data because messaging and email use the secure "HTTPS" system rather than the open "HTTP" system used by web pages. Excuse me?! How does this trash get published?

How can one trust anything that website says after this kind of statement? because clearly,these guys dont know what they are talking about.

pretty sure they dont know what HTTP is and what a header is.

How many factual errors in other articles that dont deal with the web?

Re: The Guardian Is Being Swamped with 'Dark Traffic'

#14
post #3

I built my personal extension which blocks all the traffic from Dan Pollock's list [1], then blocks all the traffic from major service providers (google analytics, etc) and social networks (fb, tw, google, etc) when not on their website. Referral and user agent headers removed, I haven't found the need to remove other headers. Currently working on preventing (and manually allowing) all xhr/script/image requests 2 sec…

Looks like that list hasn't been updated since our domain switch. If you really want to block our internal analytics (which are in practice fairly harmless) replace "hits.guardian.co.uk" with "hits.theguardian.com".

Re: The Guardian Is Being Swamped with 'Dark Traffic'

#16
post #14
post #3

I built my personal extension which blocks all the traffic from Dan Pollock's list [1], then blocks all the traffic from major service providers (google analytics, etc) and social networks (fb, tw, google, etc) when not on their website. Referral and user agent headers removed, I haven't found the need to remove other headers. Currently working on preventing (and manually allowing) all xhr/script/image requests 2 sec…

Looks like that list hasn't been updated since our domain switch. If you really want to block our internal analytics (which are in practice fairly harmless) replace "hits.guardian.co.uk" with "hits.theguardian.com".

nice

Re: The Guardian Is Being Swamped with 'Dark Traffic'

#17
It's pretty crazy that browsers send referral in the first place. Getting rid of it, accidentally or not, is not a bug.

I use refcontrol[1] to spoof the referral. I'm always visiting from the front page of the website even though I'm almost never visiting from the front page.

[1] https://addons.mozilla.org/en-US/firefox/addon/refcontrol/

Re: The Guardian Is Being Swamped with 'Dark Traffic'

#18
post #8

Funny how the tone suggests that this is something malicious being done to the guardian.

It kind of is. The Guardian is funded by advertising and this limits their ad sales story. As the article points out, the main beneficiary of this is Google - who are essentially competing with the Guardian for ad sales. I don't always agree with the Graun, but I believe in plurality rather than a Google-dominated world. Throwaway because of inevitable downvotes from the privacy crowd.

>The Guardian is funded by advertising

Not entirely, no. It is funded by a trust, and part of the Guardian Media Group is an investment fund.

Re: The Guardian Is Being Swamped with 'Dark Traffic'

#20
This is another reason why a lot of links to certain pages have the referral or campaign information hardcoded into their URLs, which removes the need for a referral header. I guess if the Guardian really wants that information they can make a deal with app publishers or Reddit or whoever to add a header like that.

But on the other hand, given how it was the Guardian that published all of the original Snowden articles and information, they of all newspapers should applaud this rapid increase in increased privacy from their readers.

I can't actually read the dates on the charts, but I assume the increase started shortly after the Snowden revelations, when more sites were enabling https by default and people became more privacy-aware.

So the Guardian's a bit inconsistent here, On the one side they go "Big Brother is watching you!", on the other (in this article) they go "We're Big Brother and we can't see you anymore!"

Post reply on HN