Live data from Hacker News

Are Posterous Fudging Visitor Statistics?

blog.awesomezombie.com

21–30 of 36 posts

Re: Are Posterous Fudging Visitor Statistics?

#22
post #20

Our focus is on building the best product. It so happens to be that we are aware of the issue and recommend that you use Google Analytics for deeper insight into visitors and views. Here is a bit of how-the-sausage is made, but you wouldn't believe how much of a negative response we got from existing users once we went to a fully JavaScript analytics system. So by sheer volume of user input we made the decision to re…

Wouldn't simply excluding any http request whose user agent contains "googlebot" from the displayed count make it dramatically more accurate without needing a switch to JS-based analytics?

I think AWStats has a a list of "bot" useragents regexs. I'd probably start there.

That said, I know my sites get many thousands of hits from rogue comment spam and email harvesting bots with forged user agents.

Re: Are Posterous Fudging Visitor Statistics?

#23
post #20

Our focus is on building the best product. It so happens to be that we are aware of the issue and recommend that you use Google Analytics for deeper insight into visitors and views. Here is a bit of how-the-sausage is made, but you wouldn't believe how much of a negative response we got from existing users once we went to a fully JavaScript analytics system. So by sheer volume of user input we made the decision to re…

Wouldn't simply excluding any http request whose user agent contains "googlebot" from the displayed count make it dramatically more accurate without needing a switch to JS-based analytics?

Trust me on this: no. I used to have ABingo ignore hits from several common bots. I then got around to implementing JS challenges. Participants in A/B tests prior to login immediately decreased by 75%, to about what my GA stats showed.

P.S. As long as we're here:

request.user_agent =~ /\b(HttpClient|Baidu|Gigabot|Googlebot|libwww-perl|lwp-trivial|msnbot|SiteUptime|Slurp|WordPress|ZIBB|ZyBorg)\b/i

That, theoretically speaking, is supposed to catch most common well-behaved bots. Feel free to copy/paste it if you want, as it is better than nothing, but it probably won't get you in the vicinity of good numbers.

Incidentally, since page views are a vanity metric which don't really matter, I don't think that worrying about "good numbers" is that productive either way.

The only reason I was eventually convinced to care for A/Bingo is that artificially suppressing conversion rates can through statistical tests off, and A/B tests actually create actionable information for my business. For people who blog because they want to be heard, though, would lying to them to tell them they're more popular than they actually are actually hurt them? That strikes me as being close to the canonical white lie, in response to "Does this dress make me look fat?"

Re: Are Posterous Fudging Visitor Statistics?

#26
post #11

They're just counting views in a particularly unrealistic but technically not incorrect way. Seems to be pretty much par for the course, like when twitter announces a billion new users, most of which are probably bots and/or quora.

The test has to be what your users understand that value to mean. I'm betting almost all Posterous users think they're being read by significantly more people than they actually are. If Posterous can't provide meaningful stats (and I appreciate that filtering out bots may be non-trivial) then they should just avoid providing stats altogether. Bad data is worse than no data as it's much more misleading.

For a site whose key value proposition is vanity - is it really? HotOrNot scales all ratings by (rating / 2 + 5.0), i.e. everybody's above average. According to the post by James Hong where he mentioned this, they seem to have found a notable increase in user satisfaction with the change.

Is it any different from Victoria Secret bras running a cup size or three higher than everyone else, or dress sizes continually shifting downwards, or SAT scores being recentered upwards by 100 points?

Re: Are Posterous Fudging Visitor Statistics?

#27
post #15

Our focus is on building the best product. It so happens to be that we are aware of the issue and recommend that you use Google Analytics for deeper insight into visitors and views. Here is a bit of how-the-sausage is made, but you wouldn't believe how much of a negative response we got from existing users once we went to a fully JavaScript analytics system. So by sheer volume of user input we made the decision to re…

Do you not think the page view stats are completely misleading your users ? There's absolutely no indication on Posterous that bots are likely responsible for thousands of the page views shown (which given the long tail nature of Posterous I imagine we're talking about the majority of the page views here for a lot of users). One user even reported that GA was showing 14 visitors while Posterous was showing 9316: http…

A few weeks ago we had some bugs in new batch processing code that caused some major errors there. These bugs have since been fixed. We are definitely not as far off as 9316 vs 14 in normal operation.

These numbers are far from meaningless. At the end of the day the numbers reflect what our servers see -- they track something different from Google Analytics but they are useful as a simple ballpark for how interesting or visited your blog post was. Also, they're realtime, which GA does not provide.

Re: Are Posterous Fudging Visitor Statistics?

#28

Our focus is on building the best product. It so happens to be that we are aware of the issue and recommend that you use Google Analytics for deeper insight into visitors and views. Here is a bit of how-the-sausage is made, but you wouldn't believe how much of a negative response we got from existing users once we went to a fully JavaScript analytics system. So by sheer volume of user input we made the decision to re…

I had the same exact problem when I built the URL shortener Cligs, and back then there was no way to implement a JS-based solution: the HTTP 301 redirect gave instructions to the browser before it would even get to executing any JS.

So I built a very simple bot detector based on IP adresses and user agents. With your volume of traffic you can do this too. Be sure to keep updating it (automatically!) and apply the detection retroactively.

The bot detector cut well over 90% of the hits reported in the real time analytics. Users complained that suddenly they were not as popular on twitter as they thought they were but accepted that the new numbers are more accurate. That's the key benefit you need to explain to your users: accuracy. They care about it a lot more than the vocal minority suggests.

Re: Are Posterous Fudging Visitor Statistics?

#30
post #8

Earlier quoted context omitted.

It's a cultural difference. In the US, people refer to the named entity (is). In the UK, they refer to the collection of people that make up the entity (are).

Interesting, good to know. How do UK speakers deal with non-named entities? For example: My family is/are going out to the movie. The class was/were getting restless. These are common gotchas on the SAT in the US; one of their favorite tricks is using plural country names, like "The United States of America (is/are) ...", where in US English "is" is the correct version. Cheap trick that really only tests whether you'…

"The United States of America (is/are) ...", where in US English "is" is the correct version.

Interesting, I didn't know that. I'd have presumed that one would use "is" when referring to the country, and "are" when referring to the group of states. Is this incorrect? (for what it's worth, I'm from the UK ;)

Post reply on HN