Live data from Hacker News

Counting Ghosts: A case for abandoning web analytics

pcmaffey.com

71–80 of 100 posts

Re: Counting Ghosts: A case for abandoning web analytics

#71

If you don't have any analytics, then how do you know your audience size? Is it 10 people per month? 1000 people? 1,000,000 people? No offense but I can't accept "it doesn't matter."

Vanity metric. The only thing you need to know is how many people paid for your product.

Re: Counting Ghosts: A case for abandoning web analytics

#72
post #36

I don't get it - it is a nice sentiment, but the crux of the argument seems to "go with your gut." The reason web analytics has been so popular is that you can actually improve your product significantly without as much subjectivity. Before web analytics, going with your gut was the only option. It turns out, threading events through a funnel that show you lost 90% of your users because your button doesn't show up on…

You could hire a decent QA department.

Then you'd run the app on all screen sizes before each git push and notice that the button doesn't always show up, or isn't always clickable.

Re: Counting Ghosts: A case for abandoning web analytics

#73
post #66

Earlier quoted context omitted.

> Before web analytics, going with your gut was the only option. The analytics people insistent denial that usability research ever existed seems to have reached a new level.

What I wrote wasn't an insistent denial, try steelmanning next time. Extrapolating the magnitude of problems from user research is hard, since you're still sampling a distribution.

If the already-released version of your product has so many problems that you have to use computational techniques to extrapolate their magnitude, then you have already lost.

Re: Counting Ghosts: A case for abandoning web analytics

#74
post #36

I don't get it - it is a nice sentiment, but the crux of the argument seems to "go with your gut." The reason web analytics has been so popular is that you can actually improve your product significantly without as much subjectivity. Before web analytics, going with your gut was the only option. It turns out, threading events through a funnel that show you lost 90% of your users because your button doesn't show up on…

> improve your product significantly without as much subjectivity It's fake objectivity that often leads to a race to the boottom. Between "engagement" as a terrible proxy for user happiness/success and the idea that it's more important and better if nobody can fail to use your app's "UX" than it is if it to enables a smaller number of people who take the time to learn to do really great things, all wrapped up in the…

Analytics data are like emotions: a valuable source of information which should not be used as a direct controlling signal. It should be first thought through.

Re: Counting Ghosts: A case for abandoning web analytics

#75
post #49
post #36

I don't get it - it is a nice sentiment, but the crux of the argument seems to "go with your gut." The reason web analytics has been so popular is that you can actually improve your product significantly without as much subjectivity. Before web analytics, going with your gut was the only option. It turns out, threading events through a funnel that show you lost 90% of your users because your button doesn't show up on…

I've personally never been in a situation where analytics drove change. Even mere A/B testing seems like a ghost in (most?) organizations, where management or designers decide to force through their personal preferences. That said, I would love to join such an organization. Any suggestions on where to find data driven jobs?

At my previous job, A/B testing was widely used to check which of the small UX tweaks works better.

Re: Counting Ghosts: A case for abandoning web analytics

#76
post #36

I don't get it - it is a nice sentiment, but the crux of the argument seems to "go with your gut." The reason web analytics has been so popular is that you can actually improve your product significantly without as much subjectivity. Before web analytics, going with your gut was the only option. It turns out, threading events through a funnel that show you lost 90% of your users because your button doesn't show up on…

The pendulum has swung too far. We quantify everything now, chasing numbers to the point of losing our sense of quality and craftsmanship. There's a huge difference between "going with your gut" and the ability to assess, qualify, and reason about something. To understand how and why something works or doesn't. Whether from first principles or experience.

Numbers provide a happy path for consensus. If the "why" of your project is to please as many people as possible, then web analytics probably works great. I'm not arguing they're categorically useless, only trying to surface the unspoken costs I see bear out in our industry from relying on them so heavily.

Re: Counting Ghosts: A case for abandoning web analytics

#77

Earlier quoted context omitted.

*Update: I removed the pagination and scrolling effects. The entire post can be read on a single page now. (And I didn't need analytics to understand something wasn't working lol.)

But you did need user feedback, which analytics would help with

User analytics would not have provided feedback in the form of "I don't like the scrolling on this site."

Re: Counting Ghosts: A case for abandoning web analytics

#78
I totally thought this was going to be a different article on phantom clicks or botnet visitors.

Been thinking about that case lately, and it makes a much better argument for me in terms of analytics.

I realized that from my own perspective as a private citizen, I'm not sure if there's any way to prove that Google and Facebook are not falsifying my clicks. I face such an information disparity in bargaining. I literally depend on the company for the tools to monitor the company. "How many people downloaded my app? Arbitrary."

Its a bit like trying to win against the NSA inside America, except they can already listen to every phone line (still finding stuff, yet another NSA leak today).

It's just too easily Machiavellian. "We've got so many new user signups, and they all love your videos...post more content like that. All the rest of you are failures, because we can just bury your content and you'll never know."

Re: Counting Ghosts: A case for abandoning web analytics

#79
post #66

Earlier quoted context omitted.

> Before web analytics, going with your gut was the only option. The analytics people insistent denial that usability research ever existed seems to have reached a new level.

What I wrote wasn't an insistent denial, try steelmanning next time. Extrapolating the magnitude of problems from user research is hard, since you're still sampling a distribution.

What you wrote was just denial. The insistent part comes from every time those discussions going this same way.

Anyway, and FYI, one of the most robust findings in user research is that the magnitude of problems isn't really something important to know.

Re: Counting Ghosts: A case for abandoning web analytics

#80

I build websites for small business, and since the beginning have used Google Analytics. What used to be a valuable tool that I would eagerly tell my clients to utilize, has now become an overly complex nightmare I loathe to install and rarely recommend to my clients. I recently had a client ask to use StatCounter.com (my reaction: "they're still around?!?") and it was refreshingly simple, much like the original Goog…

GA4 is actually the simple version of GA. Lots of stuff is hidden. So it looks lol Google did exactly what you wanted )‘simplified Analytics service’). However, if you want an even simpler solution: Matamo is totally free as well.

GA4 which I've migrated about 250 clients to (that was a ton of fun /s) simplifies some things, but complicates others. I know of the alternatives but run into anther issue relating to cost: Most of my clients are not willing to pay (more) for analytics which is why GA remains the default (free) choice. Do I raise prices for everyone and include an analytics alternative? Or do I stop using GA and only give (alternative) analytics to clients that pay extra? I'm leaning towards the latter.
Post reply on HN