Live data from Hacker News

Show HN: Most users won't report bugs unless you make it stupidly easy

news.ycombinator.com

91–100 of 226 posts

Re: Show HN: Most users won't report bugs unless you make it stupidly easy

#91
The worst example I ever experienced was finding an actual flaw within some software with Trac as a version control system - somehow DD-WRT comes to mind - and I submitted a bug report with full reproducibility workflow and everything I could imagine. Essentially, the platinum standard for submitting a bug report in software development.

It was immediately rejected.

The reasoning? “Did not identify the relevant code in which the error occurred”.

Like… WTF????

Edit: confirmed as DD-WRT. I’ve never submitted another bug report to them again. And I’ve submitted hundreds of reports to other projects all over.

Re: Show HN: Most users won't report bugs unless you make it stupidly easy

#92
post #61

Any involvement in reporting / fixing bugs is development. Why do app developers think their customers need to be or want to be developers? What other industry relies on its customers as implicit developers? Making bug reporting easier means an intentional push to foist more of Development's work upon customers and a bias towards more bugs. BUG OR FEATURE? If you can't tell, then we can understand why Knuth call it "…

> What other industry relies on its customers as implicit developers?

I would say most of them. To list a few:

- restaurants (almost all of them will send you feedback surveys these days, they also rely on you to tell them if they, for example, cooked your steak to the wrong temp)

- property maintenance (again, feedback surveys)

- auto mechanics (if the thing they fixed is still broken, a good mechanic wants to know)

- doctors (they rely heavily on YOU to tell you what wrong with your body)

- democratic political systems (when working correctly)

- road infrastructure (the city won't fix potholes nobody is reporting, and they won't do anything about badly tuned traffic lights nobody complains about)

- vaccines and medicine (the testing phase may not uncover every possible single side effect, they need recipients/users to report those if they happen)

(Please nobody come back with cynical takes on how these aren't helpful in their specific case/location, that's clearly not the point)

Re: Show HN: Most users won't report bugs unless you make it stupidly easy

#94
post #61

Any involvement in reporting / fixing bugs is development. Why do app developers think their customers need to be or want to be developers? What other industry relies on its customers as implicit developers? Making bug reporting easier means an intentional push to foist more of Development's work upon customers and a bias towards more bugs. BUG OR FEATURE? If you can't tell, then we can understand why Knuth call it "…

> What other industry relies on its customers as implicit developers? I would say most of them. To list a few: - restaurants (almost all of them will send you feedback surveys these days, they also rely on you to tell them if they, for example, cooked your steak to the wrong temp) - property maintenance (again, feedback surveys) - auto mechanics (if the thing they fixed is still broken, a good mechanic wants to know)…

none of these are bugs, they are complaints about specific date/time/incident.

restaurants

undercooked steak is not a bug unless every single steak on every single day is undercooked

property maintenance

same thing (and weird example)

auto mechanics

also not a bug, bad part, mechanic who didn’t get laid the nite before… not bugs…

doctors

not sure how to even respond to this… :)

democratic political systems

would be nice :)

road infrastructure

wear and tear :)

Re: Show HN: Most users won't report bugs unless you make it stupidly easy

#95

For many corporations, there are probably perverse incentives against making it easy to report bugs.KPI of reported bugs as an indicator of software quality, for example.

It's not just a problem in the corporate context. Open source projects usually make it a pain in the ass to submit bug reports too, in a clear effort to gatekeep the process to experienced developers. Simply because developers prefer to only deal with other developers and don't want to hear complaints about their software from the unwashed masses.

I can’t imagine I’d keep up a hobby of doing customer service type activities very long.

Re: Show HN: Most users won't report bugs unless you make it stupidly easy

#96

Earlier quoted context omitted.

> What other industry relies on its customers as implicit developers? I would say most of them. To list a few: - restaurants (almost all of them will send you feedback surveys these days, they also rely on you to tell them if they, for example, cooked your steak to the wrong temp) - property maintenance (again, feedback surveys) - auto mechanics (if the thing they fixed is still broken, a good mechanic wants to know)…

none of these are bugs, they are complaints about specific date/time/incident. restaurants undercooked steak is not a bug unless every single steak on every single day is undercooked property maintenance same thing (and weird example) auto mechanics also not a bug, bad part, mechanic who didn’t get laid the nite before… not bugs… doctors not sure how to even respond to this… :) democratic political systems would be n…

The unfortunate situation is that bugs in modern software just seem to… show up, as if their appearance is an ongoing maintainence issue rather than the outcome of something somebody on the development team did.

But, anyone who took the time to write bug-free code went out of business decades ago.

Re: Show HN: Most users won't report bugs unless you make it stupidly easy

#97

Earlier quoted context omitted.

> What other industry relies on its customers as implicit developers? I would say most of them. To list a few: - restaurants (almost all of them will send you feedback surveys these days, they also rely on you to tell them if they, for example, cooked your steak to the wrong temp) - property maintenance (again, feedback surveys) - auto mechanics (if the thing they fixed is still broken, a good mechanic wants to know)…

none of these are bugs, they are complaints about specific date/time/incident. restaurants undercooked steak is not a bug unless every single steak on every single day is undercooked property maintenance same thing (and weird example) auto mechanics also not a bug, bad part, mechanic who didn’t get laid the nite before… not bugs… doctors not sure how to even respond to this… :) democratic political systems would be n…

I think it's a given that I'm not using perfect metaphors, dissecting them is ignoring the point.

Users operate with different configurations, hardware, and needs. It is literally impossible to release bug free software. Every developer should try their best, obviously, but NOT requesting that bugs be reported is pure hubris on anyone's part

Re: Show HN: Most users won't report bugs unless you make it stupidly easy

#98
I love this, and I'm so glad it has resulted in more people filing bugs. That said, there is a larger problem going on here that has yet to be addressed by the software industry as a whole. And that is that "bugs" (and "filing" bugs) is a very complex thing. It's not just one thing, it's many, many things. And until we face that and provide a holistic solution for "it", it will continue to be an existential problem.

Here's a selection of the different kinds of complexity with "bugs":

- Type. Is it a backend or frontend bug? A network bug or an infrastructure bug? An internal or external bug? Is it a "not considered a bug" bug? Is it a bug in documentation, training, intuitiveness, etc? A product- or feature-specific bug? A location-specific bug? A user-specific bug?

- Context. Is the user even capable of giving you enough context and information for this bug report to be usable? If so, is automatic? If not, will the user simply give up reporting when this becomes difficult?

- Communication. How does the user even report a bug? (I regularly try to file bugs with every tech product I use - because they are constantly riddled with end-user bugs - but I spend hours trying to dig up some way to contact the company to report the bug, and when I finally can contact someone, they refuse to even take my bug report, because it's not one of the read-from-the-script-customer-service responses/actions. And if the user does eventually get in contact with the company, is the developer (or anyone else) even capable of communicating with this user to get more information or inform them of a fix?

- Visibility. Quite often, users will experience bugs, and maybe one report comes in about them. This is then captured by customer service or someone else, and maybe they file a ticket. But then for each subsequent request, they just tell the customer they will record it and then.... don't send it to anyone, because they've already sent one such bug and assume it's being fixed. So the developers have no idea how often this bug is actually happening. Often when bugs are reported the devs aren't informed at all.

- Impact. Is it just affecting a single user, once or twice, in a niche setting? Is it affecting the same user all the time? Is it affecting a subset of users? All users? Is it affecting all users, but core functionality still works? Is it significantly affecting core functionality? Is it affecting core functionality but there's bigger issues going on so it's actually less of an impact? Are the developers even capable of understanding the impact? (how many of you know exactly how much each specific function affects the business?)

- Prioritization. We all have ticketing systems full of hundreds of tickets that sit in the backlog never to be fixed. They're annoying, or difficult, or unsexy, or they're not a new feature. Sexy bugs get prioritized, unsexy bugs sit in the trash heap.

- Fixability. Even if all of the rest is provided for... how difficult or easy is it for a developer to fix? Is the developer capable of contextualizing it and making use of the information? Do some of them have difficulty reproducing it, while others don't? Do they have all the training needed on all the systems involved in order to effectively triage/investigate/troubleshoot? Are they given dedicated time each development cycle to fix bugs? Are they even able to track down who is responsible for "fixing" the bug, what with the modern mess of interdependent microservices and siloed development teams? Will they be implementing regression tests to make sure it doesn't come back? Are you rewarding them for this work, in addition to the rewards for "sexy work" (new features implemented, cost saved)?

Yes, getting users to file more bugs is fantastic! But that is quite literally the tip of the iceberg.

Re: Show HN: Most users won't report bugs unless you make it stupidly easy

#99
I think it's cool you built and shared it - grats on shipping.

But you (or your users) are about to learn a few truths about bugs and users :)

Foremost: unless your users pay for the product, there's a downside to easy bug reports - the vast majority will be useless, no matter how easy it is. Granted, that's true for paid products too, but at least you can bake the cost for dealing with that into the price of goods.

It's absolutely great while you're building traction. Even the most inane post has usually a kernel of truth. It's becoming a problem as you are clear on where you're heading, and the cost of dealing with them outpaces their value.

At that point, you either start stochastic sampling (annoying your users who write well thought-out reports, and who are your multipliers), or you spend a fortune to slog through everything. That's when you start writing the "feedback suite" backend :)

Re: Show HN: Most users won't report bugs unless you make it stupidly easy

#100
post #59

The problem with bug reporting is that they rarely seem to get fixed. I used to do a lot more bug reports. But you often hear back nothing, and then the bug is never fixed, even if it would be an easy fix. These days, I don't often report bugs.

Some teams have a frickin' bad attitude and couldn't care less. Try submitting a bug about how menus are displayed 5px from where they are supposed to be in a GTK app rendered on a X11-server that runs on the Windows desktop and see if the GTK developers care. Or try telling the react-testing-framework folks that they're asking me to put handrails in my bathroom when my house is burning down. Have experiences like th…

Don't forget all major OSS repositories using a stale bot to close any issue regardless of how many people reported it or how serious it is. Close and lock at times. Yikes.
Post reply on HN