Live data from Hacker News

Ask HN: Do you have a dedicated QA team?

news.ycombinator.com

1–10 of 84 posts

Ask HN: Do you have a dedicated QA team?

#1
At my current company they recently got rid of our QA resources. They were contractors and reassigned to do assist in other projects. However, the company now believes developers don't need QA since they can do their own testing. Devs should write code, do all their unit, int, system testings, run their code reviews, save testing artifacts, and work with key stakeholders across the company to close requirements gaps etc. We're basically the entire sdlc minus devops.

This is great for small features, but it gives me pause for mid or large features. Are we the only ones doing this?

Re: Ask HN: Do you have a dedicated QA team?

#2
We have a dedicated QA team. Recently they've been "rolled into" the dev team, but they're still a group of people dedicated to testing. The actual developers should be writing their unit tests and functionally validating before opening a PR, then the other devs can validate before approving that PR, but the full E2E, automation, etc. tests should have a dedicated team, because there is a lot involved in doing that properly, and developers need time to... ya know, develop.

By putting all those responsibilities on the devs, they have essentially turned a parallel development system into a serial one, which is inefficient and, frankly, dumb.

Re: Ask HN: Do you have a dedicated QA team?

#3
This seems to be a pretty common setup. I’ve heard opinions on both sides about whether it is a good idea.

One of the biggest challenges with it for me is that a dev who is a dev is a very different personality who a dev who manages the entire SDLC.

The former placed in the latter environment is going to be lost and annoyed at all the moving parts. They signed up to write code and to trust that the process would deliver good requirements.

The latter in the former environment is going to be frustrated by all the process. They signed up to really own the product and realize that they really just own a block of a process.

I suspect either can work if you have people suited for each. Switching people between them sounds like a recipe for attrition though.

Re: Ask HN: Do you have a dedicated QA team?

#4
In my company we also have dedicated QA teams. I agree with all IcePunkMetal wrote above, getting rid of them is kind of dumb. Like he wrote, they are now rolled up into the dev team instead of being part of the separate "QA division", which is better IMO. But they're still not developers.

In my team, they are fully integrated into the decision making process and roadmaps, they are CCd to almost all the team's internal emails, and a format version isn't released without their authorization.

Now, there are some problems with being a QA, personal stuff like having a low self-esteem since "you're not smart enough to be a dev", and enmity between devs, PMs and QA due to feelings that QA hold up the teams. As a former QA myself I'm fully aware of them. In our particular team these issues are negligible (well, at least I hope they are). I personally fully respect the QA team and stop whatever I'm doing to help them with whatever they need or ask. I see them as my first line of defense against bugs, especially the kind of UX bugs that are difficult to test for.

Re: Ask HN: Do you have a dedicated QA team?

#5
We didn't use to, but now we do. I think we did a better job when we didn't have the team TBH.

Engineers here used to be the ones testing out the code, verifying their changes on pre-production environments, and keep an eye on the deployed code in production to make sure it's working well.

Now I get a sense that engineers do the work up to the point of where QA steps in, and throwing it over to them and moving on. The QA team is new, and so not very well versed in the product, and rely on the engineers a great deal on how to test things, which I get the feeling also ends with the QA team not going out of their way to test things the engineers didn't explicitly say to test. I think it may be playing out in a way where our quality assurance could get worse, and our engineers will end up being less well-versed in the product, and feel less responsibility for delivering quality, while also requiring another team to manage, and spreading work over different people. As a disclaimer I think we may just have a not great setup more-so than saying all QA is bad.

Re: Ask HN: Do you have a dedicated QA team?

#6
My feel is that this pattern leads to quantitatively better software that is qualitatively worse. There are two reasons for this:

1. QA teams come up with new ways to break software in the way humans use it. Automated tests etc confirm the software works as designed.

2. Because the org making this choice isn't stupid, they measure bug frequency and impact and find that "only X users have Y impact where Y is ranked as low" per each bug. No one bug is ever worth fixing. But, user X aren't seeing that one bug, they get hit by tens or hundreds of these on a regular basis. As a result, their perceived experience with a given product is poor and it feels buggy.

This idea that you can measure bugs in isolation and deliver perceived product quality is faulty. A user experiences a product as a whole, and if you can't evaluate that as well, you will be seen as delivering a poor product.

Re: Ask HN: Do you have a dedicated QA team?

#7

My feel is that this pattern leads to quantitatively better software that is qualitatively worse. There are two reasons for this: 1. QA teams come up with new ways to break software in the way humans use it. Automated tests etc confirm the software works as designed. 2. Because the org making this choice isn't stupid, they measure bug frequency and impact and find that "only X users have Y impact where Y is ranked as…

The most common pattern I've seen, which dovetails with this analysis, is that new features are thus treated as more important as long as there is a path around existing bugs. Bugs gets treated as technical debt, and given as much priority.

Re: Ask HN: Do you have a dedicated QA team?

#8
Devs can add automation tests to a suite just fine. What you lose when you lose dedicated QA is: who improves the automation suite? Who checks out new testing tools and POCs them? Who reads QA blogs and goes to QA conferences and generally considers it their profession to find ways to test more effectively?

Re: Ask HN: Do you have a dedicated QA team?

#9

My feel is that this pattern leads to quantitatively better software that is qualitatively worse. There are two reasons for this: 1. QA teams come up with new ways to break software in the way humans use it. Automated tests etc confirm the software works as designed. 2. Because the org making this choice isn't stupid, they measure bug frequency and impact and find that "only X users have Y impact where Y is ranked as…

The best QA setup I've seen was a parallel one. Devs and QA were given the same requirements doc, and independently worked out their assumptions and implementation. QA was often ready before dev work was done so sometimes devs could even run their tests locally to see if they pass. It was really remarkable. It's frustrating its not so clean usually.

Re: Ask HN: Do you have a dedicated QA team?

#10
Good QAs are so important. There are so many bugs that would have never been found by us. In the past 3 weeks, both our QAs have been off, and the inbox list of problems have grounded to almost zero! Not because we are writing more-than-usual-amazing code, but because no one managed to find them.
Post reply on HN