Earlier quoted context omitted.
It is a rolling release, that means each time a new version of a package is available they will try and incorporate it. Apparently the difference they have to gentoo, arch et al is that they have a large CI that actually inspects screen shots to verify that the new package didn't break anything. I run antergos (arch based) at home, having the bleeding edge is nice, but the AUR is really what seals the deal for me. Th…
CI tests as described are very good for minor patches, but new features and significant UI changes seem to require significant manual updates to tests anyway.
In the case of UI changes, openQA can have it's 'needles' updated in it's webUI. Look at the new screenshot, compare to the old screenshot, tell openQA to like the new stuff, done.
In the case of functionality or workflow changes, yeah, tests need to be adapted, but the openQA test writing language is pretty human friendly, describing the steps that humans actually do, so it's not that hard to alter
And because we test at the point of submission before anything is merged to the distribution, we generally catch the behaviour changes as part of the package submission, then we have developers keen to get their stuff in the distribution happy to help tune up the tests ;)