At the project I’m currently working on we evaluated WinAppDriver (for WPF) and found it to be pretty buggy, slow and low featured. In the end we decided for a commercial product on around the same level as it, but if you’re on windows you can always use the ui automation Framework.
Any recommendations of commercial products that worked for you?
Our team's troubles writing automated UI tests
21–28 of 28 posts
Re: Our team's troubles writing automated UI tests
#22I think this is one of the "dirty secrets" of current software development ... one of those things that pretty much nobody does very well (at least, anywhere I have seen). My view is that we won't make real progress on proper UI testing until there is a paradigm shift that moves responsibility for creating applications that are fundamentally testable to developers. This is not dissimilar to how the idea of "devops" f…
Development for devops is based on write code, run it ,see if it works, move on.
Re: Our team's troubles writing automated UI tests
#23I think this is one of the "dirty secrets" of current software development ... one of those things that pretty much nobody does very well (at least, anywhere I have seen). My view is that we won't make real progress on proper UI testing until there is a paradigm shift that moves responsibility for creating applications that are fundamentally testable to developers. This is not dissimilar to how the idea of "devops" f…
Without those “above” developers on board, you end up with a hodgepodge suite of tests because developers/QA are forced to focus on delivering features instead of a testable product and reliable tests.
Re: Our team's troubles writing automated UI tests
#24The thing about writing test, either unit test or functional UI test, is repeatability. Back then I had this problem too, to which I had worked on getting a script to drop the database, and recreate it back again, repopulating it with consistent test data.
Then, docker-compose came along. It is so easy right now to just have an environment up and running consistently. And once the test is done, the whole container set of the docker-compose can be easily removed, and created again on a whim.
For most database containers, you can just attach your sql files into the volumes that the database engine reads, and you will have consistent test sets overtime.
This will solve :-
1. Running test again and again, will make certain elements go of page because of pagination. 2. Creating new data with the same data to ensure uniqueness and testing it, can be done, because it will be a clean slate everytime. 3. Previous data causing inconsistent state with the current test
This does not solve every issue with functional UI testing, but in my experience, having consistent data every time is huge! No more second guessing when you write the logic in your test in fear of having existing data or any manual testing data breaking your test.
Re: Our team's troubles writing automated UI tests
#25Not intending to drop yet another test tool in the mix, but if you are worried about flakiness due to timeouts or dynamic classes/id you can take a look at boozang.com.
It has many similarities to Cypress, but element selectors are based on natural language so doing automation on top of changing ids/classes is trivial. Also it supports Chrome, Firefox, Safari, Opera and Chromium Edge.
Re: Our team's troubles writing automated UI tests
#26Repurpose a graphical process automation tool. You're going to have a lot better time. https://www.uipath.com/
That is very interesting! What benefits do you see from using UiPath over testing frameworks?
Compatibility has an extremely long tail.
The only companies incentivized to implement support for that long tail are those who derive revenue from doing so.
Testing frameworks, by and large, don't derive revenue from that. Process automation frameworks do.
Ergo, if you're sick of "Oh, well that isn't supported", use the latter, even if for the purposes of the former.
Re: Our team's troubles writing automated UI tests
#27Re: Our team's troubles writing automated UI tests
#28I've found this while looking last two days - https://visualregressiontesting.com/ - but in my case I'm more into validating 3d rendering from a tool