Are you testing Rainforest UI with Rainforest? If not when do you think it will be possible to do (for majority of your views let's say)?
Yes, we are dogfooding pretty hard! We release a bunch of times a day and every release goes through a suite of >130 Rainforest tests for regression. We also add tests for every new feature we release, so it keeps growing. It was a cool thing to write tests for testing the test writing interface :) That's one "level deep" - out of curiosity I was playing with how deep it's possible to go and it turned out at 7 levels…
Launch HN: Rainforest QA (YC S12) – No-Code UI Test Automation
81–89 of 89 posts
Re: Launch HN: Rainforest QA (YC S12) – No-Code UI Test Automation
#82Earlier quoted context omitted.
Agree, no-code seems to optimize for a large number of people being somewhat effective, but with less control over the output (increasing fragility, rework) Code is more upfront effort but more control and thus less fragility but more maintainable over time (if done right). I imagine there are some/many situations where throwing many people at a problem is the “best” way and this would suit that quite well I guess.
In my experience, many orgs that work with Selenium and its derivatives have described that (coded) approach as flaky / brittle (i.e., fragile). Of course, until automation gets to be as clever of humans, any test automation approach is going to have some flavor of brittleness.
Re: Launch HN: Rainforest QA (YC S12) – No-Code UI Test Automation
#83Re: Launch HN: Rainforest QA (YC S12) – No-Code UI Test Automation
#84Is there a solution for paranoid companies that don't want your VMs to have access to the application(s) under test?
For the crowd side (which use the VMs), you can bring your own humans to make your own custom crowd, which we'll manage for you. It's mainly used by larger enterprise companies with existing bigger teams.
Re: Launch HN: Rainforest QA (YC S12) – No-Code UI Test Automation
#85It's a bit unclear, but can this be used to test native desktop applications as well?
Re: Launch HN: Rainforest QA (YC S12) – No-Code UI Test Automation
#86How do you handle branch or error handling code logic that is ultimately code-like? How would a customer version control and audit the version of the test that was run at a point in time?
Re: Launch HN: Rainforest QA (YC S12) – No-Code UI Test Automation
#87It's a bit unclear, but can this be used to test native desktop applications as well?
yes :)
Re: Launch HN: Rainforest QA (YC S12) – No-Code UI Test Automation
#88Is there a solution for paranoid companies that don't want your VMs to have access to the application(s) under test?
So far this objection hasn't really been raised more than a couple of times that I can recall. So far, folks have been satisfied using our automation or crowd in the cloud due to our security, external auditing and contracting. For the crowd side (which use the VMs), you can bring your own humans to make your own custom crowd, which we'll manage for you. It's mainly used by larger enterprise companies with existing b…
Some ability to host it or build a dedicated instance would be easier for us, but if your experience shows the market doesnt care its probably not worth the time.