Live data from Hacker News

Launch HN: Rainforest QA (YC S12) – No-Code UI Test Automation

news.ycombinator.com

81–89 of 89 posts

Re: Launch HN: Rainforest QA (YC S12) – No-Code UI Test Automation

#81

Are you testing Rainforest UI with Rainforest? If not when do you think it will be possible to do (for majority of your views let's say)?

Yes, we are dogfooding pretty hard! We release a bunch of times a day and every release goes through a suite of >130 Rainforest tests for regression. We also add tests for every new feature we release, so it keeps growing. It was a cool thing to write tests for testing the test writing interface :) That's one "level deep" - out of curiosity I was playing with how deep it's possible to go and it turned out at 7 levels…

Adding to this, we've been doing this since at least 2013 - https://www.rainforestqa.com/blog/2013-11-04-extreme-dogfood...

Re: Launch HN: Rainforest QA (YC S12) – No-Code UI Test Automation

#82

Earlier quoted context omitted.

Agree, no-code seems to optimize for a large number of people being somewhat effective, but with less control over the output (increasing fragility, rework) Code is more upfront effort but more control and thus less fragility but more maintainable over time (if done right). I imagine there are some/many situations where throwing many people at a problem is the “best” way and this would suit that quite well I guess.

In my experience, many orgs that work with Selenium and its derivatives have described that (coded) approach as flaky / brittle (i.e., fragile). Of course, until automation gets to be as clever of humans, any test automation approach is going to have some flavor of brittleness.

Playwright is excellent too. Playwright is much more forgiving with tests that need to high different origins (common with Enterprise apps) and multiple browsers in the same test (to verify collaborative editing etc). If you're considering Cypress, I'd highly recommend also giving Playwright a look (https://playwright.dev )

Re: Launch HN: Rainforest QA (YC S12) – No-Code UI Test Automation

#84
post #83

Is there a solution for paranoid companies that don't want your VMs to have access to the application(s) under test?

So far this objection hasn't really been raised more than a couple of times that I can recall. So far, folks have been satisfied using our automation or crowd in the cloud due to our security, external auditing and contracting.

For the crowd side (which use the VMs), you can bring your own humans to make your own custom crowd, which we'll manage for you. It's mainly used by larger enterprise companies with existing bigger teams.

Re: Launch HN: Rainforest QA (YC S12) – No-Code UI Test Automation

#86
This seems like Sikuli back in the day, or other OCR/CV based testing tools. It will be interesting to see your take on it!

How do you handle branch or error handling code logic that is ultimately code-like? How would a customer version control and audit the version of the test that was run at a point in time?

Re: Launch HN: Rainforest QA (YC S12) – No-Code UI Test Automation

#87
post #76

It's a bit unclear, but can this be used to test native desktop applications as well?

yes :)

Awesome! I see there's mentions of it on the website, but I don't see how to do it via the dashboard UI and there's not much in the docs about it. Wrote to support, would be nice to try this out.

Re: Launch HN: Rainforest QA (YC S12) – No-Code UI Test Automation

#88
post #84
post #83

Is there a solution for paranoid companies that don't want your VMs to have access to the application(s) under test?

So far this objection hasn't really been raised more than a couple of times that I can recall. So far, folks have been satisfied using our automation or crowd in the cloud due to our security, external auditing and contracting. For the crowd side (which use the VMs), you can bring your own humans to make your own custom crowd, which we'll manage for you. It's mainly used by larger enterprise companies with existing b…

It’s definitely possible to get done, I work in a place where we deployed a testing product with similar architecture and it took about a year to get approved.

Some ability to host it or build a dedicated instance would be easier for us, but if your experience shows the market doesnt care its probably not worth the time.

Re: Launch HN: Rainforest QA (YC S12) – No-Code UI Test Automation

#89

When I click the help centre link ( https://help.rainforestqa.com/en/ ) I get a 404 :D

Oh thanks for letting us know! Where did you find this link? It should be https://help.rainforestqa.com/

I did find it, but now I can't re-find it! Never mind.
Post reply on HN