[dead]
Launch HN: TesterArmy (YC P26) – Agents that test web and mobile apps
71–80 of 87 posts
Re: Launch HN: TesterArmy (YC P26) – Agents that test web and mobile apps
#72[flagged]
Re: Launch HN: TesterArmy (YC P26) – Agents that test web and mobile apps
#73Seems interesting, but I wonder about this > Traditional E2E tests are slow to set up and expensive to maintain. Isn't this just using agents to create e2e tests or is there some better new approach I'm missing?
We use agents to navigate the app, making real-time decisions based on its state. I prefer to compare it more to a manual QA engineer than to static e2e tests. We spent a lot of time on the harness to make sure the results are reliable. This allows you to assert on dynamic content like AI-generated content. We also support validation of email flows since the agent can read its own email.
> We use agents to navigate the app, making real-time decisions based on its state.
This still leads me to my original question of how though. If you're not using locators are you just passing page contents to the LLM? Or using a multi modal model and say screenshotting? My experience with that has been pretty poor and worse than proper e2e scripts, and is fairly expensive to boot.
Sorry for the insistence haha, just interested because it could be pretty groundbreaking if done well.
Re: Launch HN: TesterArmy (YC P26) – Agents that test web and mobile apps
#74Congrats on the launch!
Will this solution work with services protected by cloudflare turnstile or captchas? Does this involve human in a loop?
Re: Launch HN: TesterArmy (YC P26) – Agents that test web and mobile apps
#75Re: Launch HN: TesterArmy (YC P26) – Agents that test web and mobile apps
#76[flagged]
Re: Launch HN: TesterArmy (YC P26) – Agents that test web and mobile apps
#77How do you differ from othe companies doing automated testing?
Rainforest QA, for example, has been in this space for a while and also happens to be a YC company.
Re: Launch HN: TesterArmy (YC P26) – Agents that test web and mobile apps
#78I'm curious how your mobile testing compares to https://revyl.com I've been experimenting with Revyl and it's really nice. I think this agent-driven testing is the future.
Curious how they frame testing on real devices: “Real devices on demand: spin up iOS simulators and Android emulators”. So those are not real/physical devices?
Physical devices for AI agents is something we at TestingBot do provide: https://testingbot.com/support/ai/mcp
Re: Launch HN: TesterArmy (YC P26) – Agents that test web and mobile apps
#79Has anyone tried to build their own version of this? It's cool, but I'm not super excited about using some 3rd party SaaS as a critical part of my testing.
I did. Checkout the OSS alternative - https://github.com/vostride/agent-qa
Nice!
I will say though, I don't really want to "write tests in natural language", I want something to crawl my app and figure out what's there and what's currently broken and then write its own regression tests.
Re: Launch HN: TesterArmy (YC P26) – Agents that test web and mobile apps
#80Earlier quoted context omitted.
Is there a long term future in hand-crafted UI/UX? Maybe not. Is there a future where we still have traditional UX? Absolutely. I don't want to write a whole dissertation on this topic, so I'm just going to mention that we tried to build AI voice assistants for a decade, and while LLMs have basically solved understanding, they have not solved the UX portion.
Aside from entertainment/marketing purposes, I think UI will become useless. Why should I interact with UI when an agent can (and will) interact with it?
Because you do not know everything and information (possible inputs, actual outputs) still needs to be presented to you. Because text is not the best way to present everything. Because consistency of presentation makes it easier to absorb. Because everything is social and standardization is useful.