Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Show HN: Finalrun – Spec-driven testing using English and vision for mobile apps

github.com

Post reply on HN
Print view View original

11–20 of 22 posts

Re: Show HN: Finalrun – Spec-driven testing using English and vision for mobile apps

#11

Post by gavinray » 

  > The shift for me was realizing test generation shouldn’t be a one-off step. Tests need to live alongside the codebase so they stay in sync and have more context.
Does the actual test code generated by the agent get persisted to project?

If not, you have kicked the proverbial can down the road.

Re: Show HN: Finalrun – Spec-driven testing using English and vision for mobile apps

#12

Post by ashish004 »

gavinray wrote: post #11

> The shift for me was realizing test generation shouldn’t be a one-off step. Tests need to live alongside the codebase so they stay in sync and have more context. Does the actual test code generated by the agent get persisted to project? If not, you have kicked the proverbial can down the road.

Yes gavinray, It gets persisted to the project. Its lives alongside the codebase. So that any test generated has the best context of what is being shipped. which makes the AI models use the best context to test any feature more accurately and consistently.

Re: Show HN: Finalrun – Spec-driven testing using English and vision for mobile apps

#17

Post by ashish004 »

usual_engineer wrote: post #16

Verification of AI generated code right would be dope. We do something similar in our company for web with playwright but facing a lot of flaky tests. Will check this out

Hey, thats true, verification of ai generated code needs proof with video of each action, console logs and network logs. Would love to know how you are solving for web. would be a great learning for me too.
Post reply on HN