Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Show HN: E2E testing is a chore. We taught an AI to do it instead

playmatic.ai

Post reply on HN
Print view View original

1–10 of 10 posts

Show HN: E2E testing is a chore. We taught an AI to do it instead

#1

Post by ElasticBottle »

Hey Hacker News,

For the last 2 months, I've been working on a testing agent to free developers from the endless maintenance of end-to-end tests.

You just push up a PR, and our agent analyzes the code changes and automatically visits the preview to test things out like a real human!

We also support describing tests in English (or even in the PR description), and we'll go through your site whenever you want via a GitHub action to test and make sure various core flows continue to work as expected.

We are looking for early testers and are giving out a generous free tier! Just sign up on the landing page.

Show HN: E2E testing is a chore. We taught an AI to do it instead
playmatic.ai

Re: Show HN: E2E testing is a chore. We taught an AI to do it instead

#4

Post by MongooseStudios »

Did it tell you that your embedded video seems to be struggling to buffer content? How about that there isn't a way to seek to where I was in that video after it failed to resume playing and I had to refresh the page?

Did it tell you that it's weird the section headers on the homepage look like buttons? Or that it's also weird they are smaller than the text below them?

Did it tell you about the invisible footer links that were already mentioned?

Re: Show HN: E2E testing is a chore. We taught an AI to do it instead

#5

Post by ElasticBottle »

MongooseStudios wrote: post #4

Did it tell you that your embedded video seems to be struggling to buffer content? How about that there isn't a way to seek to where I was in that video after it failed to resume playing and I had to refresh the page? Did it tell you that it's weird the section headers on the homepage look like buttons? Or that it's also weird they are smaller than the text below them? Did it tell you about the invisible footer links…

Hmm, the video loads fine for me. Good call on the seeker, that's something we can add.

In general, our agent today is unlikely to call out on stylistic choices, but rather more so if something is broken. For e.g., the video doesn't start / the link doesn't go anywhere, etc.

everything you mention are good points though, and we've made a note!

Re: Show HN: E2E testing is a chore. We taught an AI to do it instead

#6

Post by MongooseStudios »

ElasticBottle wrote: post #5
MongooseStudios wrote: post #4

Did it tell you that your embedded video seems to be struggling to buffer content? How about that there isn't a way to seek to where I was in that video after it failed to resume playing and I had to refresh the page? Did it tell you that it's weird the section headers on the homepage look like buttons? Or that it's also weird they are smaller than the text below them? Did it tell you about the invisible footer links…

Hmm, the video loads fine for me. Good call on the seeker, that's something we can add. In general, our agent today is unlikely to call out on stylistic choices, but rather more so if something is broken. For e.g., the video doesn't start / the link doesn't go anywhere, etc. everything you mention are good points though, and we've made a note!

This is why E2E testing isn't a waste of time. I used your homepage like a user would for a few moments and provided value.
Post reply on HN