Live data from Hacker News

Show HN: Autotab – An AI-powered Chrome extension to create Selenium scripts

autotab.com

31–40 of 131 posts

Re: Show HN: Autotab – An AI-powered Chrome extension to create Selenium scripts

#31
post #9

Related: https://playwright.dev/ has a built-in code generator. In *my opinion*, it's also more pleasant to work with than Selenium.

Interesting, what features are most impactful in making it more pleasant to work with?

We picked Selenium because it seems much more widely used at least in the Python world (selenium has about 10x more downloads on PyPI than playwright). My guess is that's at least partly because Playwright is more focused on the JS/TS ecosystem and testing.

Re: Show HN: Autotab – An AI-powered Chrome extension to create Selenium scripts

#34

Earlier quoted context omitted.

Selectors have been our primary focus so far – they're notoriously finicky! Our roadmap includes more extensive use of AI, both as embedded intelligence, and in the code generation process. For example, one thing we've heard from heavy users of browser automation is that maintenance becomes the largest cost. Self-healing automations will be able to either fix themselves, our give you an alert with a suggested fix to…

The "self-healing" sounds very interesting. I've tried to think, myself, how to approach this in a chrome extension running dom selectors in automations. Curious if you have any high-level thoughts/findings in this area?

We're just getting started on it ourselves but it's a really fun problem. I think the useful thing from our findings so far is that simplifying the DOM representation really helps the model reason about state.

Re: Show HN: Autotab – An AI-powered Chrome extension to create Selenium scripts

#35

I don't get why people still use XPaths, CSS selectors or HTML IDs to identify elements, even when they are "recorded". Please please please just use my https://github.com/mherrmann/selenium-python-helium instead. It makes so much more sense.

Let me have the opportunity to really thank you for this it has been my goto library for scraping, while allowing also selenium syntax, the idea behind it is really great. Also the “elements below …” very nice

Please make the switch to selenium 4, so that it is kept up to date with the rest of the selenium ecosystem e.g. undetectable browsers

Re: Show HN: Autotab – An AI-powered Chrome extension to create Selenium scripts

#37
This is amazing. I will try to have it automate my system of agents web app in a meaningful way (turtles all the way down.) Shameless plug: https://github.com/agi-merge/waggle-dance

BTW I don’t normally use Chrome- I know why you would start with that, but it would be great to see a Firefox or even Safari version of this.

Re: Show HN: Autotab – An AI-powered Chrome extension to create Selenium scripts

#39

I was curious about the YC backing and realised that you're the founders of https://www.ztool.co . Did you pivot or is this a complementary prodcut to ztool? Would love to hear more about your journey :)

Hey, nice detective work :)

This is definitely more of a pivot, though the ZTool product also went through a few bigger iterations itself. I think my learnings from building and talking to users the last few months boil down to two main things that led me to work on autotab.

    1. AI-generated software isn't ready for non-technical users. With ZTool I was initially focused on making it easy for people who don't know how to code to create automations. For the reasons we talked about above, I think having the model's output be code is best for now, so autotab is focused on users that can review and tweak Python code.
    2. How you communicate intent matters. There is a surprising amount of mental work required to go from "this task is annoying" to creating a structured representation of it (c.f. the whole world of process automation). AI demos have focused on short prompts to communicate intent, but those don't work that well for more complex domains. Using the browser to communicate intent seems really powerful because it's so intuitive/familiar.

Re: Show HN: Autotab – An AI-powered Chrome extension to create Selenium scripts

#40

Awesome. I'm mostly curious what the path to monetization for this is

I'm more interested in making it useful than extracting value.

Longer term I think you'd monetize the infrastructure to run the automations at scale in the cloud.

Post reply on HN