Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Show HN: Autotab – An AI-powered Chrome extension to create Selenium scripts

autotab.com

Post reply on HN
Print view View original

51–60 of 131 posts

Re: Show HN: Autotab – An AI-powered Chrome extension to create Selenium scripts

#51

Post by monkpit »

alexirobbins wrote: post #26
monkpit wrote: post #15

Earlier quoted context omitted.

AI looks to be involved in creating element selectors.

Selectors have been our primary focus so far – they're notoriously finicky! Our roadmap includes more extensive use of AI, both as embedded intelligence, and in the code generation process. For example, one thing we've heard from heavy users of browser automation is that maintenance becomes the largest cost. Self-healing automations will be able to either fix themselves, our give you an alert with a suggested fix to…

So I assume the video is the ground-truth, then the AI has access to the DOM and the video, and generates a selector based on the video during the test run (each time) in order to do avoid flakiness due to DOM/class/attribute changes?

Re: Show HN: Autotab – An AI-powered Chrome extension to create Selenium scripts

#53

Post by gHA5 »

Does this allow me to record something like a workflow or macro I can use as a shortcut in an open browser window or is it restricted an automated process of opening a browser window and executing some actions?

Specifically, assume I have a bunch of open tabs, each with an identical element, say the Full Screen button on Youtube video pages. Can I record "Exit Full Screen, move to next tab, enter Full Screen of the video on the page" with Autotab?

Re: Show HN: Autotab – An AI-powered Chrome extension to create Selenium scripts

#55

Post by jondwillis »

jonasnelle wrote: post #42
jondwillis wrote: post #37

This is amazing. I will try to have it automate my system of agents web app in a meaningful way (turtles all the way down.) Shameless plug: https://github.com/agi-merge/waggle-dance BTW I don’t normally use Chrome- I know why you would start with that, but it would be great to see a Firefox or even Safari version of this.

Glad to hear it, let me know how it goes! And yes, other browsers are definitely in our future at some point

I got stuck with an `autotab record` error after following the README setup instructions:

selenium.common.exceptions.WebDriverException: Message: Service /opt/homebrew/bin/chromedriver unexpectedly exited. Status code was: -9

Re: Show HN: Autotab – An AI-powered Chrome extension to create Selenium scripts

#56

Post by jonasnelle »

dr_kiszonka wrote: post #54

Hey, it looks very neat. I was wondering if Autotab currently supports logging into websites that require 2FA. (Your readme mentions Google only.)

Hey, we're looking to build out our library of authentication plugins. Many websites offer "Sign in with Google" which makes things easier, you can just specify that in the autotab.yaml file. If you have a specific website in mind, I'd be happy to add support for it!

Re: Show HN: Autotab – An AI-powered Chrome extension to create Selenium scripts

#57

Post by alexirobbins »

gHA5 wrote: post #53

Does this allow me to record something like a workflow or macro I can use as a shortcut in an open browser window or is it restricted an automated process of opening a browser window and executing some actions? Specifically, assume I have a bunch of open tabs, each with an identical element, say the Full Screen button on Youtube video pages. Can I record "Exit Full Screen, move to next tab, enter Full Screen of the v…

You could do a version of this if you always open your Youtube videos in the browser instance your autotab script spins up, but short answer is not really. Macros like this are super interesting though, and we've talked a lot about ways browsers could be designed for AI and automation like this.

Re: Show HN: Autotab – An AI-powered Chrome extension to create Selenium scripts

#58

Post by jonasnelle »

jondwillis wrote: post #55
jonasnelle wrote: post #42

Earlier quoted context omitted.

Glad to hear it, let me know how it goes! And yes, other browsers are definitely in our future at some point

I got stuck with an `autotab record` error after following the README setup instructions: selenium.common.exceptions.WebDriverException: Message: Service /opt/homebrew/bin/chromedriver unexpectedly exited. Status code was: -9

Hm, that unfortunately sounds like a chromium/Chromedriver error which can be somewhat finicky. I recommend check that the versions you're using match (`chromedriver --version` and at chrome://settings/help). Let me know how it goes and happy to help debug further (though GPT4 is probably more helpful than I will be)

Re: Show HN: Autotab – An AI-powered Chrome extension to create Selenium scripts

#59

Post by jonasnelle »

gHA5 wrote: post #53

Does this allow me to record something like a workflow or macro I can use as a shortcut in an open browser window or is it restricted an automated process of opening a browser window and executing some actions? Specifically, assume I have a bunch of open tabs, each with an identical element, say the Full Screen button on Youtube video pages. Can I record "Exit Full Screen, move to next tab, enter Full Screen of the v…

This is very interesting, may I ask what macros you would define? Definitely something I'd like to learn more about

Re: Show HN: Autotab – An AI-powered Chrome extension to create Selenium scripts

#60

Post by jonasnelle »

derac wrote: post #50

I'd love if it could output Playwright code as well. I haven't tried it but if this works well it's a great concept!

Good to know! The comments have definitely made us update towards looking into Playwright again quite seriously
Post reply on HN