Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Show HN: Autotab – An AI-powered Chrome extension to create Selenium scripts

autotab.com

Post reply on HN
Print view View original

91–100 of 131 posts

Re: Show HN: Autotab – An AI-powered Chrome extension to create Selenium scripts

#91

Post by jondwillis »

justusthane wrote: post #89
jondwillis wrote: post #37

This is amazing. I will try to have it automate my system of agents web app in a meaningful way (turtles all the way down.) Shameless plug: https://github.com/agi-merge/waggle-dance BTW I don’t normally use Chrome- I know why you would start with that, but it would be great to see a Firefox or even Safari version of this.

Wow! I haven't played with it a much yet, but just wanted to say that waggledance.ai seems really, really cool. It seems like a really interesting idea, and I love the UI and general aesthetic!

Thank you! It’s been fun to build and is getting even more fun now that I am adding skills and inter-agent interactions.

Re: Show HN: Autotab – An AI-powered Chrome extension to create Selenium scripts

#94

Post by keepamovin »

This is very cool! I want to host this on a server and deliver it using BrowserBox so you can build automations on mobile.

This was what I originally created BrowserBox for--a delivery platform for web scraping authoring tools so you're not limited by extensions--but got into building the remote browser as a product, and haven't got around to the automation authoring tool yet, haha!

Thank you for creating this, and making it MIT. AI-augmented human guided web scraping authoring is definitely the future in this space I think!

Great name, too!

autotab

Very cool!

I was already calling my up-and-coming BrowserBox SaaS Cloudtabs so there's .... "synergies" hahaha! :)

https://github.com/BrowserBox/BrowserBox

Re: Show HN: Autotab – An AI-powered Chrome extension to create Selenium scripts

#95

Post by taneq »

Amusingly I've just started playing with llama.cpp, and the first successful test (after some issues with AVX instructions on my test VM) was getting Vicuna 30b to complete "The result of your test is":

> "The result of your test is: You should not use Selenium WebDriver for testing web applications. Other automated testing tools such as Cucumber, RSpec or Jest may be more suitable for your needs. [end of text]

Seemed a little mean. :P

Re: Show HN: Autotab – An AI-powered Chrome extension to create Selenium scripts

#96

Post by eddtries »

jonasnelle wrote: post #25
hugs wrote: post #7

Selenium project creator here... Very cool! I totally expect testing to be one of the killer apps for AI. And this is an easy way to get there. How do you ensure the AI isn't hallucinating any details in the generated code?

That's awesome! We couldn't have built any of this without Selenium, definitely standing on the shoulders of giants :) Right now we have the basic sanity check that the Selenium xpath selects exactly one element in the DOM. Going forward I think the best way to do this is to have a live preview where you can see the mirrored browser copy your last action and debug if it errors or isn't what you wanted.

Can you have a feedback loop, for example trying the test in the background (headless) and if it doesn't work altering paths and retrying?

Re: Show HN: Autotab – An AI-powered Chrome extension to create Selenium scripts

#97

Post by eddtries »

jonasnelle wrote: post #60
derac wrote: post #50

I'd love if it could output Playwright code as well. I haven't tried it but if this works well it's a great concept!

Good to know! The comments have definitely made us update towards looking into Playwright again quite seriously

Playwright is definitely the industry standard testing tool for those who are likely to be interested in Autotab too - I'm a test engineer and the last time I used Selenium was probably 2017. Playwright is everywhere that's comfortable using AI-tooling!

Re: Show HN: Autotab – An AI-powered Chrome extension to create Selenium scripts

#99

Post by jonasnelle »

eddtries wrote: post #96
jonasnelle wrote: post #25

Earlier quoted context omitted.

That's awesome! We couldn't have built any of this without Selenium, definitely standing on the shoulders of giants :) Right now we have the basic sanity check that the Selenium xpath selects exactly one element in the DOM. Going forward I think the best way to do this is to have a live preview where you can see the mirrored browser copy your last action and debug if it errors or isn't what you wanted.

Can you have a feedback loop, for example trying the test in the background (headless) and if it doesn't work altering paths and retrying?

Yes! Two things we’re working on that would be very cool are 1) seeing the mirrored actions executed live as you record and 2) even if the website changes later, using AI at runtime to auto-heal the automation.

Re: Show HN: Autotab – An AI-powered Chrome extension to create Selenium scripts

#100

Post by jonasnelle »

keepamovin wrote: post #94

This is very cool! I want to host this on a server and deliver it using BrowserBox so you can build automations on mobile. This was what I originally created BrowserBox for--a delivery platform for web scraping authoring tools so you're not limited by extensions--but got into building the remote browser as a product, and haven't got around to the automation authoring tool yet, haha! Thank you for creating this, and m…

Thanks! Excited to see what you do with it

BrowserBox looks cool, I couldn’t tell from the README what browser engine it uses. Did you build your own?

Post reply on HN