Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Launch HN: Intuned (YC S22) – Build and run reliable browser automations as code

intunedhq.com

Post reply on HN
Print view View original

61–70 of 76 posts

Re: Launch HN: Intuned (YC S22) – Build and run reliable browser automations as code

#61

Post by tulubyev »

bobbiechen wrote: post #48
omarbish wrote: post #40

Earlier quoted context omitted.

Hi Bronco, Omar here, a Lead Platform Engineer at Intuned. > I've tried adding browser automation outside of the single click from the extension, and I'm immediately met with bot detection. Can you explain how you write your automation? How do you do the click from the extension? Do you use CDP input commands to perform the click (`Input.dispatchMouseEvent`), or do you execute JS code and click the button using `elem…

Hey Omar, do you have any plan to add support for Web Bot Auth? https://datatracker.ietf.org/wg/webbotauth/about/ While I understand that not every business wants automation on their site, I know some businesses are totally open to it. But from a technical perspective, it's very difficult to allow well-behaved browser automation while still blocking abusive bots. Web Bot Auth gives website owners / security vendors a…

[flagged]

Re: Launch HN: Intuned (YC S22) – Build and run reliable browser automations as code

#62

Post by gchamonlive »

trollbridge wrote: post #17

Biggest question I have is how this will overcome sites that implement aggressive anti-automation security. I can easily automate websites with existing tools until I slam into that wall.

I had this problem with https://gitlab.com/gabriel.chamon/yagi which is Yet Another Stalker Gamma Installer. In my region, Brazil, I get cloudflare captchas when downloading assets from moddb. Using a VPN solves this but then latency and speed goes out the window. What worked for this particular case was to use an unmodified Firefox build and interact with it indirectly with it's limited interface: launch the browser with the download URL, solve captcha once, have the automation look for the download start at the browser's sqlite db then wait for the download to finish looking at the filesystem. Anything, even marionette would trigger cloudflares anti automation, even if I was solving the captcha manually.

Re: Launch HN: Intuned (YC S22) – Build and run reliable browser automations as code

#63

Post by gvkhna »

bronco21016 wrote: post #38

Really cool! I was reading the blog post about bot detection with browsers. The first layer being the IP address of the browser. One rather unique scenario I've been trying to work out for a scraper is eliminating network latency. My use of the site is enhanced by the request from the browser having the lowest RTT latency to the webserver as possible. This means being in the same cloud provider. To do this right now…

Use the real browser: clawchrome.com. You can evaluate code on the page, do network capture, screenshot. But it’s the real browser, no fork, no cdp.

For lower RTT you’ll need an instance and proxy close to upstream but a real browser will help with scraping detection.

Re: Launch HN: Intuned (YC S22) – Build and run reliable browser automations as code

#64

Post by Hasz »

In terms of ICP, there is a wonderful underbelly of scraper/drop/deliberate automation evasion resellers for basically every consumer product niche -- think shoes, watches, anything limited-edition, etc. These people mostly are building bots and constantly in a coy cat and mouse game with the sites they buy from to avoid blocks.

Not only could this help them keep up with the new security features and redesigns, but they are more than willing to pay for a product that meaningfully improves overall success rate. You should look on twitter/discord for these kinds of groups, they are "reseller"-type communities.

Re: Launch HN: Intuned (YC S22) – Build and run reliable browser automations as code

#66

Post by fkilaiwi »

Hasz wrote: post #64

In terms of ICP, there is a wonderful underbelly of scraper/drop/deliberate automation evasion resellers for basically every consumer product niche -- think shoes, watches, anything limited-edition, etc. These people mostly are building bots and constantly in a coy cat and mouse game with the sites they buy from to avoid blocks. Not only could this help them keep up with the new security features and redesigns, but t…

thanks for the idea!

Re: Launch HN: Intuned (YC S22) – Build and run reliable browser automations as code

#68

Post by adamgoodapp »

ahmadilaiwi wrote: post #56
adamgoodapp wrote: post #55

Salam. I'm currently working on a very similar idea but through a no code UX perspective https://usetwobytwo.com . Nice to see you guys see the same issue exist.

Salam, very interesting. curious why abstracting the code? For us, exposing code gives the user way more control and visibility about what's happening with their automations.

Mainly to target both developers and non developers. I also find it easier and faster to navigate and select elements via UI than in code.

It's very early prototype but the next feature would be to export/view the created playwright code from the workflow.

Post reply on HN