Live data from Hacker News

Show HN: Chromeless – Headless Chrome Automation on AWS Lambda

github.com

41–50 of 92 posts

Re: Show HN: Chromeless – Headless Chrome Automation on AWS Lambda

#41
I've got the impression that lots of sites block AWS IP addresses. I wonder if this would hamper the practical use of this on Lambda.

I'm doing something similar, and this concern was one motivation for running in our datacentre vs EC2.

Does anyone have concrete info on rates of bots blocked from AWS IPs?

Re: Show HN: Chromeless – Headless Chrome Automation on AWS Lambda

#43
post #39

@schickling - When will the PDF support arrive? https://github.com/graphcool/chromeless/blob/master/docs/api...

Also interested, this would be excellent fit for a use case I have archiving certain important government websites.

Btw, does the .viewport() option not work in the demo? I'm seeing a `TypeError: Failed to fetch` when I set one.

Re: Show HN: Chromeless – Headless Chrome Automation on AWS Lambda

#44
post #23

Earlier quoted context omitted.

So basically if I had 200 automations I could run them on 200 lambdas and have them finish by the time the slowest one finishes? That pretty awesome, specially for testing. For many cases this would also fall under the free tier since it not that many requests/usage...it kinda seems too good to be true. Am I missing something?

Yep. That's one of the main reasons why we're so excited about this project!

Haven't had time to read the source yet, how are the lambda headless chrome reliability issues dealt with? Is it a different chrome build than serverless-chrome?

Re: Show HN: Chromeless – Headless Chrome Automation on AWS Lambda

#47
post #44

Earlier quoted context omitted.

Yep. That's one of the main reasons why we're so excited about this project!

Haven't had time to read the source yet, how are the lambda headless chrome reliability issues dealt with? Is it a different chrome build than serverless-chrome?

For now, we're using the workaround proposed here: https://github.com/adieuadieu/serverless-chrome/issues/41#is...

The Chromeless Proxy service uses the @serverless-chrome/lambda package as is. Same build.

Re: Show HN: Chromeless – Headless Chrome Automation on AWS Lambda

#48

The last time I tried headless Chrome, file downloads were a PITA. Has anyone tried downloads with Chromeless?

Other than taking a screenshot and evaluating JS code in the context of Chrome and returning JSON, we haven't yet implemented any file-download features. But it might be possible for us to implement something. Would you mind creating an issue here describing your use case so we can discuss it further? https://github.com/graphcool/chromeless/issues/new

By design, headless Chrome disables file downloads. This is being tracked at this issue to offer a way to enable that, and the issue seems to be moving along =) https://bugs.chromium.org/p/chromium/issues/detail?id=696481

EDIT - above is assuming downloading a file by simulating a click event to perform the download. there may be other workarounds by script injection etc to use XMLHttpRequest() for downloading a resource directly.

Re: Show HN: Chromeless – Headless Chrome Automation on AWS Lambda

#50

I've got the impression that lots of sites block AWS IP addresses. I wonder if this would hamper the practical use of this on Lambda. I'm doing something similar, and this concern was one motivation for running in our datacentre vs EC2. Does anyone have concrete info on rates of bots blocked from AWS IPs?

I assume the number one use of this would be test automation for one's own sites so blocking would not be an issue.

What are sites' motivations for blocking AWS IPs? I bet there are some reasons I would agree with even though the somewhat crude method of blocking ip range would have some unintended consequences (e.g. blocking people running a personal VPN).

Post reply on HN