AWS Lambda now supports up to 10 GB Ephemeral Storage

#1

Post by sologuardsman2 » Thu, Mar 24, 2022, 9:03 PM UTC

AWS Lambda now supports up to 10 GB Ephemeral Storage
aws.amazon.com

Re: AWS Lambda now supports up to 10 GB Ephemeral Storage

#2

Post by DevKoala » Thu, Mar 24, 2022, 10:22 PM UTC

I remember when I was breaking my head against the wall to fit puppeteer inside a lambda. Good times.

Re: AWS Lambda now supports up to 10 GB Ephemeral Storage

#3

Post by nunez » Fri, Mar 25, 2022, 3:21 AM UTC

this is fantastic for anyone wanting to run Chrome inside of Lambda (one of the biggest challenges is getting Chrome to fit)

Re: AWS Lambda now supports up to 10 GB Ephemeral Storage

#4

Post by matt-attack » Fri, Mar 25, 2022, 6:20 AM UTC

nunez wrote: post #3

this is fantastic for anyone wanting to run Chrome inside of Lambda (one of the biggest challenges is getting Chrome to fit)

What's the use case? I see a sibling commenter mentioned puppeteer which I'm aware is essentially Chrome. Are you too referring to running puppeteer in Lambda? If so, what is the purpose?

Re: AWS Lambda now supports up to 10 GB Ephemeral Storage

#5

Post by mulhoon » Fri, Mar 25, 2022, 7:34 AM UTC

matt-attack wrote: post #4

nunez wrote: post #3

this is fantastic for anyone wanting to run Chrome inside of Lambda (one of the biggest challenges is getting Chrome to fit)

What's the use case? I see a sibling commenter mentioned puppeteer which I'm aware is essentially Chrome. Are you too referring to running puppeteer in Lambda? If so, what is the purpose?

Puppeteer-core can already fit in a lambda around 60mb and can be used for web scraping, taking screenshots, or performance testing.

Re: AWS Lambda now supports up to 10 GB Ephemeral Storage

#6

Post by unixhero » Fri, Mar 25, 2022, 7:50 AM UTC

matt-attack wrote: post #4

nunez wrote: post #3

this is fantastic for anyone wanting to run Chrome inside of Lambda (one of the biggest challenges is getting Chrome to fit)

What's the use case? I see a sibling commenter mentioned puppeteer which I'm aware is essentially Chrome. Are you too referring to running puppeteer in Lambda? If so, what is the purpose?

Chrome headless

Re: AWS Lambda now supports up to 10 GB Ephemeral Storage

#7

Post by atonse » Fri, Mar 25, 2022, 11:58 AM UTC

mulhoon wrote: post #5

matt-attack wrote: post #4

Earlier quoted context omitted.

What's the use case? I see a sibling commenter mentioned puppeteer which I'm aware is essentially Chrome. Are you too referring to running puppeteer in Lambda? If so, what is the purpose?

Puppeteer-core can already fit in a lambda around 60mb and can be used for web scraping, taking screenshots, or performance testing.

How’s the overhead? Are you launching full chrome every lambda invocation?

Re: AWS Lambda now supports up to 10 GB Ephemeral Storage

#8

Post by bl4ckm0r3 » Fri, Mar 25, 2022, 1:16 PM UTC

matt-attack wrote: post #4

nunez wrote: post #3

this is fantastic for anyone wanting to run Chrome inside of Lambda (one of the biggest challenges is getting Chrome to fit)

What's the use case? I see a sibling commenter mentioned puppeteer which I'm aware is essentially Chrome. Are you too referring to running puppeteer in Lambda? If so, what is the purpose?

scalable pdf rendering

Re: AWS Lambda now supports up to 10 GB Ephemeral Storage

#9

Post by mulhoon » Fri, Mar 25, 2022, 1:20 PM UTC

atonse wrote: post #7

mulhoon wrote: post #5

Earlier quoted context omitted.

Puppeteer-core can already fit in a lambda around 60mb and can be used for web scraping, taking screenshots, or performance testing.

How’s the overhead? Are you launching full chrome every lambda invocation?

In one lambda I can load chrome, visit a website, take a screenshot and save it to S3 in around 2s with around 280mb memory used. You could keep chrome open and reuse it if available, but you can't count on it with lambda being stateless.

I use this Chromium binary https://www.npmjs.com/package/chrome-aws-lambda

Re: AWS Lambda now supports up to 10 GB Ephemeral Storage

#10

Post by zozbot234 » Fri, Mar 25, 2022, 1:42 PM UTC

If it's ephemeral to a function, it's not "storage". It's just core memory that may or may not be backed by physical "storage" media, and is organized as a tmpfs for the user's convenience.