Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Data API for Amazon Aurora Serverless

aws.amazon.com

Post reply on HN
Print view View original

11–20 of 23 posts

Re: Data API for Amazon Aurora Serverless

#11

Post by keysmasher »

cavisne wrote: post #5

Another cool thing about this is it avoids the connection pool issue with Lambda (where concurrent requests cant reuse connections). Aurora is already pretty good at handling a lot of connections but this is even better.

Not really, it was solved without this API given aurora serverless would manage connections and scaling automatically (https://docs.aws.amazon.com/AmazonRDS/latest/AuroraUserGuide...).

But the real problem was connection time was unusable for any client facing application. I tried it after it was released (not preview). I really doubt this API would respond any faster.

Re: Data API for Amazon Aurora Serverless

#12

Post by keysmasher »

reilly3000 wrote: post #7
tienshiao wrote: post #6

The beta version seemed like it had pretty poor performance: https://www.jeremydaly.com/aurora-serverless-data-api-a-firs... Does anyone have performance feedback now that it is no longer beta?

I'm definitely excited about this, especially after paying $36/month for a NAT that I barely used for a long, long time, and spending too many hours configuring it for my Lambdas. That said, I don't know how Jeremy Daly got away with making that post, per AWS preview terms. They are pretty explicit about not posting benchmarks on their preview products, and that makes sense as the API is not stable at all. Still, I'm…

Wait if I read that doc correctly, does it seem to suggest that connections will be closed when the function goes cold. So the locked up connections where lambda dies without disconnecting isn’t a problem google functions?

Think of a spike in traffic, 100 functions connect one connection per function. Then a break 80 of them go cold. Your max connections is 100, so if 80 didn’t disconnect and are waiting to timeout you are stuck. Any more functions coming online won’t have any connections.

The only work around in AWS was to setup an external connection pool, kind of begins to kill the serverless savings and all.

Re: Data API for Amazon Aurora Serverless

#13

Post by etaioinshrdlu »

I told my AWS account manager today that this is what I wanted to see on Aurora Serverless:

- mysql 5.7 compatibility

- acting as replication master or slave

- faster upscaling, more likes 5s instead of 30s

- publicly accessible over internet (the rest of RDS has this)

- aurora parallel query built in

- aurora multi master built in

Basically, I asked for one product to merge all their interesting features. That sounds nice and like a one-size-fits all database. I would very much like to use it in production. It would require very little maintenance.

Re: Data API for Amazon Aurora Serverless

#14

Post by blaisio »

... Don't you have to establish an HTTPS connection to use this API? Is that really easier than using the existing MySQL protocol? Or is it really so horrible that HTTPS is faster?

Things establishing new connections will never be as fast as things reusing existing connections. It seems wasteful to ignore this.

Re: Data API for Amazon Aurora Serverless

#15

Post by smt88 »

blaisio wrote: post #14

... Don't you have to establish an HTTPS connection to use this API? Is that really easier than using the existing MySQL protocol? Or is it really so horrible that HTTPS is faster? Things establishing new connections will never be as fast as things reusing existing connections. It seems wasteful to ignore this.

This appears to be targeted at Lambda function, which can't reuse existing connections between executions.

Also, establishing an HTTP connection is much faster than establishing a typical database connection, in my experience. I don't know why that is.

Re: Data API for Amazon Aurora Serverless

#16

Post by tybit »

blaisio wrote: post #14

... Don't you have to establish an HTTPS connection to use this API? Is that really easier than using the existing MySQL protocol? Or is it really so horrible that HTTPS is faster? Things establishing new connections will never be as fast as things reusing existing connections. It seems wasteful to ignore this.

Unlike a properly configured RDS cluster, this is available outside of your VPC on the open internet.

That’s the main selling point to me, though the connection pooling of MYSQL connections by the HTTPS proxy is also nice too.

Re: Data API for Amazon Aurora Serverless

#17

Post by joemag »

blaisio wrote: post #14

... Don't you have to establish an HTTPS connection to use this API? Is that really easier than using the existing MySQL protocol? Or is it really so horrible that HTTPS is faster? Things establishing new connections will never be as fast as things reusing existing connections. It seems wasteful to ignore this.

Unless I’m misunderstanding the question, many http clients would pool http(s) connections. Most of them do that by default. So connection establishment cost gets amortized over large number of API calls.

Re: Data API for Amazon Aurora Serverless

#18

Post by coderecipe »

With this, VPC is no longer needed from lambda call to RDS, and this means that cold start time will be lowered from seconds to milliseconds. I made a ready to use recipe (source code+deployment script+demo included) here https://coderecipe.ai/architectures/77374273 hopefully this help others to easily onboard to this new API.

Re: Data API for Amazon Aurora Serverless

#19

Post by coderecipe »

hn_throwaway_99 wrote: post #2

I wonder what effect this may have for AWS Lambdas connecting to a DB for synchronous calls (e.g. through API gateway). The biggest issue with Lambdas IMO is the cold start time. If your Lambda is in a VPC the cold start time is around 8-10 seconds , and if you have decent security practices your database will be in a VPC. I know AWS said they would be working on improving Lambda VPC cold start times, but would like…

Feel free to take a look at my code sample here with this new Data API on Aurora Serverless https://coderecipe.ai/architectures/77374273, demo and source code included. It removes the need of a vpc and it works like a charm

Re: Data API for Amazon Aurora Serverless

#20

Post by djhworld »

cavisne wrote: post #5

Another cool thing about this is it avoids the connection pool issue with Lambda (where concurrent requests cant reuse connections). Aurora is already pretty good at handling a lot of connections but this is even better.

You can create a connection pool in a static context that lives throughout the lifetime of the JVM.

Although admittedly if Lambda scales to multiple JVMs as request rate increases, you'll have multiple pools. Or if your request rate is low you'll not get much benefit

Post reply on HN