Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Deploy your side-projects at scale for basically nothing – Google Cloud Run

alexolivier.me

Post reply on HN
Print view View original

71–80 of 397 posts

Re: Deploy your side-projects at scale for basically nothing – Google Cloud Run

#71

Post by staticassertion »

anirudhgarg wrote: post #61
all_factz wrote: post #35

What’s the advantage of GCR over AWS Fargate/ECS? I’ve been running an app on ECS for a couple months now and have been pretty happy with the ease of set-up, load-balancing, auto-scaling etc, though there are still kinks I’m figuring out (SSHing into containers to perform database management, for example, or deploying updated tasks without downtime). Is the main selling point of GCR just its price? I haven’t found EC…

I don't think you can scale up and scale down Fargate based on Http requests

I'm not sure if you can reasonably scale to 0, but I believe you can attach Autoscaling Groups to Fargate.

Re: Deploy your side-projects at scale for basically nothing – Google Cloud Run

#72

Post by spyspy »

moksly wrote: post #17

The thing I really want out of these services is the ability to set a payment cap. It’s probably never going to be an issue, but I have anxiety, and I can’t sleep easily knowing that if I fuck up, if someone sinister abuses my application or whatever I may be stuck with a giant bill.

You can deploy with a —max-instances flag to prevent infinite scaling. This has been a feature since the Cloud Run beta and has been in GAE forever.

Re: Deploy your side-projects at scale for basically nothing – Google Cloud Run

#73

Post by minimaxir »

montychain wrote: post #66
minimaxir wrote: post #38

I've been using Cloud Run for my GPT-2 text generation apps ( https://github.com/minimaxir/gpt-2-cloud-run ) in order to survive random burst, and also for small Twitter bots ( https://github.com/minimaxir/twitter-cloud-run/tree/master/h... ) which can be invoked via Cloud Scheduler to utilize the efficiency benefits. It has been successful in those tasks. The only complaint I have with Cloud Run now (after many usab…

How much do you end up paying on average for a tweet-sized generated text?

I haven't create a service for auto-generated tweets yet (just human-curated ones), but for similar service which output tweet-length text (w/ a 2GiB RAM side), it takes about 30s on a cold boot (which makes sense as it has to load the model to RAM), and ~12s to generate text after a cold boot.

From the pricing (https://cloud.google.com/run/pricing):

12 * ($0.00002400) + 12 * (2 * $0.00000250) = $0.000348 per text

...and that's assuming you go over the free tier limit.

Re: Deploy your side-projects at scale for basically nothing – Google Cloud Run

#74

Post by yegle »

fideloper wrote: post #68

There must be added cost for a managed databases or similar, right? This sounds a lot like aws lambda (except nicer thanks to just running any container). In AWS’s case, you need to pay extra for RDS, redis, and any other persistence.

Firestore is a managed database with free tier.

Re: Deploy your side-projects at scale for basically nothing – Google Cloud Run

#75

Post by akudha »

WrtCdEvrydy wrote: post #25
moksly wrote: post #17

The thing I really want out of these services is the ability to set a payment cap. It’s probably never going to be an issue, but I have anxiety, and I can’t sleep easily knowing that if I fuck up, if someone sinister abuses my application or whatever I may be stuck with a giant bill.

That's not a bug... that's a 'feature'. Interestingly, AWS will not cut you off for non-payment (we had an issue with finance and were 250k in the red by the time we got the first 'Is there any issues over there?' email)

This sounds like a short term 'thinking'. If there are a few stories on the internet (and there are some in this very thread) about developers getting burned by this 'feature', it would turn off a lot of potential users in the future. It would make sense to be transparent and give tools to strictly control usage/billing - both in terms of trust and money.

Re: Deploy your side-projects at scale for basically nothing – Google Cloud Run

#76

Post by minimaxir »

ParanoidShroom wrote: post #70
minimaxir wrote: post #38

I've been using Cloud Run for my GPT-2 text generation apps ( https://github.com/minimaxir/gpt-2-cloud-run ) in order to survive random burst, and also for small Twitter bots ( https://github.com/minimaxir/twitter-cloud-run/tree/master/h... ) which can be invoked via Cloud Scheduler to utilize the efficiency benefits. It has been successful in those tasks. The only complaint I have with Cloud Run now (after many usab…

I'm currently serving an api that uses a 500mb resnet v2 model. The bootup takes to long, so now I have a single instance that can't handle any peaks and costs too much. Doesn't your model take to long to spin up before being able to serve a request ?

Yes unfortunately, but that's the caveat of services-on-demand. I'm looking more into more efficient/cheap model deployment workflows. (it might be just running the equivalent of Cloud Run on Knative/GKE, backed by GPUs)

Re: Deploy your side-projects at scale for basically nothing – Google Cloud Run

#78

Post by rantwasp »

lallysingh wrote: post #20
remmargorp64 wrote: post #2

Of course, the downside to doing anything with a Google product is that it could be deprecated next year...

Can we standardize this standard comment? Say a URL that points to the problems we always see complaints about for using a Google service? Then someone posts that link at every Google HN post and we can all get on with our lives? They're boilerplate and don't add to the discussion.

i suggest a TLA in the title so that we all know what is going to happen. why wast a good comment on it

Re: Deploy your side-projects at scale for basically nothing – Google Cloud Run

#79

Post by anirudhgarg »

staticassertion wrote: post #71
anirudhgarg wrote: post #61

Earlier quoted context omitted.

I don't think you can scale up and scale down Fargate based on Http requests

I'm not sure if you can reasonably scale to 0, but I believe you can attach Autoscaling Groups to Fargate.

Most likely it would be based on CPU/Memory and not requests

Re: Deploy your side-projects at scale for basically nothing – Google Cloud Run

#80

Post by rantwasp »

this has already been said, but due to the fact that this is google you have no idea when it's going to get killed and most things from google get killed.

so i would suggest AWS. API Gateway + Lambda. It's basically free for side-projects and the setup + operating it is trivial. It also scales (and you're going to have to shell out real money) if you were to receive a lot of traffic.

Post reply on HN