I've been looking for a service like this for a while now. The only problem I'm seeing with regards to my use case is I need powerful GPUs for NLP inference to also scale up and down to demand. Can someone explain if this is possible with GCR and if so what do i need to do to accomplish it?
Deploy your side-projects at scale for basically nothing – Google Cloud Run
221–230 of 397 posts
Re: Deploy your side-projects at scale for basically nothing – Google Cloud Run
#222Earlier quoted context omitted.
https://scaleway.com prices their base compute very cheap [0]. They have got DCs in AMS and CDG, but unfortunately, I've not got to use them since their DCs are a bit far from customers. [0] €2.99 for 2vCPU, 2GB RAM, 200Mbits/s bandwidth.
75GB object storage free??? Am I reading this correctly or am I stupid?
Outgoing traffic counts as well. So for example 5 GB storage + 70 GB outgoing traffic and then you start paying.
See section "Traffic" on https://www.scaleway.com/en/object-storage/
Re: Deploy your side-projects at scale for basically nothing – Google Cloud Run
#223I've been looking for a service like this for a while now. The only problem I'm seeing with regards to my use case is I need powerful GPUs for NLP inference to also scale up and down to demand. Can someone explain if this is possible with GCR and if so what do i need to do to accomplish it?
There are Cloud GPUs: https://cloud.google.com/gpu/
but more generally, there's a whole AI platform: https://cloud.google.com/ai-platform/
Re: Deploy your side-projects at scale for basically nothing – Google Cloud Run
#224Re: Deploy your side-projects at scale for basically nothing – Google Cloud Run
#225Earlier quoted context omitted.
> When will everyone understand that google cloud (money earning product) is different to all the other free products When Google demonstrates it. They've already discontinued various parts of their cloud product. True, they are unlikely to shut down gmail, search, or Android. On the other hand google's cloud is a money loser that has slipped to a distant #4 in the cloud rankings. But like many of Google's revenue-ge…
Do you have examples of discontinued Google Cloud Platform products?
You don't need to ask me: Google provides their own handy list of examples (some like messaging API show up under other names like XMPP; others don't appear on this list because they were marketed differently, e.g. Google Print):
Re: Deploy your side-projects at scale for basically nothing – Google Cloud Run
#226This is exactly the service that Azure needs and doesn't seem to have: while there is a consumption plan for functions, that's about it, and App Service is incredibly expensive for what you get.
As @GordonS mentions, Azure Container Instances is about as close as you’ll get with Azure, but it’s only close on ease-of-use: rather different from a deployment/scaling characteristics POV.
I’m generally very underwhelmed by Azure offerings, but ACI is one of the few that actually lives up to what is advertised.
Re: Deploy your side-projects at scale for basically nothing – Google Cloud Run
#227I wont use this for the simple reason that I bought into the Google Appengine stack in the past and it really bit me for several reasons: They force-upgraded the java version. The problem was their their own libraries didn’t work with the new version and we had to rewrite a ton of code. It ended up being insanely expensive at scale. We were totally locked-in to their system and the way it did things. This would be fi…
These products remind me of that one colleague who doesn't understand why people don't like them. Uh, you've systematically fucked them over for years without even realizing it, and when you get caught you never even apologize, thats why they don't like you.
It’s a good point. A reputation is really hard to build up, but easily torn down in an instant.
Certain early decisions are still biting GCP.
Re: Deploy your side-projects at scale for basically nothing – Google Cloud Run
#228Earlier quoted context omitted.
Yes they do. If you want to bypass these rules, just make a ton of accounts and wait for a couple months and the use those accounts with whatever credit card you have (keep in mind that you should get another card from your bank because google can tell when your card is a generated one like privacy.com)
Won’t they just correlate the name and address on your different credit cards?
I don't recall ever giving my real name/address for any billing address/name, because most if not all the time, they don't really care (or at least I never seen a difference).
Re: Deploy your side-projects at scale for basically nothing – Google Cloud Run
#229Earlier quoted context omitted.
Cloud hosting is great for businesses, that's why I believe that every web developer should experiment with those services. It's not great for personal use for the reasons you've stated - the risk of your service going down due to it being viral is much easier to bear than the risk of having to pay outrageous amounts of money for those services in that event. If your hobby project goes down for a while nobody will re…
Years ago I ran a side project that went viral. It grew to 60k visitors a day and my monthly cloud expenses were around $1,500. I cannot fathom a scenario where you get a surprise $100k bill from a viral hit. Anytime my project went down due to scaling, it was painful. You don’t get many chances at going viral.
$1500/month is a massive cost for a side project, I'd rather have it go offline by far.
Re: Deploy your side-projects at scale for basically nothing – Google Cloud Run
#230Earlier quoted context omitted.
AWS has Aurora Serverless ( https://aws.amazon.com/rds/aurora/serverless/ ) for that purpose with MySQL and Postgres compatible engines. But I haven't heard anyone using it for side projects yet.
They also have RDS Proxy ( https://aws.amazon.com/rds/proxy/ ) that lets you pool connections from tons of lambda instances in order not to overwhelm your DB when scaling up.
I wonder where the threshold is that the proxy is beneficial. MySQL is actually really good at handling new connections.