Lambdas labs has run out of GPUs to rent lately. I think it’s too many people running SD.
Barely two weeks after Stable Diffusion release, we use SD as its acronym? That's fast.
Google Colab Pro is switching to compute credits
71–80 of 89 posts
Re: Google Colab Pro is switching to compute credits
#72Earlier quoted context omitted.
>Computation should be free (or nearly free) if there's idle capacity I guess nothing stops you from buying infra and offering it for "free (or nearly free)".
Agree. I just do not like restaurants which charge full price of burgers to me when there are clearly more patties on grill than customers at that time.
So you also wouldn't expect to be paid when a company has less work than it has employees during a week ?
Re: Google Colab Pro is switching to compute credits
#73Earlier quoted context omitted.
Lambda has $1.10/hr A100 instances. That's less than half the price of GCP on demand. https://lambdalabs.com/service/gpu-cloud
If I may ask, and if you use Lambda Labs cloud GCP, how do you like it? I have visited their pricing page about ten times, their price for a single A100 is very good, but I haven’t talked to any customers. Do you basically get VPS with a GPU and all the usually software installed, and SSH/Mosh into it?
Yeah I found Lambda super easy to use, especially compared to GCP etc. It took me about 5 minutes to get a model up and running. They don't support launching machines with docker images or kubernetes or anything like that though (problem if you want to run a business on it) and recently they are extremely supply constrained (only available machine type 8xA100, no A6000s or V100s).
Re: Google Colab Pro is switching to compute credits
#74Earlier quoted context omitted.
Used Google Colabs for the last 8 months, will fully divest from them with this change...
The change is meant to provide increased visibility in your paid compute consumption.
Yeah, I was looking on Google Colab Github page.
There were some issues about "Hey! I got a Pro(+) account, and I'm keeping to be limited, but I don't know how I can check how much resources I still have" kind of messages.
I think this is one of the reasons Google is switching to this model.
Re: Google Colab Pro is switching to compute credits
#75I just subscribed to Colab Pro+ hours before this announcement (－‸ლ)
I'll refund you myself if you hate it. This change will give you more transparency in your paid compute consumption, though won't land for 30 days.
Thanks for the response! I’m glad Colab is sorting out the pricing vagueness. I’m hoping that we get more detailed information about the changes before the launch so I (and my team) can better prepare. Do you know approximately when information about the new pricing tiers will be launched?
Re: Google Colab Pro is switching to compute credits
#76Earlier quoted context omitted.
I'd think anyone trying to run a business off a $10 or $49 tier is the one sucking up undue compute power.
A business wants to pay (at least) what something costs, because 1. they’re making money themselves from the result, and 2. they don’t want the thing they depend on to stop being offered. You’re not a free rider per se if you want a cost-plus pricing model but it’s just not on offer. (In that case, it’s instead the provider’s fault for not capturing your value surplus.)l similar to how, in scalping, it’s the original…
> similar to how, in scalping, it’s the original seller’s fault for not charging what the market will bear
Absolutely. Unfortunately, people hate scalpers, irrationally if you take a broad view.
Re: Google Colab Pro is switching to compute credits
#77Earlier quoted context omitted.
Agree. I just do not like restaurants which charge full price of burgers to me when there are clearly more patties on grill than customers at that time.
So you also wouldn't expect to be paid when a company has less work than it has employees during a week ?
That would be logical conclusion. I think people looking for (nearly) free collab would agree.
Re: Google Colab Pro is switching to compute credits
#78Earlier quoted context omitted.
>Computation should be free (or nearly free) if there's idle capacity I guess nothing stops you from buying infra and offering it for "free (or nearly free)".
Agree. I just do not like restaurants which charge full price of burgers to me when there are clearly more patties on grill than customers at that time.
There are stores in my area which sell, at a discount, overstock food products before they expire. It costs less stores less than simply wasting food, and people who aren't picky about what they buy are able to get quality food at a low price.
And to the employee point, overtime (and contractors) typically get paid more to fill gaps when demand exceeds supply. In some cases, when there is reduced demand, employees are offered furloughs. I recall during a recession when I was a child, my Dad spent about a month at home, but was still paid some fraction of his normal salary to stay on payroll.
Adjusting pricing to supply-and-demand isn't exactly crazy, freeloading, or communism. If co-lab were designed to generate a profit, the same type of pricing as AWS and GCP do would make sense. Since it seems designed to position Google in some position in the ML ecosystem, free makes sense.
As a footnote, I don't use co-lab. That's not because of pricing, but because in free offerings like these, I am the product. That's not always a bad deal, but it is for me for the type of work I do. I like running ML models locally (I have a pretty fancy GPU) using my employer's in-house cluster, or paying for AWS. I don't discourage others from using co-lab (that decision is specific to what I do).
I'm not sure why this discussion is so hostile, and reads so much false subtext into statements which shouldn't be controversial at all.
Re: Google Colab Pro is switching to compute credits
#79At Paperspace we've long offered an alternative to Google Colab that includes free CPU, GPU, and (recently released) IPU machines.
Free notebooks can be run for 6 hours at a time.
More info available in docs: https://docs.paperspace.com/gradient/machines/#free-machines...
Re: Google Colab Pro is switching to compute credits
#80Right when I started using it for StableDiffusion. Lovely.
Would be nice a plan tailored for AI Image Generation and leave the more powerful GPUs for heavier jobs.
Like, I don't know, 15$ per month. Still cheaper than buy a GPU VPS.