81% of IT teams directed to reduce or halt cloud spending • Hacker News Board

Re: 81% of IT teams directed to reduce or halt cloud spending

#231

Post by ahmedtd » Fri, Oct 21, 2022, 7:24 PM UTC

raffraffraff wrote: post #130

sofixa wrote: post #92

Earlier quoted context omitted.

More and more companies (newer ones of course, those unburned by legacy) use public clouds as "managed Kubernetes and maybe a few other things like a database, load balancer, object storage". That way there is close to no lock-in, so the biggest challenge in switching clouds would be how to migrate the data and do the failover with minimal downtime.

It may be easier, but still take a lot of work to migrate. Perhaps k8s + object store + LB is easier for the developer, who has a few AWS APIs to replace, but is otherwise not affected. But talk to the person who has to rewrite 5k+ lines of terraform, figure out users, roles & policies in a new IAM, aunderstands the differences between EKS and GKE (what's the Google equivalent for IRSA?). None of it is rocket science…

Not really the point of your comment, but...

The GKE equivalent of EKS IRSA is GKE Workload Identity.

It's pretty much the same user experience:

* Enable Workload Identity on your cluster

* Create a GCP service account

* Grant your Kubernetes service account permission to act as the GCP service account.

It's a bit more seamless because you don't need to upgrade your client libraries. Instead there is an on-node metadata server that provides access tokens to workloads.

Disclosure: I work on this

Re: 81% of IT teams directed to reduce or halt cloud spending

#232

Post by deathanatos » Fri, Oct 21, 2022, 9:55 PM UTC

victorNicollet wrote: post #146

deathanatos wrote: post #23

How many would say this normally? I.e., what's the baseline? Meanwhile, how many are giving their teams the resources (i.e., people) necessary to do the analytics on the bill required to find & cut costs? Every cloud I've worked with has been terrible at billing in a way that could be reasonable investigated. At one point we literally pulled all the billing data into a SQLite database. (And that was a great idea, as…

Hey, we've had our blob storage costs spike up +70% for two days (Oct 4th and Oct 5th), across almost all of our storage accounts, regions and hot/cold/archive tiers. The spike is a consistent ~70% for each of the affected accounts, and this includes accounts where there have been no writes for months (so why is there an increase), as well as accounts where we never delete (so while an increase would be surprising, t…

Incredible. You've nailed both the amount (the +70%)¹ and the days (yep, Oct 4th & 5th).

You are also right that it is across storage accounts, and access tiers: I've now looked at some of our other SAs, including ones in the Hot tier, and yep, they see the same bizarre uptick. Given that Hot tier is experiencing it, that rules out the possibility of "human error" w.r.t. to it not being a Cool-tier early deletion.

> Is this similar to what you're seeing ?

You've nailed it precisely; it sounds exactly like what we're seeing.

(What a small world HN is sometimes!)

¹the numbers on our end wiggle a bit, so I'm not sure about how precise I can estimate the uptick. But 70% is as close as any guess.

Re: 81% of IT teams directed to reduce or halt cloud spending

#233

Post by raffraffraff » Sat, Oct 22, 2022, 6:56 AM UTC

ahmedtd wrote: post #231

raffraffraff wrote: post #130

Earlier quoted context omitted.

It may be easier, but still take a lot of work to migrate. Perhaps k8s + object store + LB is easier for the developer, who has a few AWS APIs to replace, but is otherwise not affected. But talk to the person who has to rewrite 5k+ lines of terraform, figure out users, roles & policies in a new IAM, aunderstands the differences between EKS and GKE (what's the Google equivalent for IRSA?). None of it is rocket science…

Not really the point of your comment, but... The GKE equivalent of EKS IRSA is GKE Workload Identity. It's pretty much the same user experience: * Enable Workload Identity on your cluster * Create a GCP service account * Grant your Kubernetes service account permission to act as the GCP service account. It's a bit more seamless because you don't need to upgrade your client libraries. Instead there is an on-node metad…

Thanks. I may have to work on this pretty soon!

Re: 81% of IT teams directed to reduce or halt cloud spending

#234

Post by eb0la » Mon, Oct 24, 2022, 12:18 PM UTC

ethbr0 wrote: post #169

eb0la wrote: post #148

Earlier quoted context omitted.

IMHO Reservations in AWS are good if you have a US Bank Account. Why? Because there is a secondary market (run by AWS) where you can buy and sell reservations. If you have a 1-year project that will have a 1-year extension, then get a 3-year reservation (with some amount upfront) that you can sell. Your second best option is a Savings Plan.

Neat! Is this via third party services or Amazon itself? Curious about details on the retrade market.

Amazon does the reselling and through their web interface.

Re: 81% of IT teams directed to reduce or halt cloud spending

#235

Post by itsdrewmiller » Wed, Oct 26, 2022, 3:59 AM UTC

deathanatos wrote: post #232

victorNicollet wrote: post #146

Earlier quoted context omitted.

Hey, we've had our blob storage costs spike up +70% for two days (Oct 4th and Oct 5th), across almost all of our storage accounts, regions and hot/cold/archive tiers. The spike is a consistent ~70% for each of the affected accounts, and this includes accounts where there have been no writes for months (so why is there an increase), as well as accounts where we never delete (so while an increase would be surprising, t…

Incredible. You've nailed both the amount (the +70%)¹ and the days (yep, Oct 4th & 5th). You are also right that it is across storage accounts, and access tiers: I've now looked at some of our other SAs, including ones in the Hot tier, and yep, they see the same bizarre uptick. Given that Hot tier is experiencing it, that rules out the possibility of "human error" w.r.t. to it not being a Cool-tier early deletion. >…

This comment inspired me to check our storage spend and we also have a very unusual spike in storage cost on Oct 4th and 5th. More like 40% increase than 70% though, hot tier.