Live data from Hacker News

Switching to AWS Graviton slashed our infrastructure bill

squeaky.ai

81–90 of 140 posts

Re: Switching to AWS Graviton slashed our infrastructure bill

#81
post #29

I have two comments. AWS Graviton is interesting because it is pretty different machine to their AMD and Intel offerings. A "16 vCPU" machine from AWS is 8 cores/16 threads, not 16 cores - except for Graviton, which actually has 16 cores, although much weaker ones. So for problems where you the cores can actually work in parallel, Graviton can keep up with AMD and Intel, while being somewhat cheaper. In single-thread…

ECS is so much simpler to use and understand than Kubernetes, even on EKS.

But as for CodeDeploy... IMHO the only reason to use it is "I don't want to deal with another vendor" due to procurement/compliance hell in large companies.

Re: Switching to AWS Graviton slashed our infrastructure bill

#82
post #49

Earlier quoted context omitted.

Everything, all at once. SMEs can't reliably manage that transition with any skillset and still deliver a product at the same time.

I’m very curious to hear more details! Did you use reservations to reduce costs? Was it a lift and shift with VM configs staying as-is? (I’ve seen a lot of empty 1TB “app” drives burning money in the cloud!) You complain about PaaS services, but I can’t imagine 8 data centres worth of stuff being converted to PaaS in hurry!

Cost savings are mostly consolidation, scaling down stuff we don't need (we have peak hours) and migrating stuff to kubernetes and packing it tight.

Re: Switching to AWS Graviton slashed our infrastructure bill

#83
post #82

Earlier quoted context omitted.

I’m very curious to hear more details! Did you use reservations to reduce costs? Was it a lift and shift with VM configs staying as-is? (I’ve seen a lot of empty 1TB “app” drives burning money in the cloud!) You complain about PaaS services, but I can’t imagine 8 data centres worth of stuff being converted to PaaS in hurry!

Cost savings are mostly consolidation, scaling down stuff we don't need (we have peak hours) and migrating stuff to kubernetes and packing it tight.

it feels like the "refactor" was the way to improve

Re: Switching to AWS Graviton slashed our infrastructure bill

#84
post #65

Earlier quoted context omitted.

Unfortunately yes. I would rather a desktop but they don't know how to pay half as much for the same specification. The desks in the office are all equipped with docks and expensive WiFi mesh driven by COVID mentality so that is the status quo. Just send me a fucking workstation. Nope too hard.

Who wants to be in an office in 2022 unless necessary (specialized hardware, etc.)

Exactly that. I don't and I won't do it again.

Re: Switching to AWS Graviton slashed our infrastructure bill

#85
post #82

Earlier quoted context omitted.

Cost savings are mostly consolidation, scaling down stuff we don't need (we have peak hours) and migrating stuff to kubernetes and packing it tight.

it feels like the "refactor" was the way to improve

I love reading people saying this. Try a couple of thousand DB tables evolved organically. Nope not happening.

Re: Switching to AWS Graviton slashed our infrastructure bill

#86

I'm not sure I understand the point of this article : in theory they don't depend on x86 only code, so they've switched to arm and it worked, as expected, and things are cheaper. I'm happy that they've shrunk their bill, but I somehow expected some kind of 'unfortunately, things went wrong because of bizarre memory model issues causing difficult concurrency bugs'. What am I missing?

> in theory they don't depend on x86 only code, so they've switched to arm and it worked, as expected, and things are cheaper. What's Intel's response to this as a company? I know that isn't mentioned in the article but... just curious Does Intel have any ARM offering whatsoever? Does AMD have any ARM offering?

> What's Intel's response to this as a company?

They've lowered prices on their CPUs, and they have come out with so-called BIG.little designs (small eco low powered CPU cores for mundane stuff, and higher power ones for heavy lifting, in the same package with automatic switching - phones with ARM have had this for years, but it's new for x86 desktops/laptops).

Intel don't make ARM based chips, while AMD (who generally do more diverse things like special designs for consoles) have indicated they might. I'm not sure what competitive advantage they'd have, but Qualcomm need more ARM competition so anyone is welcome. The big blocker is TSMC capacity though.

Re: Switching to AWS Graviton slashed our infrastructure bill

#87
post #82

Earlier quoted context omitted.

I’m very curious to hear more details! Did you use reservations to reduce costs? Was it a lift and shift with VM configs staying as-is? (I’ve seen a lot of empty 1TB “app” drives burning money in the cloud!) You complain about PaaS services, but I can’t imagine 8 data centres worth of stuff being converted to PaaS in hurry!

Cost savings are mostly consolidation, scaling down stuff we don't need (we have peak hours) and migrating stuff to kubernetes and packing it tight.

Despite that you were paying 8x the previous amount!?

How is that possible?

E.g.: With Kubernetes and AWS you ought to be able to use clusters with a base of "reserved" capacity plus spot pricing for peak hours on top, right?

From what I've seen (in my limited experience), that should reduce costs for most orgs, not increase them!

Re: Switching to AWS Graviton slashed our infrastructure bill

#88
post #55

Earlier quoted context omitted.

> I believe using Amazon AWS already disqualifies you from being fully GDPR-compliant. AFRIK - There is nowhere in GDPR that says your data ought to reside in EU server per GDPR. However, if I understand the Shopify legality complaint it's saying "because your data is hosted by a US entity and theoretically could be accessed by the US authorities it means the US authorities are now part of the data custody and you ca…

Yeah, according to Shopify. According to a German court, a US parent company being able to access your data - which is the case both for Shopify and here - automatically disqualifies you from being GDPR-compliant: https://gdprhub.eu/index.php?title=VK_Baden-W%C3%BCrttemberg...

> which is the case both for Shopify and here - automatically disqualifies you from being GDPR-compliant:

It doesn't automatically disqualify you. No reason to spread this FUD. From your article:

> The Chamber found that, contrary to what Company A stated in their offer, it did disclose customer data to a third party. More specifically, it disclosed customer data to a third party in a third country (its parent company in the U.S.). Therefore, a transfer pursuant to Article 44 GDPR would take place. The Chamber explained that a transfer in this context must also be assumed when data can be accessed from a third country, regardless of whether this actually takes place. The fact that the physical location of the server that provided such access was located in the EU was irrelevant.

This has to do with the transfer of data from the EEA region to the US, which AWS covers: https://aws.amazon.com/compliance/gdpr-center/#GDPR_FAQs

So, no, from a blanket perspective using AWS doesn't automatically disqualify you from GDPR, but it may have implications based on how you transfer the data.

EDIT: To add, as part of Article 44 of GDPR:

> Under Article 44 GDPR, the transfer (or the onward transfer) shall only take place “subject to the other provisions of this Regulation”. As a result, data controllers or processors exporting personal data to third countries or international organisations must ensure the GDPR compliance of the overall processing activity.

So, if AWS follows GDPR compliance in the US (which as a default AWS US does) and you transfer from EU to US, then you can still achieve GDPR compliance. The reason this was thrown out: https://gdprhub.eu/index.php?title=VK_Baden-W%C3%BCrttemberg... was because the company said "that it would not disclose customer data to any third party", but when they reviewed the case they found out that because a parent company. So they are not GDPR compliant because they failed to disclose that data would transfer to AWS US, NOT that they are using AWS. This is the discrepancy. Lesson learned here - GPDR is more about process control than it is technology.

FYI - that case appears to be a public trading company that is owned by the public serving the government. It seems clear to me that they wanted to send a message of "hey just don't use any US-based company for your services to German government services, here's how we're legally going to penalize you for it". This would be like having an "American first" policy for gov't procurement and making sure TenCent's US based wholly owned entity can't do business with the US gov't.

Re: Switching to AWS Graviton slashed our infrastructure bill

#89
post #20

Earlier quoted context omitted.

I'm curious about that Rust-based message queue system

What do you want to know? It was a prototype. I was trying to learn Rust (didn't succeed), but I did manage to hack together a message queue that used HTTP for client interaction. I'd previously written a SQL database message queue in Python which worked with Postgres/MySQL and SQL server. This worked well but it was not fast enough for my liking. My goal was to build the fastest and simplest message queue server tha…

It seems very diplomatic of you to say you found Rust hard to learn, rather than that it was hard to make Rust do what you wanted. You seem very clear on what you wanted to do.

Re: Switching to AWS Graviton slashed our infrastructure bill

#90
post #82

Earlier quoted context omitted.

Cost savings are mostly consolidation, scaling down stuff we don't need (we have peak hours) and migrating stuff to kubernetes and packing it tight.

Despite that you were paying 8x the previous amount!? How is that possible? E.g.: With Kubernetes and AWS you ought to be able to use clusters with a base of "reserved" capacity plus spot pricing for peak hours on top, right? From what I've seen (in my limited experience), that should reduce costs for most orgs, not increase them!

I have identified the limits of human incompetence.

Please someone hire me so I don't have to live through this nightmare any longer.

Post reply on HN