Live data from Hacker News

Visualizing Meltdown on AWS

blog.appoptics.com

11–20 of 72 posts

Re: Visualizing Meltdown on AWS

#11
post #3

Anyone has more info on the performance recovery today? We experienced similar performance issues over the last few days with a seemingly complete recovery today (on a cluster of ~2500 HVM T-1s).

Very curious as to what changed today if performance increased. Some sort of smarter patch? That'd be an amazingly impressive thing to cobble together so quickly.

Re: Visualizing Meltdown on AWS

#12
post #5

My team saw a 40% CPU usage increase on all of our EC2 instances and even our RDS instances. We were shocked since the media was downplaying the performance impact. I tried to start a poll but it seems as though my team was just the unlucky one: https://news.ycombinator.com/item?id=16109036

Are your ec2 instances PV? They are known to suffer perf issues more than the other type which you can switch to.

Not sure about RDS

Re: Visualizing Meltdown on AWS

#13
That's one interesting aspect of these issues and mitigations is that performance really depends on the workload. Just because Google saw little performance impact on their servers, doesn't mean your application won't see. Or because someone said their CPU usage went up 2x doesn't mean it will go up for you.

On an unrelated note, kind of wish Meltdown had been discovered and exposed separately from Spectre. Intel has managed to weasel its way of out of taking responsibility by implying that this is not a bug and all the other CPUs have similar issues. If they had to respond to Meltdown only, it would have made it a bit harder for their PR and legal department to deny the security and performance implications.

Re: Visualizing Meltdown on AWS

#14

Pardon this likely naive question, but I haven’t seen it addressed yet in all the coverage: what’s the cost in electricity of patching this vulnerability? Does a company like amazon running a massive cloud infrastructure see a non-negligible increase in their cost of doing business?

It may impact the AWS control plane and amazon.com, but as far as AWS services go, it just means customers will be paying for more instances.

Re: Visualizing Meltdown on AWS

#15

Pardon this likely naive question, but I haven’t seen it addressed yet in all the coverage: what’s the cost in electricity of patching this vulnerability? Does a company like amazon running a massive cloud infrastructure see a non-negligible increase in their cost of doing business?

It may impact the AWS control plane and amazon.com, but as far as AWS services go, it just means customers will be paying for more instances.

But for VM, do customers pay by CPU usage or runtime? I am sure the Netflix of this world optimise their CPU usage but I also suspect the majority of VMs are mostly idle or have little traffic as their task are either intermittent or are sized for peak usage.

Re: Visualizing Meltdown on AWS

#16
"Why I like to run my own hardware for $100, Alex"

You can patch various tiers of servers at your own leisure, depending on threat levels and exposure. Measure the impact, capacity plan, etc. Rather than it being forced on you across all tiers because cloud.

Re: Visualizing Meltdown on AWS

#17

It would be nice if AWS could write something official about what they are doing. I've been noticing major performance changes in our instances and have no idea if it is related to Meltdown or something else. Google released a blog post specifically on performance: https://blog.google/topics/google-cloud/protecting-our-googl... It would be nice to have similar transparency from AWS.

Google likely only wrote a blog post about it because they were able to find a way to brag that there was effectively no performance hit. They have never written any blog posts IIRC explaining bad/unpredictable performance on GCE

Re: Visualizing Meltdown on AWS

#18
post #15

Earlier quoted context omitted.

It may impact the AWS control plane and amazon.com, but as far as AWS services go, it just means customers will be paying for more instances.

But for VM, do customers pay by CPU usage or runtime? I am sure the Netflix of this world optimise their CPU usage but I also suspect the majority of VMs are mostly idle or have little traffic as their task are either intermittent or are sized for peak usage.

Not on AWS but as far as I can tell from their pricing estimator[1], for 24/7 instances you pay based on time running, not cpu usage.

Can see the appeal of AWS for scaling, redundancy, cross region availability, etc., but for long lived services it seems you pay a high price compared to services like Digital Ocean where the per VM cost is significantly lower.

[1] https://calculator.s3.amazonaws.com/index.html

Re: Visualizing Meltdown on AWS

#19
post #16

"Why I like to run my own hardware for $100, Alex" You can patch various tiers of servers at your own leisure, depending on threat levels and exposure. Measure the impact, capacity plan, etc. Rather than it being forced on you across all tiers because cloud.

You forgot to type 5 or 6 zeros there.

Re: Visualizing Meltdown on AWS

#20
post #5

My team saw a 40% CPU usage increase on all of our EC2 instances and even our RDS instances. We were shocked since the media was downplaying the performance impact. I tried to start a poll but it seems as though my team was just the unlucky one: https://news.ycombinator.com/item?id=16109036

Hi,

How are you trying to measure the performance impact? Are you checking the cloudwatch data or running any specific test?

I am interested to assess the baseline statistics (unpatched so far) and after patching. Any suggestions?

Post reply on HN