Live data from Hacker News

Things You Should Know About AWS

highscalability.com

21–30 of 51 posts

Re: Things You Should Know About AWS

#21

Description of noisy neighbor problem #6 lacks some depth. AWS noisy neighbors problem is very often misunderstood. CPU steal time under linux does NOT mean that somebody is stealing your CPU. It simply means that you wanted to use CPU and hypervisor has given it to another instance. This may happen because you have exceeded your quota or scheduling algorithm selected another pending instance at this very moment and…

Why does this happen even when the instance isn't using all of its CPU?

Re: Things You Should Know About AWS

#22
An important gotcha regarding Cloudformation - there is no way to recover from a failed rollback (except maybe to contact amazon support). So it's basically only safe for initial setup of resources.

Re: Things You Should Know About AWS

#23

Description of noisy neighbor problem #6 lacks some depth. AWS noisy neighbors problem is very often misunderstood. CPU steal time under linux does NOT mean that somebody is stealing your CPU. It simply means that you wanted to use CPU and hypervisor has given it to another instance. This may happen because you have exceeded your quota or scheduling algorithm selected another pending instance at this very moment and…

Why does this happen even when the instance isn't using all of its CPU?

>Why does this happen even when the instance isn't using all of its CPU?

Probably hypervisor does not assign CPU every time it is requested but it still manages to assign as much as needed because in the end there is some idle time left.

Re: Things You Should Know About AWS

#24

Description of noisy neighbor problem #6 lacks some depth. AWS noisy neighbors problem is very often misunderstood. CPU steal time under linux does NOT mean that somebody is stealing your CPU. It simply means that you wanted to use CPU and hypervisor has given it to another instance. This may happen because you have exceeded your quota or scheduling algorithm selected another pending instance at this very moment and…

Why does this happen even when the instance isn't using all of its CPU?

If you're sharing a CPU with a neighbour and you're using 3% and the neighbour is at 100%, the hypervisor needs to somehow squash that 103% into the 100% it has available - which means you lose a little bit of the scheduled time slots that otherwise would have been yours. If your neighbour drops down to 50%, there's now enough CPU time to handle both of you, so there's no 'steal'.

Re: Things You Should Know About AWS

#25
post #4

This is great and all, but I'd love to see a community wiki / discussion area for AWS tips, tricks, and gotchas. Something like Quora crossed with Wikipedia, just for AWS. Is anyone aware of such a thing? If not, any advice for starting one?

This would be great. I actually was searching for something like this only a week or so ago.

In my current role I have been doing a lot with Elastic Beanstalk. Many cool features are non obvious and/or not clearly documented. Especially in the case of extending its functionality with various hacks and recipes.

By now I have a fair accumulation of notes on this stuff, would happily pour this into a wiki.

Re: Things You Should Know About AWS

#26
post #10
post #8

Earlier quoted context omitted.

That's the AWS CLI (Command Line Interface), available at http://aws.amazon.com/cli/ .

Is there a huge difference with s3cmd?

It's more of a swiss army knife. It's also still pretty new - the aws documentation misses out on some things for it (like autoscaling) and it's still in development to some degree, but it means you have to remember one command with one auth, instead of a handful (s3cmd, boto, others I can't recall)

Re: Things You Should Know About AWS

#27

Does anyone understand the point they are making in #9 about VPC? Are they suggesting using HAProxy in your public subnet and ELBs in your private subnets? Is this their reference to avoiding using a NAT box (actually PAT)? Don't you still need a HAProxy box in each of your AZs?

I'm not sure, but I read it as ELB over your HAProxy instances (for high availability), and use HAProxy to do the intelligent load balancing (which would solve the "sticky" argument put forth by the author).

Re: Things You Should Know About AWS

#28
post #22

An important gotcha regarding Cloudformation - there is no way to recover from a failed rollback (except maybe to contact amazon support). So it's basically only safe for initial setup of resources.

Failed rollbacks are definitely an exception, not a norm, and something support should know about!

Re: Things You Should Know About AWS

#29

> Stripe your RDS disks for better performance This is a fun hack to perform, but it opens you up to another problem: latency on any of the striped EBS volumes will lag out the entire striped array. Attempts to mitigate this problem (including setting up raid 10) work in the short term, but it really is easier to just purchase a guaranteed iops volume if you want to run a database on EC2.

RDS is the hosted sql database solution.

When RDS stripes your disks (I have seen it start when I jumped from 100GB to 300GB) you benefit from faster IOPS (I have seen 700 IOPS improve to 2500 IOPS.

PIOPS (Provisioned IOPS) is the way to go in the long run though.

Re: Things You Should Know About AWS

#30
post #26
post #10

Earlier quoted context omitted.

Is there a huge difference with s3cmd?

It's more of a swiss army knife. It's also still pretty new - the aws documentation misses out on some things for it (like autoscaling) and it's still in development to some degree, but it means you have to remember one command with one auth, instead of a handful (s3cmd, boto, others I can't recall)

awscli depends on boto-core actually, so in some sense awscli is a fork of boto.
Post reply on HN