AWS Olympics: Speed-Testing EC2 and S3 Across Regions • Hacker News Board

Re: AWS Olympics: Speed-Testing EC2 and S3 Across Regions

#11

Post by datasage » Thu, Mar 21, 2013, 1:30 PM UTC

Australia is has low bandwidth to the rest of the world largely due its geography and capacity/path of the undersea cables connecting the country.

Geographically its relatively close to Singapore (compared to other data centers anyway), all of the cables from the eastern side of the country either go up to Japan via Guam or go to the US via Hawaii. Its not uncommon to see a route from Sydney to Singapore go through the US, and/or Japan before reaching Singapore.

Re: AWS Olympics: Speed-Testing EC2 and S3 Across Regions

#12

Post by toki5 » Thu, Mar 21, 2013, 2:05 PM UTC

You know, I know it's 2013 and all, and things like this shouldn't amaze me, but the fact that you can get data from Australia to Brazil in _minutes_ is still kind of astounding to me.

Re: AWS Olympics: Speed-Testing EC2 and S3 Across Regions

#13

Post by res0nat0r » Thu, Mar 21, 2013, 2:06 PM UTC

nachteilig wrote: post #8

dbarlett wrote: post #4

For anyone interested in optimizing S3 performance, I recommend Jim Sorenson's "Building Scalable Applications on Amazon S3" from re:Invent. http://www.slideshare.net/AmazonWebServices/building-scalabl... http://www.youtube.com/watch?v=YYnVRYbUR6A

His comments on hashing for S3 buckets were pretty interesting.

Here's a very informative blog post by Doug Grismore that talks more about this if you are interested: http://aws.typepad.com/aws/2012/03/amazon-s3-performance-tip...

Re: AWS Olympics: Speed-Testing EC2 and S3 Across Regions

#14

Post by oscarwao » Thu, Mar 21, 2013, 2:32 PM UTC

Keep in mind that the S3 Virgnia location (known as US Standard Regionin AWS terms) includes endpoints in Virginia and in the Pacific Northwest. Hence that may be why the Virginia to Virginia numbers were high compared to the other regions.

"The US Standard Region automatically routes requests to facilities in Northern Virginia or the Pacific Northwest using network maps." http://aws.amazon.com/s3/

Re: AWS Olympics: Speed-Testing EC2 and S3 Across Regions

#15

Post by jedberg » Thu, Mar 21, 2013, 5:04 PM UTC

oscarwao wrote: post #14

Keep in mind that the S3 Virgnia location (known as US Standard Regionin AWS terms) includes endpoints in Virginia and in the Pacific Northwest. Hence that may be why the Virginia to Virginia numbers were high compared to the other regions. "The US Standard Region automatically routes requests to facilities in Northern Virginia or the Pacific Northwest using network maps." http://aws.amazon.com/s3/

If that's the cause of slowness then their network maps are broken.

Re: AWS Olympics: Speed-Testing EC2 and S3 Across Regions

#16

Post by donavanm » Thu, Mar 21, 2013, 6:41 PM UTC

oscarwao wrote: post #14

Keep in mind that the S3 Virgnia location (known as US Standard Regionin AWS terms) includes endpoints in Virginia and in the Pacific Northwest. Hence that may be why the Virginia to Virginia numbers were high compared to the other regions. "The US Standard Region automatically routes requests to facilities in Northern Virginia or the Pacific Northwest using network maps." http://aws.amazon.com/s3/

The us-east and SEA end points for US Standard buckets are directly addressable as well. Consistency will be tighter if you PUT and GET to the same endpoint.

Edit: that's be s3-external-1.amazonaws.com for us-east and s3-external-2.amazonaws.com for the PNW. See https://forums.aws.amazon.com/message.jspa?messageID=185820