AWS Olympics: Speed-Testing EC2 and S3 Across Regions

#1

Post by chookrl » Thu, Mar 21, 2013, 12:31 PM UTC

AWS Olympics: Speed-Testing EC2 and S3 Across Regions
blog.takipi.com

Re: AWS Olympics: Speed-Testing EC2 and S3 Across Regions

#2

Post by tawgx » Thu, Mar 21, 2013, 12:34 PM UTC

Thanks for putting this up. I'd be very intrested to know if anyone has ever done a similar test with Azure?

Re: AWS Olympics: Speed-Testing EC2 and S3 Across Regions

#3

Post by eran_rl75 » Thu, Mar 21, 2013, 12:43 PM UTC

Interesting!! We've tried conducting similar tests where I work a few months ago. We had to deploy a few servers and tried to figure out the optimal spread.

Re: AWS Olympics: Speed-Testing EC2 and S3 Across Regions

#4

Post by dbarlett » Thu, Mar 21, 2013, 12:58 PM UTC

For anyone interested in optimizing S3 performance, I recommend Jim Sorenson's "Building Scalable Applications on Amazon S3" from re:Invent.

http://www.slideshare.net/AmazonWebServices/building-scalabl...

http://www.youtube.com/watch?v=YYnVRYbUR6A

Re: AWS Olympics: Speed-Testing EC2 and S3 Across Regions

#5

Post by blahpro » Thu, Mar 21, 2013, 1:00 PM UTC

Interesting. It might also be useful to see latencies between regions (or even availability zones).

Re: AWS Olympics: Speed-Testing EC2 and S3 Across Regions

#6

Post by cpa » Thu, Mar 21, 2013, 1:06 PM UTC

Any idea why the results are not symmetrical? Upload from Virginia to California is twice as fast as from California to Viriginia (and it's even worse with US Japan).

Are there strategical interests to not have a symmetric link?

Re: AWS Olympics: Speed-Testing EC2 and S3 Across Regions

#7

Post by chookrl » Thu, Mar 21, 2013, 1:18 PM UTC

tawgx wrote: post #2

Thanks for putting this up. I'd be very intrested to know if anyone has ever done a similar test with Azure?

We haven't tested Azure Cloud Storage. However, we did test other cloud computing hosts such as GoGrid and Rackspace. Their upload speeds were almost the same and sometimes even better than EC2 when uploading to AWS S3. Perhaps we will test Azure in a follow-up post.

Re: AWS Olympics: Speed-Testing EC2 and S3 Across Regions

#8

Post by nachteilig » Thu, Mar 21, 2013, 1:20 PM UTC

dbarlett wrote: post #4

For anyone interested in optimizing S3 performance, I recommend Jim Sorenson's "Building Scalable Applications on Amazon S3" from re:Invent. http://www.slideshare.net/AmazonWebServices/building-scalabl... http://www.youtube.com/watch?v=YYnVRYbUR6A

His comments on hashing for S3 buckets were pretty interesting.

Re: AWS Olympics: Speed-Testing EC2 and S3 Across Regions

#9

Post by Xylakant » Thu, Mar 21, 2013, 1:24 PM UTC

cpa wrote: post #6

Any idea why the results are not symmetrical? Upload from Virginia to California is twice as fast as from California to Viriginia (and it's even worse with US Japan). Are there strategical interests to not have a symmetric link?

Maybe the link is symmetric, but the traffic flow is not - so in one direction the intertubes are more clogged.

Re: AWS Olympics: Speed-Testing EC2 and S3 Across Regions

#10

Post by datasage » Thu, Mar 21, 2013, 1:25 PM UTC

cpa wrote: post #6

Any idea why the results are not symmetrical? Upload from Virginia to California is twice as fast as from California to Viriginia (and it's even worse with US Japan). Are there strategical interests to not have a symmetric link?

Actually, the results are reverse from what you said (y-axis is the origin). It likely has to do with traffic congestion coming out of each datacenter. Virginia has by far the heaviest use out of all the datacenters.