Live data from Hacker News

Amazon S3 Transfer Acceleration

aws.amazon.com

61–70 of 88 posts

Re: Amazon S3 Transfer Acceleration

#61
post #49

Did anyone else have some pretty terrible results from the speed tester? I was pretty optimistic seeing their sample screenshot - am I missing something? http://i.imgur.com/UwNBGf3.png

We have 20Gbit of Direct Connect with public peering on. This causes upload for us to be 40% slower in primary region and 2-5% slower in the other regions in the US. We only get any benefit going to APAC, granted we aren't your "typical" or "ideal" user for this

Re: Amazon S3 Transfer Acceleration

#62

Earlier quoted context omitted.

So you have 50TB of images to send me and a 10mbit internet pipe. Is it faster to FTP me the file or mail it on a hard drive?

To you and @nxzero, I'm not debating whether it's better or worse, I'm trying to find out if I'm actually understanding it right. From some of the other comments, it appears that it is just a matter of them sending you a physical disk -- it makes sense now.

Yes they mail you a fancy disk, you fill and mail back.

Re: Amazon S3 Transfer Acceleration

#63
> The name of the bucket used for Transfer Acceleration must be DNS-compliant and must not contain periods (".").

Source: http://docs.aws.amazon.com/AmazonS3/latest/dev/transfer-acce...

> The bucket names must match the names of the website that you are hosting. For example, to host your example.com website on Amazon S3, you would create a bucket named example.com.

Source: http://docs.aws.amazon.com/AmazonS3/latest/dev/website-hosti...

...

Looks like they don't want you replacing CloudFront with Amazon S3 Transfer Acceleration - which is a royal pain for some of my use cases (internal facing websites that don't need a full CDN).

Re: Amazon S3 Transfer Acceleration

#65
post #55
post #49

Did anyone else have some pretty terrible results from the speed tester? I was pretty optimistic seeing their sample screenshot - am I missing something? http://i.imgur.com/UwNBGf3.png

If it makes you feel better, the accelerated ones are slower for me! http://i.imgur.com/n6DhyHj.png

Same here, got 11%-24% slower in most regions, and only 3% faster in US-EAST-1. Sao Paulo got 60% faster, though.

Regardless of my results, I've gotta hand it to Amazon on a really kickass speed comparison page. That's a great user experience. It immediately tells me whether I should be using this or not from my particular corporate network without requiring me to waste a day or so trying it out.

Re: Amazon S3 Transfer Acceleration

#66

Earlier quoted context omitted.

Even with that, I don't get it. "Moving lots of data either requires a huge pipe, or a ton of storage disks." With that, they offer their Snowball device, which, if I'm understanding correctly, holds up to 50TB (now 80TB), which they physically ship to you, and then you ship back to them. How does this fix either of the constraints (disk space / connection pipe)?

So you have 50TB of images to send me and a 10mbit internet pipe. Is it faster to FTP me the file or mail it on a hard drive?

it's 428 days to ship 50TB of stuff on a 10Mb/s pipe. 5 days if you have 1Gb/s

This assumes you get perfect utilisation of the connection (which never happens) so i would probably round up to 450 to 500 days on a 10Mb/s pipe

Re: Amazon S3 Transfer Acceleration

#67

Does anybody have a sense of how fast uploading to S3 can get? I'm on a gigabit link here in Singapore, uploading to Singapore instance of S3 (via ARQ) - and I'm disappointed that I rarely see better than about 40 Mbits/second.

900-950 Mbps on a 1000 Mbps line, but only if you use 20 threads and multipart

Re: Amazon S3 Transfer Acceleration

#68
post #35

Earlier quoted context omitted.

You cant? PUT/POST through Cloudfront supported since October 2013. https://aws.amazon.com/about-aws/whats-new/2013/10/15/amazon... "You can use existing Amazon CloudFront distributions for upload requests by simply enabling support in the AWS management console. When end users upload content, CloudFront will send the upload request back to the origin web server (such as an Amazon S3 bucket, an Amazon EC2 instance, a…

I stand corrected, thanks for the info. Cloudfront doesn't appear to support multi-part uploads however, which I guess is the primary value-add of the newly announced service.

Can you elaborate on why you came to this conclusion? I am able to do multipart uploads via cloudfront to s3.

Re: Amazon S3 Transfer Acceleration

#70

Earlier quoted context omitted.

I'm in Singapore, uploading to Oregon, 100mb, took minutes , I changed to upload via signed cloud front requests, takes 15s to upload 100mb now...

I presume you mean 100 MB (or just plain 100 MBytes) - so, 53 megabits/second. So a little better, but nowhere near 1 gigabit (which I presume you have, it's so cheap here - not that it seems to be useful for anything other than great speedtest results)

I use homeplugs because the router and computer are in different rooms. So I only get about ~300mbit from my room. I've never actually tried from next to the router.

My point was just that I get better results using CloudFront than using S3 or Multi Upload S3.

Sharing what I can :)

Post reply on HN