Live data from Hacker News

Amazon S3 Transfer Acceleration

aws.amazon.com

31–40 of 88 posts

Re: Amazon S3 Transfer Acceleration

#32
post #6

Earlier quoted context omitted.

It depends entirely on the quantity of data. For huge datasets, Snowball will be fastest & cheapest (literally shipping data).

As they used to say, never underestimate the bandwidth of a van filled with harddrives.

Never underestimate the bandwidth of a station wagon full of tapes hurtling down the highway.

Re: Amazon S3 Transfer Acceleration

#34
post #7

"What's a Snowball?" Animated YouTube by Amazon explains: https://youtube.com/watch?v=9uc2DSZ1wL8

Even with that, I don't get it. "Moving lots of data either requires a huge pipe, or a ton of storage disks." With that, they offer their Snowball device, which, if I'm understanding correctly, holds up to 50TB (now 80TB), which they physically ship to you, and then you ship back to them. How does this fix either of the constraints (disk space / connection pipe)?

it doesn't fix the constraint about needing a ton of disks, but it solves it for you - they're loaning you a big pile of disk space to use for the transfer.

Re: Amazon S3 Transfer Acceleration

#35
post #11

Earlier quoted context omitted.

You can't upload through Cloudfront. It's a good analogy though, you can think of this feature as a "CDN for uploads", if you'll excuse the abuse of the CDN acronym.

You cant? PUT/POST through Cloudfront supported since October 2013. https://aws.amazon.com/about-aws/whats-new/2013/10/15/amazon... "You can use existing Amazon CloudFront distributions for upload requests by simply enabling support in the AWS management console. When end users upload content, CloudFront will send the upload request back to the origin web server (such as an Amazon S3 bucket, an Amazon EC2 instance, a…

I stand corrected, thanks for the info. Cloudfront doesn't appear to support multi-part uploads however, which I guess is the primary value-add of the newly announced service.

Re: Amazon S3 Transfer Acceleration

#36
post #35

Earlier quoted context omitted.

You cant? PUT/POST through Cloudfront supported since October 2013. https://aws.amazon.com/about-aws/whats-new/2013/10/15/amazon... "You can use existing Amazon CloudFront distributions for upload requests by simply enabling support in the AWS management console. When end users upload content, CloudFront will send the upload request back to the origin web server (such as an Amazon S3 bucket, an Amazon EC2 instance, a…

I stand corrected, thanks for the info. Cloudfront doesn't appear to support multi-part uploads however, which I guess is the primary value-add of the newly announced service.

You're welcome. And you're correct. As long as you don't need to upload multi parts in parallel or objects over 5GB, standard upload works fine.

Re: Amazon S3 Transfer Acceleration

#39

Does anybody have a sense of how fast uploading to S3 can get? I'm on a gigabit link here in Singapore, uploading to Singapore instance of S3 (via ARQ) - and I'm disappointed that I rarely see better than about 40 Mbits/second.

I'm in Singapore, uploading to Oregon, 100mb, took minutes , I changed to upload via signed cloud front requests, takes 15s to upload 100mb now...

Re: Amazon S3 Transfer Acceleration

#40
Secure Connection Failed

An error occurred during a connection to aws.amazon.com. Peer attempted old style (potentially vulnerable) handshake. Error code: SSL_ERROR_UNSAFE_NEGOTIATION

Really,Amazon?

https://www.ssllabs.com/ssltest/analyze.html?d=aws.amazon.co...

No PFS, TLS 1.0 only, No HSTS or HPKP ??

Post reply on HN