Live data from Hacker News

Amazon S3 Transfer Acceleration

aws.amazon.com

21–30 of 88 posts

Re: Amazon S3 Transfer Acceleration

#21
Anyone know if the quoted cost of $0.04/GB for Transfer Acceleration is instead of the $0.03/GB for standard S3 ingress, or in addition to it? Ie. is the final cost per GB $0.07 or $0.04 when using Transfer Acceleration?

Edit: as pointed out to me below, there actually is no ingress cost for standard S3 uploading. The $0.03/GB is monthly storage. So the cost of this service is $0.04/GB instead of $0.00.

Re: Amazon S3 Transfer Acceleration

#22
post #7

"What's a Snowball?" Animated YouTube by Amazon explains: https://youtube.com/watch?v=9uc2DSZ1wL8

Even with that, I don't get it. "Moving lots of data either requires a huge pipe, or a ton of storage disks." With that, they offer their Snowball device, which, if I'm understanding correctly, holds up to 50TB (now 80TB), which they physically ship to you, and then you ship back to them. How does this fix either of the constraints (disk space / connection pipe)?

When the last time you moved 10TB+ from onsite to offsite and:

- how long did it take,

- how was latency/connectivity/etc,

- was it encrypted,

- how much did the hardware cost

- etc.

Re: Amazon S3 Transfer Acceleration

#23
post #6
post #4

What's the fastest & cheapest way to get data off Amazon's cloud services?

It depends entirely on the quantity of data. For huge datasets, Snowball will be fastest & cheapest (literally shipping data).

As they used to say, never underestimate the bandwidth of a van filled with harddrives.

Re: Amazon S3 Transfer Acceleration

#24

Does anybody have a sense of how fast uploading to S3 can get? I'm on a gigabit link here in Singapore, uploading to Singapore instance of S3 (via ARQ) - and I'm disappointed that I rarely see better than about 40 Mbits/second.

Testing in my office (central US) to N. Virginia and Oregon was getting about 90 Mbit/sec. I'm guessing that's the cap on our connection, not an Amazon limit.

Re: Amazon S3 Transfer Acceleration

#26
post #7

"What's a Snowball?" Animated YouTube by Amazon explains: https://youtube.com/watch?v=9uc2DSZ1wL8

Even with that, I don't get it. "Moving lots of data either requires a huge pipe, or a ton of storage disks." With that, they offer their Snowball device, which, if I'm understanding correctly, holds up to 50TB (now 80TB), which they physically ship to you, and then you ship back to them. How does this fix either of the constraints (disk space / connection pipe)?

So you have 50TB of images to send me and a 10mbit internet pipe. Is it faster to FTP me the file or mail it on a hard drive?

Re: Amazon S3 Transfer Acceleration

#27

Anyone know if the quoted cost of $0.04/GB for Transfer Acceleration is instead of the $0.03/GB for standard S3 ingress, or in addition to it? Ie. is the final cost per GB $0.07 or $0.04 when using Transfer Acceleration? Edit: as pointed out to me below, there actually is no ingress cost for standard S3 uploading. The $0.03/GB is monthly storage. So the cost of this service is $0.04/GB instead of $0.00.

Data transfer into S3 is free - it's the storage that's $0.03/GB-Month

Re: Amazon S3 Transfer Acceleration

#28

Anyone know if the quoted cost of $0.04/GB for Transfer Acceleration is instead of the $0.03/GB for standard S3 ingress, or in addition to it? Ie. is the final cost per GB $0.07 or $0.04 when using Transfer Acceleration? Edit: as pointed out to me below, there actually is no ingress cost for standard S3 uploading. The $0.03/GB is monthly storage. So the cost of this service is $0.04/GB instead of $0.00.

> Anyone know if the quoted cost of $0.04/GB for Transfer Acceleration is instead of the $0.03/GB for standard S3 ingress, or in addition to it? Ie. is the final cost per GB $0.07 or $0.04 when using Transfer Acceleration?

S3 ingress is free. You're thinking of storage pricing.

Re: Amazon S3 Transfer Acceleration

#29
post #7

"What's a Snowball?" Animated YouTube by Amazon explains: https://youtube.com/watch?v=9uc2DSZ1wL8

Even with that, I don't get it. "Moving lots of data either requires a huge pipe, or a ton of storage disks." With that, they offer their Snowball device, which, if I'm understanding correctly, holds up to 50TB (now 80TB), which they physically ship to you, and then you ship back to them. How does this fix either of the constraints (disk space / connection pipe)?

With Snowball, you don't need a huge pipe because your data is being sneaker-netted to one of their data centers. You don't need a ton of storage disks because they're lending Snowball to you in the short-term as a means of copying your data to S3 (and/or Glacier) for the long-term.

If you can spare a 1 gigabit connection to saturate with S3 uploads, you can send 50TB in about two weeks. It takes about a week to request a Snowball, have it arrive, you fill it (takes about a day, assuming you have a 10Gbit connection for Snowball), you ship it back, they copy the contents to AWS storage. If you don't have a spare 1 gigabit connection, the speed is that much better. Even if you don't have 10Gbit hardware to fill Snowball with, a local, dedicated 1 gigabit connection to Snowball would be much more reliable.

Re: Amazon S3 Transfer Acceleration

#30
post #28

Anyone know if the quoted cost of $0.04/GB for Transfer Acceleration is instead of the $0.03/GB for standard S3 ingress, or in addition to it? Ie. is the final cost per GB $0.07 or $0.04 when using Transfer Acceleration? Edit: as pointed out to me below, there actually is no ingress cost for standard S3 uploading. The $0.03/GB is monthly storage. So the cost of this service is $0.04/GB instead of $0.00.

> Anyone know if the quoted cost of $0.04/GB for Transfer Acceleration is instead of the $0.03/GB for standard S3 ingress, or in addition to it? Ie. is the final cost per GB $0.07 or $0.04 when using Transfer Acceleration? S3 ingress is free. You're thinking of storage pricing.

Ah yes of course, thanks. I took too brief a glance at the S3 pricing page.
Post reply on HN