Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

AWS Tape Gateway

aws.amazon.com

Post reply on HN
Print view View original

111–120 of 139 posts

Re: AWS Tape Gateway

#111

Post by dgacmu »

lopkeny12ko wrote: post #52
kcb wrote: post #48

Earlier quoted context omitted.

I hate it. Once the number gets so small beyond comprehension it’s hard to believe the validity. It reminds me of the Feynman’s statements during the Space Shuttle Challenger disaster. > Feynman was disturbed by two aspects of this practice. First, NASA management assigned a probability of failure to each individual bolt, sometimes claiming a probability of 1 in 10^8, i.e. one in one hundred million. Feynman pointed…

There is rigor behind the claim. Check out this talk from a few years ago: https://www.youtube.com/watch?v=DzRyrvUF-C0

There's rigor within the assumptions. The problem is when the assumptions are wrong - most notably around failure independence. Data center fire? Accounted for. Simultaneous terrorist attack / asteroid (as per GP), / nuclear war on all data centers? Maybe not. Where does insider threat fit in on that spectrum? We don't know.

I'm personally fine with the claim as I understand the methodology and assumptions but it has to be interpreted carefully.

Re: AWS Tape Gateway

#112

Post by BonoboIO »

chrisshroba wrote: post #24

Tangent: What's the cheapest way to backup a few TB of personal data these days, pricing based on the premise that I probably will never need to retrieve it (due to local backups as well), but I don't want to pay thousands if I do have to (hundreds would be okay). Glacier Deep Archive?

Hetzner Storage Boxes I host nearly everything there. Just awesome company.

1TB = 3.2€

5TB = 10.9€

10TB = 20.8€

...

https://www.hetzner.com/storage/storage-box

No transfer fees.

Re: AWS Tape Gateway

#113

Post by electroly »

htrp wrote: post #94
WrtCdEvrydy wrote: post #41

Earlier quoted context omitted.

> Once you have massive data in AWS there is no efficient and affordable solution to move that data back out; you are locked in forever subject to whatever future terms Amazon may chose to impose. You can have your shit packed into a snowball and shipped to you.

Can you? https://aws.amazon.com/snowmobile/faqs/ > Snowmobile does not support data export.

Snowball and Snowmobile are different. Snowball does support it.

https://docs.aws.amazon.com/snowball/latest/developer-guide/...

Re: AWS Tape Gateway

#115

Post by robocat »

kube-system wrote: post #70
robocat wrote: post #44

Earlier quoted context omitted.

“Transfer up to 100 PB per Snowmobile, a 45-foot-long ruggedized shipping container pulled by a semi-trailer truck.” - I’m guessing usually used to migrate corporate information into AWS, but can also be used for data export. They advertise Exabytes (using more than one rig I guess). https://aws.amazon.com/snowmobile/

https://aws.amazon.com/snowmobile/faqs/ > Snowmobile does not support data export.

Hmmmm - the subheading of the page says “Migrate or transport exabyte-scale datasets into and out of AWS”, and in the diagram they repeat it. Either AWS is being deceptive, or the FAQ is wrong. Someone who cares that has a corporate AWS account should check or get documentation corrected? More interesting to know how AWS respond…

  Q: Can I export data from AWS with Snowmobile? Snowmobile does not support data export. It is designed to let you quickly, easily, and more securely migrate exabytes of data to AWS. When you need to export data from AWS, you can use AWS Snowball Edge to quickly export up to 100TB per appliance and run multiple export jobs in parallel as necessary.
Interesting since there is obviously no technical reason the export can’t be done from AWS. ⸘Technically you could export exabytes using tens of thousands of 100TB Snowball Edge devices‽

The snowball “device” is pretty neat:

* 45-foot long High Cube shipping container

* [each snowmobile container] comes with a removable connector rack with up to two kilometers of networking cable that can directly connect to the network backbone in your data center.

* AWS can provide the auxiliary chiller if needed based on the site survey findings [if temperature exceeds 85F/29.4C]

* A fully powered Snowmobile requires ~350KW [sic] Generators can be provided by AWS if needed

* Snowmobile pricing is based on the amount of data stored on the truck per month. Provisioned Snowmobile Capacity: $0.005/GB per month

Re: AWS Tape Gateway

#116

Post by ufmace »

robocat wrote: post #44
dzdt wrote: post #2

As always the problem seems to be the 'Hotel California' issue: you can check out but you can never leave. Once you have massive data in AWS there is no efficient and affordable solution to move that data back out; you are locked in forever subject to whatever future terms Amazon may chose to impose.

“Transfer up to 100 PB per Snowmobile, a 45-foot-long ruggedized shipping container pulled by a semi-trailer truck.” - I’m guessing usually used to migrate corporate information into AWS, but can also be used for data export. They advertise Exabytes (using more than one rig I guess). https://aws.amazon.com/snowmobile/

I wonder if they haven't updated that in a while, it sounds low. You can get 22TB 3.5" hard drives these days. If I take that storage and figure full racks with rackmount NASes I get 30 feet long for 1 row of full-size racks. 45 feet is longer and they probably have room for at least 2 rows. Even accounting for probably needing some controller computers and routers and network interfaces and such, I would think they could at least double that these days.

Re: AWS Tape Gateway

#117

Post by luhn »

brudgers wrote: post #19
jaywalk wrote: post #12

Earlier quoted context omitted.

> Also, how will this magic Amazon "Tape Gateway" back up petabytes over slow links? Easy: it won't. If you have more data than bandwidth, you won't use this service. Not sure why you seem to think otherwise.

Amazon has a service to send a semi-trailer to the loading dock of your data warehouse, so you can forklift in pallets of physical media. Then hauls it all away for ingestion into its cloud. Or, if it will fit in your station wagon, you can haul your data down the highway to one of Amazon's clouds. Or put it in a box and ship it Fedex.

That's not quite how it works. Amazon will send you various storage appliances (including a semi hauling a 45ft shipping container full of hard drives), which you connect to your network, upload your data, and send it back to them. They don't accept pallets of arbitrary media devices.

https://aws.amazon.com/snow/

Re: AWS Tape Gateway

#118

Post by znpy »

CSMastermind wrote: post #71
zetazzed wrote: post #61

I think I'll point to this as one of the examples of how AWS has been scrappy and successful. (Yes, I'll get like 10 flames on this comment.) They made this nice simple API for S3 that has become a de facto standard. They added lots of features and security controls, and I can easily imagine an architect saying "everyone should just adopt S3, it's so easy!" But huge, paying customers were used to tape libraries so th…

I use AWS at the companies I work for because of their amazing customer service. I'm fairly critical of Amazon's engineering culture and practices but as a customer I have to admit they are head and shoulders above their competition and frankly most SaaS providers as a whole. They've secured millions of dollars in revenue from me alone just by being so customer friendly.

Customer obsession is like the first of Amazon’s leadership principles.

Re: AWS Tape Gateway

#119

Post by iLoveOncall »

posguy wrote: post #89
MisterPea wrote: post #76

Earlier quoted context omitted.

I think if you took a poll of AWS workers you'd find that most enjoy it. The culture leads to a vocal minority who REALLY hate it but my time there was some of the most enjoyable I've ever had. I've worked with some of the smartest people in the tech field, building products from scratch for billion dollar customers and learning every day. I've always told people that it's probably the best place you can start out of…

Amazon is a turn and burn employer at its heart. I've watched dozens of friends and acquaintances work there, rarely making it past 2 years, only to leave for less caustic organization thereafter. Unless your willing to put up with a huge ration of shit on a regular basis, or you make it into management, your time is limited by the up and out mentality of the organization as a whole. Amazon has created the perfect sc…

It's weird how it's always the people that talk about friends that worked there but don't actually work there themselves that are usually the only ones to have negative things to tell.

I've been there 5 years, haven't worked more than 40 hours a week ever, and a lot of the people that started at the same time as me are in the same situation. And of those that aren't, they left because they wanted new experiences, not because they didn't like Amazon.

I never had to put up with any "shit", whatever that could mean.

Re: AWS Tape Gateway

#120

Post by Aeolun »

CSMastermind wrote: post #71
zetazzed wrote: post #61

I think I'll point to this as one of the examples of how AWS has been scrappy and successful. (Yes, I'll get like 10 flames on this comment.) They made this nice simple API for S3 that has become a de facto standard. They added lots of features and security controls, and I can easily imagine an architect saying "everyone should just adopt S3, it's so easy!" But huge, paying customers were used to tape libraries so th…

I use AWS at the companies I work for because of their amazing customer service. I'm fairly critical of Amazon's engineering culture and practices but as a customer I have to admit they are head and shoulders above their competition and frankly most SaaS providers as a whole. They've secured millions of dollars in revenue from me alone just by being so customer friendly.

I’m fairly critical of all AWS’s weird limits and the quality of their non-core offerings (CDK is full of bugs and missing resources, half of which are caused by missing shit in CloudFormation).

But I agree their support is very responsive.

Post reply on HN