Live data from Hacker News

AWS Snowmobile – Massive Exabyte-Scale Data Transfer Service

aws.amazon.com

31–39 of 39 posts

Re: AWS Snowmobile – Massive Exabyte-Scale Data Transfer Service

#33

Who even has that much data, outside of Google and Facebook? I mean - I totally believe there are people that do have that much, I just don't know who they are. Fake Edit: Film?

Any retail chain has that scale of data in surveillance tapes. Order of few mb/s * 10's of cameras per location * 100's of locations * 1000's of seconds per day * 100's of days per year => order of 10^15 bytes per year. So far it hasn't been economical to collect and analyze these tapes. But it is approaching feasibility, and AI is reaching the point it could give useful output on that massive input. Patterns of how shoppers interact with merchandise. What can you change to sell a few percent more items?

Re: AWS Snowmobile – Massive Exabyte-Scale Data Transfer Service

#35
post #31

Will they let you snowmobile your data back out if you want to switch to another cloud provider later? Or is it a one way street, and you pay thru the nose if you want to load your exabytes back out?

The FAQ implies it is for ingest only, and you need to use snowballs if you want to get data out.

Re: AWS Snowmobile – Massive Exabyte-Scale Data Transfer Service

#36
post #28

Who even has that much data, outside of Google and Facebook? I mean - I totally believe there are people that do have that much, I just don't know who they are. Fake Edit: Film?

Banks?

That's just numbers and a bit of text, no?

I guess anything media related is way bigger. I thought of media archives of TV stations, but those are (if digital already) cold storage with only a low-res preview live.

Re: AWS Snowmobile – Massive Exabyte-Scale Data Transfer Service

#37
As he says in the talk this truck is for 100 Pb, you'd need 10 of them for the aforementioned Exabyte (Eb); which I imagine would nicely equate to a train.

If this data is valuable though wouldn't it need to be securely transported; Mad Max: Fury Road springs to mind...

Increasingly the film Johnny Mnemonic is becoming more and more preposterous; it was 320 Gb in the film. I think the book was 320Mb.

Re: AWS Snowmobile – Massive Exabyte-Scale Data Transfer Service

#38
post #28

Earlier quoted context omitted.

Banks?

That's just numbers and a bit of text, no? I guess anything media related is way bigger. I thought of media archives of TV stations, but those are (if digital already) cold storage with only a low-res preview live.

Check images, receipts, transactions, statements (particularly PDF), deposit slips, mortgage documents... all kept for 7-20+ years.

Re: AWS Snowmobile – Massive Exabyte-Scale Data Transfer Service

#39
post #38

Earlier quoted context omitted.

That's just numbers and a bit of text, no? I guess anything media related is way bigger. I thought of media archives of TV stations, but those are (if digital already) cold storage with only a low-res preview live.

Check images, receipts, transactions, statements (particularly PDF), deposit slips, mortgage documents... all kept for 7-20+ years.

Oooh. Very good point.
Post reply on HN