Amazon S3’s 15th Birthday: 5,475 Days and 100T Objects

#1

Post by yarapavan » Mon, Mar 15, 2021, 2:17 PM UTC

Amazon S3’s 15th Birthday: 5,475 Days and 100T Objects
aws.amazon.com

Re: Amazon S3’s 15th Birthday: 5,475 Days and 100T Objects

#2

Post by leesalminen » Mon, Mar 15, 2021, 2:43 PM UTC

> That’s almost 13,000 objects for each person in the world, or 50 objects for every one of the roughly two trillion galaxies (according to this 2021 estimate) in the Universe.

That’s mind boggling to think about. I wonder how much paper would’ve been needed to store 100T objects on paper. It’s like the new Library of Alexandria.

Re: Amazon S3’s 15th Birthday: 5,475 Days and 100T Objects

#3

Post by intsunny » Mon, Mar 15, 2021, 2:44 PM UTC

Can we update the title? 100T reads as "100 terabytes" instead of "100 trillion" (as per the source).

Re: Amazon S3’s 15th Birthday: 5,475 Days and 100T Objects

#4

Post by TedDoesntTalk » Mon, Mar 15, 2021, 2:44 PM UTC

> S3 is designed to provide “11 9’s” (99.999999999%) of durability

Has anyone lost data on S3 or know anyone who has?

Re: Amazon S3’s 15th Birthday: 5,475 Days and 100T Objects

#5

Post by TedDoesntTalk » Mon, Mar 15, 2021, 2:45 PM UTC

leesalminen wrote: post #2

> That’s almost 13,000 objects for each person in the world, or 50 objects for every one of the roughly two trillion galaxies (according to this 2021 estimate) in the Universe. That’s mind boggling to think about. I wonder how much paper would’ve been needed to store 100T objects on paper. It’s like the new Library of Alexandria.

> It’s like the new Library of Alexandria.

Presumably the Library of Alexandria didn’t have access control lists

Re: Amazon S3’s 15th Birthday: 5,475 Days and 100T Objects

#6

Post by jcims » Mon, Mar 15, 2021, 2:46 PM UTC

TedDoesntTalk wrote: post #5

leesalminen wrote: post #2

> That’s almost 13,000 objects for each person in the world, or 50 objects for every one of the roughly two trillion galaxies (according to this 2021 estimate) in the Universe. That’s mind boggling to think about. I wonder how much paper would’ve been needed to store 100T objects on paper. It’s like the new Library of Alexandria.

> It’s like the new Library of Alexandria. Presumably the Library of Alexandria didn’t have access control lists

And look what happened...

Re: Amazon S3’s 15th Birthday: 5,475 Days and 100T Objects

#7

Post by gnrlst » Mon, Mar 15, 2021, 2:47 PM UTC

TedDoesntTalk wrote: post #4

> S3 is designed to provide “11 9’s” (99.999999999%) of durability Has anyone lost data on S3 or know anyone who has?

There's different storage tiers, with different redundancy. So if anyone has an anecdote, would be curious to know which storage tier was used (e.g. single availability zone)

Re: Amazon S3’s 15th Birthday: 5,475 Days and 100T Objects

#8

Post by bluedino » Mon, Mar 15, 2021, 2:47 PM UTC

Do they de-dupe at all?

Re: Amazon S3’s 15th Birthday: 5,475 Days and 100T Objects

#9

Post by corban1 » Mon, Mar 15, 2021, 2:48 PM UTC

I am really getting afraid of this centralization of data.

Re: Amazon S3’s 15th Birthday: 5,475 Days and 100T Objects

#10

Post by leesalminen » Mon, Mar 15, 2021, 2:49 PM UTC

TedDoesntTalk wrote: post #5

leesalminen wrote: post #2

> That’s almost 13,000 objects for each person in the world, or 50 objects for every one of the roughly two trillion galaxies (according to this 2021 estimate) in the Universe. That’s mind boggling to think about. I wonder how much paper would’ve been needed to store 100T objects on paper. It’s like the new Library of Alexandria.

> It’s like the new Library of Alexandria. Presumably the Library of Alexandria didn’t have access control lists

For sure ;) but I also imagine that the number of objects with a public-read ACL (potentially mis-configured) would still dwarf Alexandria.