Amazon S3 now supports the ability to append data to an object
1–10 of 70 posts
Re: Amazon S3 now supports the ability to append data to an object
#2This is specifically for S3 "Express One Zone"
Re: Amazon S3 now supports the ability to append data to an object
#3The original title is "Amazon S3 Express One Zone now supports the ability to append data to an object" and the difference is extremely important! I was excited for a moment.
Re: Amazon S3 now supports the ability to append data to an object
#4I wonder what the implications for all the s3-like APIs is going to be.
Re: Amazon S3 now supports the ability to append data to an object
#5Does it really work for livestreams? Can I stream read and write on the same video file? That is huge if true!
Edit: oh it’s only in one AZ
Re: Amazon S3 now supports the ability to append data to an object
#6For comparison, while GCS doesn't support appends directly, there's hacky but effective workaround in that you can compose existing objects together into new objects, without having to read & write the data. If you have existing object A, upload new object B, and compose A and B together so that the resulting object is also called A, this effectively functions the same as appending B into A.
https://cloud.google.com/storage/docs/composite-objects#appe...
Re: Amazon S3 now supports the ability to append data to an object
#7I got excited until I saw the one zone part. That is a critical difference in terms of cost.
Re: Amazon S3 now supports the ability to append data to an object
#8I got excited until I saw the one zone part. That is a critical difference in terms of cost.
Isn't it cheaper than normal S3 though?
> S3 Express One Zone delivers data access speed up to 10x faster and request costs up to 50% lower than S3 Standard [0]
The critical difference seems to be in availability (1 AZ)
[0] https://aws.amazon.com/s3/storage-classes/express-one-zone/
Re: Amazon S3 now supports the ability to append data to an object
#9If you want to know the differences between Express One Zone and normal, check https://www.vantage.sh/blog/amazon-s3-express-one-zone this blog post. I had no idea this even existed. tl;dr: it's x7 expensive.
Re: Amazon S3 now supports the ability to append data to an object
#10For comparison, while GCS doesn't support appends directly, there's hacky but effective workaround in that you can compose existing objects together into new objects, without having to read & write the data. If you have existing object A, upload new object B, and compose A and B together so that the resulting object is also called A, this effectively functions the same as appending B into A. https://cloud.google.com/…
Colossus allows appends, so it would make sense that there's a backdoor way to take advantage of that in GCS. It seemed silly of me that Google didn't just directly allow appends given the architecture.