Live data from Hacker News

Amazon S3 now supports the ability to append data to an object

aws.amazon.com

11–20 of 70 posts

Re: Amazon S3 now supports the ability to append data to an object

#11

I got excited until I saw the one zone part. That is a critical difference in terms of cost.

Isn't it cheaper than normal S3 though? > S3 Express One Zone delivers data access speed up to 10x faster and request costs up to 50% lower than S3 Standard [0] The critical difference seems to be in availability (1 AZ) [0] https://aws.amazon.com/s3/storage-classes/express-one-zone/

[deleted]

Re: Amazon S3 now supports the ability to append data to an object

#12

I got excited until I saw the one zone part. That is a critical difference in terms of cost.

Isn't it cheaper than normal S3 though? > S3 Express One Zone delivers data access speed up to 10x faster and request costs up to 50% lower than S3 Standard [0] The critical difference seems to be in availability (1 AZ) [0] https://aws.amazon.com/s3/storage-classes/express-one-zone/

Storage cost is much higher. Express One Zone is $0.16 per GB while standard S3 is $0.023 per GB ( https://aws.amazon.com/s3/pricing/?nc=sn&loc=4 )

Re: Amazon S3 now supports the ability to append data to an object

#13

I got excited until I saw the one zone part. That is a critical difference in terms of cost.

Isn't it cheaper than normal S3 though? > S3 Express One Zone delivers data access speed up to 10x faster and request costs up to 50% lower than S3 Standard [0] The critical difference seems to be in availability (1 AZ) [0] https://aws.amazon.com/s3/storage-classes/express-one-zone/

> Compared to S3 Standard, even though the new class offers 50% cheaper request pricing—storage is almost seven times more expensive.

The house always wins https://www.vantage.sh/blog/amazon-s3-express-one-zone

Re: Amazon S3 now supports the ability to append data to an object

#14

I got excited until I saw the one zone part. That is a critical difference in terms of cost.

Isn't it cheaper than normal S3 though? > S3 Express One Zone delivers data access speed up to 10x faster and request costs up to 50% lower than S3 Standard [0] The critical difference seems to be in availability (1 AZ) [0] https://aws.amazon.com/s3/storage-classes/express-one-zone/

Ingress pricing is indeed cheaper. POST is $0.005 per thousand requests on standard and $0.0025 on express one.

Egress and storage however are more expensive on express one than any other tier. For comparison, glacier (instant), standard and express are $0.004, $0.023 and $0.16 per GB. Although slight, standard tier also receives additional discounts above 50 TB.

Re: Amazon S3 now supports the ability to append data to an object

#15
Wrote some notes on this here: https://simonwillison.net/2024/Nov/22/amazon-s3-append-data/

Key points:

- It's just for the "S3 Express One Zone" bucket class, which is more expensive (16c/GB/month compared to 2.3c for S3 standard tier) and less highly available, since it lives in just one availability zone

- "With each successful append operation, you create a part of the object and each object can have up to 10,000 parts. This means you can append data to an object up to 10,000 times."

That 10,000 parts limit means this isn't quite the solution for writing log files directly to S3.

Re: Amazon S3 now supports the ability to append data to an object

#19
post #15

Wrote some notes on this here: https://simonwillison.net/2024/Nov/22/amazon-s3-append-data/ Key points: - It's just for the "S3 Express One Zone" bucket class, which is more expensive (16c/GB/month compared to 2.3c for S3 standard tier) and less highly available, since it lives in just one availability zone - "With each successful append operation, you create a part of the object and each object can have up to 10,000…

Not directly, but enough to write once every hour for more than a year!
Post reply on HN