Live data from Hacker News

S3 Express Is All You Need

warpstream.com

1–10 of 87 posts

Re: S3 Express Is All You Need

#3
post #2

Has anyone here a usecase which would perform better with this new S3 Express Tier? And a second question, would it be worth the 8x times surcharge?

I think the key benefit brushed on by this article is the potential 10x improvement in access speeds (which has many applications, beyond reducing your s3 op charges).

> S3 Express One Zone can improve data access speeds by 10x and reduce request costs by 50% compared to S3 Standard and scales to process millions of requests per minute.

Re: S3 Express Is All You Need

#4
> However, the new storage class does open up an exciting new opportunity for all modern data infrastructure: the ability to tune an individual workload for low latency and higher cost or higher latency and lower cost with the exact same architecture and code.

I get it, but at the same time that is also what you lost when you locked yourself in with a particular vendor.

Re: S3 Express Is All You Need

#5
post #4

> However, the new storage class does open up an exciting new opportunity for all modern data infrastructure: the ability to tune an individual workload for low latency and higher cost or higher latency and lower cost with the exact same architecture and code. I get it, but at the same time that is also what you lost when you locked yourself in with a particular vendor.

> I get it, but at the same time that is also what you lost when you locked yourself in with a particular vendor.

What are other viable practical alternative solution(s)?

Re: S3 Express Is All You Need

#6
post #4

> However, the new storage class does open up an exciting new opportunity for all modern data infrastructure: the ability to tune an individual workload for low latency and higher cost or higher latency and lower cost with the exact same architecture and code. I get it, but at the same time that is also what you lost when you locked yourself in with a particular vendor.

> I get it, but at the same time that is also what you lost when you locked yourself in with a particular vendor. What are other viable practical alternative solution(s)?

Storage adapter to talk S3 compatible to target, assuming you're not relying on vendor specific extensions or behavior (ie this).

Off the top of my head, Backblaze B2, Cloudflare R2, etc are S3 compatible, and Minio locally.

https://www.google.com/search?q=s3+compatible

Re: S3 Express Is All You Need

#7

Earlier quoted context omitted.

> I get it, but at the same time that is also what you lost when you locked yourself in with a particular vendor. What are other viable practical alternative solution(s)?

Storage adapter to talk S3 compatible to target, assuming you're not relying on vendor specific extensions or behavior (ie this). Off the top of my head, Backblaze B2, Cloudflare R2, etc are S3 compatible, and Minio locally. https://www.google.com/search?q=s3+compatible

There are no vendor specific extensions or behavior here, are there? Isn't it just a different billing structure?

Re: S3 Express Is All You Need

#8
post #4

> However, the new storage class does open up an exciting new opportunity for all modern data infrastructure: the ability to tune an individual workload for low latency and higher cost or higher latency and lower cost with the exact same architecture and code. I get it, but at the same time that is also what you lost when you locked yourself in with a particular vendor.

There's not much to the S3 API, and data import/export even at massive scale is available with Snowball. Sure, there's many other AWS services that aren't available at other vendors, but blob storage is commodified at this point.

Re: S3 Express Is All You Need

#9
post #4

> However, the new storage class does open up an exciting new opportunity for all modern data infrastructure: the ability to tune an individual workload for low latency and higher cost or higher latency and lower cost with the exact same architecture and code. I get it, but at the same time that is also what you lost when you locked yourself in with a particular vendor.

Except this has uniform billing, security, locality, monitoring, tools, etc
Post reply on HN