Live data from Hacker News

Show HN: S3mini – Tiny and fast S3-compatible client, no-deps, edge-ready

github.com

101–105 of 105 posts

Re: Show HN: S3mini – Tiny and fast S3-compatible client, no-deps, edge-ready

#102

Somewhat related, I just came across s5cmd[1] which is mainly focused on performance and fast upload/download and sync of s3 buckets. > 32x faster than s3cmd and 12x faster than aws-cli. For downloads, s5cmd can saturate a 40Gbps link (~4.3 GB/s), whereas s3cmd and aws-cli can only reach 85 MB/s and 375 MB/s respectively. [1] https://github.com/peak/s5cmd

I prefer s5cmd as well because it has a better CLI interface than s3cmd, especially if you need to talk with non-AWS S3-compatible servers. It does few things and does them well, whereas s3cmd is a tool with a billion options, configuration files, badly documented env variables, and its default mode of operation assumes you are talking with AWS.

Re: Show HN: S3mini – Tiny and fast S3-compatible client, no-deps, edge-ready

#103
post #85

Earlier quoted context omitted.

So let's put every package under the sun into the client? This approach does not scale. We should make NPM better.

How do you make NPM better? BTW I'm not saying we should kill NPM. What I'm saying is we should reduce our dependance on random packages. Bun doesn't need to add everything into the core engine. Eg: when using .NET you still add plenty of official Microsoft dependencies from Nuget.

- NPM could migrate to reproducible builds of artefacts

- Trust could be opt-in by default

- Dependency installation could be made fully reproducible

Re: Show HN: S3mini – Tiny and fast S3-compatible client, no-deps, edge-ready

#104
post #31
post #29

This is awesome! Been waiting for something like this to replace the bloated SDK Amazon provides. Important question— is there a pathway to getting signed URLs?

For now, unfortunately, no - no signed URLs are supported. It wasn't my focus (use case), but if you find a simple/minimalistic way to implement it, I can help you with that to integrate it. From my helicopter perspective, it adds extra complexity and size, which could maybe be ideal for a separate fork/project?

I use presigned urls as part of a federation layer on top of an s3 bucket. Users make authenticated requests to my api which checks their permissions (if they have access to read/write to the specified slice of the s3 bucket), my api sends a presigned url back to allow read/write/delete to that specific portion of the bucket.

Re: Show HN: S3mini – Tiny and fast S3-compatible client, no-deps, edge-ready

#105

Somewhat related, I just came across s5cmd[1] which is mainly focused on performance and fast upload/download and sync of s3 buckets. > 32x faster than s3cmd and 12x faster than aws-cli. For downloads, s5cmd can saturate a 40Gbps link (~4.3 GB/s), whereas s3cmd and aws-cli can only reach 85 MB/s and 375 MB/s respectively. [1] https://github.com/peak/s5cmd

For the time I worked at AWS, pretty much everyone inside the company used s5cmd for its speed.

I think that speaks pretty highly of it.

Post reply on HN