Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Show HN: S3mini – Tiny and fast S3-compatible client, no-deps, edge-ready

github.com

Post reply on HN
Print view View original

91–100 of 105 posts

Re: Show HN: S3mini – Tiny and fast S3-compatible client, no-deps, edge-ready

#91

Post by koito17 »

linotype wrote: post #90

This looks slick. What I would also love to see is a simple, single binary S3 server alternative to Minio. Maybe a small built in UI similar to DuckDB UI.

> What I would also love to see is a simple, single binary S3 server alternative to Minio

Garage[1] lacks a web UI but I believe it meets your requirements. It's an S3 implementation that compiles to a single static binary, and it's specifically designed for use cases where nodes do not necessarily have identical hardware (i.e. different CPUs, different RAM, different storage sizes, etc.). Overall, Garage is my go-to solution for object storage at "home server scale" and for quickly setting up a real S3 server.

There seems to be an unofficial Web UI[2] for Garage, but you're no longer running a single binary if you use this. Not as convenient as a built-in web UI.

[1] https://garagehq.deuxfleurs.fr/

[2] https://github.com/khairul169/garage-webui

Re: Show HN: S3mini – Tiny and fast S3-compatible client, no-deps, edge-ready

#92

Post by rsync »

nodesocket wrote: post #17

Somewhat related, I just came across s5cmd[1] which is mainly focused on performance and fast upload/download and sync of s3 buckets. > 32x faster than s3cmd and 12x faster than aws-cli. For downloads, s5cmd can saturate a 40Gbps link (~4.3 GB/s), whereas s3cmd and aws-cli can only reach 85 MB/s and 375 MB/s respectively. [1] https://github.com/peak/s5cmd

s5cmd is built into the rsync.net platform. See:

https://news.ycombinator.com/item?id=44248372

Re: Show HN: S3mini – Tiny and fast S3-compatible client, no-deps, edge-ready

#94

Post by impulser_ »

arianvanp wrote: post #76

libcurl also has AWS auth with --aws-sigv4 which gives you a fully compatible S3 cliënt without installing anything! (You probably already have curl installed)

Yeah, but that will not work on cloudflare, vercel, or any other serverless environment because at most you only have access to node apis.

Re: Show HN: S3mini – Tiny and fast S3-compatible client, no-deps, edge-ready

#95

Post by hsbauauvhabzb »

JimDabell wrote: post #10
hsbauauvhabzb wrote: post #2

I found the words used to describe this jarring - to me it makes sense to have an s3 client on my computer, but less so client side on a webapp. On further reading, it makes sense, but highlighting what problem this package solves in the first few lines of the readme would be valuable for people like me at least

I think “for node and edge platforms” and “No browser support!” makes this pretty clear? Those are in the title and first paragraph.

I think if you asked the average IT person what those buzzwords mean, you’ll find the answer unclear…

Re: Show HN: S3mini – Tiny and fast S3-compatible client, no-deps, edge-ready

#96

Post by degamad »

formerly_proven wrote: post #19
vbezhenar wrote: post #18

Earlier quoted context omitted.

Theoretically TCP packets have checksums, however it's fairly weak. So for HTTP, additional checksums make sense. Although I'm not sure, if there are any internal AWS S3 deployments working over HTTP and why would they complicate their protocol for everyone to help such a niche use case. I'm sure that they have reasons for this whole request signature scheme over traditional "Authorization: Bearer $token" header, but…

Because a bearer token is a bearer token to do any request, while a pre-signed request allows you to hand out the capability to perform _only that specific request_.

Bearer tokens have a defined scope, which could be used to limit functionality in a similar way to pre-signed requests.

However, the s3 pre-signed requests functionality was launched in 2011, but the Bearer token RFC 6750 wasn't standardised until 2012...

Re: Show HN: S3mini – Tiny and fast S3-compatible client, no-deps, edge-ready

#97

Post by crabmusket »

spott wrote: post #54
pier25 wrote: post #40

Earlier quoted context omitted.

for JS > It runs on Node, Bun, Cloudflare Workers, and other edge platforms

But not in the browser… because it depends on node.js apis.

There's always https://github.com/mhart/aws4fetch/

Re: Show HN: S3mini – Tiny and fast S3-compatible client, no-deps, edge-ready

#98

Post by leerob »

impulser_ wrote: post #94
arianvanp wrote: post #76

libcurl also has AWS auth with --aws-sigv4 which gives you a fully compatible S3 cliënt without installing anything! (You probably already have curl installed)

Yeah, but that will not work on cloudflare, vercel, or any other serverless environment because at most you only have access to node apis.

Should work on Vercel, you have access to full Node.js APIs in functions.

Re: Show HN: S3mini – Tiny and fast S3-compatible client, no-deps, edge-ready

#99

Post by cosmotic »

cosmotic wrote: post #58

> https://raw.githubusercontent.com/good-lly/s3mini/dev/perfor... It gets slower as the instance gets faster? I'm looking at ops/sec and time/op. How am I misreading this?

Oh, I see my mistake. Those are payload sizes not intance sizes in the heading for each table.

Re: Show HN: S3mini – Tiny and fast S3-compatible client, no-deps, edge-ready

#100

Post by JimDabell »

hsbauauvhabzb wrote: post #95
JimDabell wrote: post #10

Earlier quoted context omitted.

I think “for node and edge platforms” and “No browser support!” makes this pretty clear? Those are in the title and first paragraph.

I think if you asked the average IT person what those buzzwords mean, you’ll find the answer unclear…

I was responding to this:

> to me it makes sense to have an s3 client on my computer, but less so client side on a webapp

The relevant audience in this situation is not the average IT person, but a person who might mistake this for client-side web app functionality.

If you think that something might run in the browser, then “no browser support!” is not complicated jargon that you won’t understand.

Post reply on HN