Live data from Hacker News

Zstandard v1.5.0

github.com

1–10 of 38 posts

Re: Zstandard v1.5.0

#2
zstandard continues to amazes me. Compared to zlib (level=4 I think) it seems to have best of both worlds (good speed & comparable compression ratio).

Re: Zstandard v1.5.0

#3
When can we bring this to the web? Zstd aka RFC8478[1] is so good. That it can continue to improve at all feels almost unbelievable, but @Cyan4973 &al continue to make it faster, somehow.

Especially on mobile, with large assets, I feel like zstd's lightning fast decompression time could be a huge win. It used to be that Brotli was the obvious choice for achieving high compression, but it doesn't feel so clear to me now. Here's one random run-off between the two[2].

The other obvious use case is if there is large-ish dynamic-ish data, where the cost of doing Brotli compression each time might be too high.

[1] https://datatracker.ietf.org/doc/html/rfc8478

[2] https://peazip.github.io/fast-compression-benchmark-brotli-z...

Re: Zstandard v1.5.0

#4
Is this the same "zstd" compression used in Fedora's btrfs transparent block level compression? I have been thoroughly impressed with it in Fedora 34. If that's true, I had no idea that it was a Facebook project. Color me shocked.

Re: Zstandard v1.5.0

#5

Is this the same "zstd" compression used in Fedora's btrfs transparent block level compression? I have been thoroughly impressed with it in Fedora 34. If that's true, I had no idea that it was a Facebook project. Color me shocked.

Yeah, it is.

The Linux kernel is currently using zstd-1.3.1, and I'm working on getting it updated to the latest zstd version.

Re: Zstandard v1.5.0

#6

Is this the same "zstd" compression used in Fedora's btrfs transparent block level compression? I have been thoroughly impressed with it in Fedora 34. If that's true, I had no idea that it was a Facebook project. Color me shocked.

Facebook actually does a decent amount of work on Fedora, and were even part of the force behind using btrfs as the default.

Re: Zstandard v1.5.0

#7
> Single file Libs > This move reflects a commitment on our part to support this tool and this pattern of using zstd going forward.

I love that they are moving toward supporting an amalgamation build. I and many others reach for SQLite because of this feature, and I think this will really increase the adoption of Zstd.

Re: Zstandard v1.5.0

#8
Zstd is so much better than the commonly-used alternatives that I get mildly annoyed when given a .tar.{gz,xz,bz2} it's not like it's a huge deal, but a much smaller file (compared to gz) or similarly sized with much faster decompression (comared to xz, bz2) just makes me a tiny bit happier.

Re: Zstandard v1.5.0

#9

Is this the same "zstd" compression used in Fedora's btrfs transparent block level compression? I have been thoroughly impressed with it in Fedora 34. If that's true, I had no idea that it was a Facebook project. Color me shocked.

It wasn't originally. Facebook hired Yann Collet well after zstd was a working thing.

Re: Zstandard v1.5.0

#10

> Single file Libs > This move reflects a commitment on our part to support this tool and this pattern of using zstd going forward. I love that they are moving toward supporting an amalgamation build. I and many others reach for SQLite because of this feature, and I think this will really increase the adoption of Zstd.

Glad to hear it! It's a pretty hefty single file, so it probably won't be qualifying for https://github.com/nothings/single_file_libs anytime soon... but hopefully people find it useful nonetheless.
Post reply on HN