Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Zstandard RFC 8878

datatracker.ietf.org

Post reply on HN
Print view View original

11–20 of 45 posts

Re: Zstandard RFC 8878

#11

Post by m0zg »

Zstd is an amazing bit of work and all I ever use for data compression nowadays (or LZ4 when speed is even more critical). Several times the compression/decompression speed of gzip, approximately the same compression ratio with default settings.

It's also supported by tar in recent Linux distros, if zstd is installed, so "tar acf blah.tar.zst *" works fine, and "tar xf blah.tar.zst" works automatically as well. Give it a try, folks, and retire gzip shortly afterwards.

Re: Zstandard RFC 8878

#14

Post by thriftwy »

Zstandard has very cool dictionary training feature, which allows to keep a separate dictionary and have a 50% ratio compression on very small (~100b) but repetitive data such as database records.

Re: Zstandard RFC 8878

#15

Post by oofbey »

buryat wrote: post #12

i forgive facebook all their abuses just because they gave us zstd

I think you should read more about Facebook. Try e.g. the Damien Collins email dump, and read about how their android app tricked people into letting it record all phone call and text message records, knowing full well users would hate it if they found out.

Clearly they produce good technology. But the company is morally bankrupt.

Re: Zstandard RFC 8878

#17

Post by metafex »

buryat wrote: post #12

i forgive facebook all their abuses just because they gave us zstd

they didn't though. zstd has been around even before the main dev joined fb, i distinctly remember it being under the persons personal github name.

Re: Zstandard RFC 8878

#18

Post by lifthrasiir »

jeffbee wrote: post #3

Does this mean the Zstd magic number is now cast in stone?

You may have mistaken Brotli (whose file format has no magic number and prevents an easy identification) with Zstandard (whose file format does have defined magic numbers 28 B5 2F FD or [50-5F] 2A 4D 18).

Re: Zstandard RFC 8878

#19

Post by mjevans »

m0zg wrote: post #11

Zstd is an amazing bit of work and all I ever use for data compression nowadays (or LZ4 when speed is even more critical). Several times the compression/decompression speed of gzip, approximately the same compression ratio with default settings. It's also supported by tar in recent Linux distros, if zstd is installed, so "tar acf blah.tar.zst *" works fine, and "tar xf blah.tar.zst" works automatically as well. Give…

I get why someone might want to avoid .zstd ; but that is the short name offered for humans.

Was .zs not sufficient if a file format ending in 'std' is so abhorrent?

Post reply on HN