Live data from Hacker News

7-Zip for Windows can now use more than 64 CPU threads for compression

7-zip.org

21–30 of 220 posts

Re: 7-Zip for Windows can now use more than 64 CPU threads for compression

#22
Wow, a program that doesn't matter anymore has been very very minimally enhanced on a platform that doesn't matter anymore, benefitting the 7 users that have more than 64 real cores with Windoes and are regularly compressing archives so large that it doesn't drastically reduce the compression ratio to split it into more thsn 64 sections.

Posting this link to hn has consumed more human potential than the thing it is describing will save up to the end of time.

Re: 7-Zip for Windows can now use more than 64 CPU threads for compression

#24
post #10

I worry that 7-Zip is going to lose relevance because lack of zstd support. zlib's performance is intolerable for large files and zlib-ng's SIMD implementation only helps here a bit. Which is a shame, because 7-Zip is a pretty amazing container format, especially with its encryption and file splitting capabilities.

https://github.com/mcmilk/7-Zip-zstd

Thanks! Any ideas why it didn't get merged? Clearly 7-Zip has some development activity going on and so does this fork...

Re: 7-Zip for Windows can now use more than 64 CPU threads for compression

#25
post #13
post #10

I worry that 7-Zip is going to lose relevance because lack of zstd support. zlib's performance is intolerable for large files and zlib-ng's SIMD implementation only helps here a bit. Which is a shame, because 7-Zip is a pretty amazing container format, especially with its encryption and file splitting capabilities.

Not that many people care about zstd; I would assume most 7-zip users care about the convenience of the gui.

.. but 7-zip has a pretty terrible GUI?

Hence why PeaZip is so popular, and J-Zip used to be before it was stuffed with adware.

Re: 7-Zip for Windows can now use more than 64 CPU threads for compression

#26
post #25
post #13

Earlier quoted context omitted.

Not that many people care about zstd; I would assume most 7-zip users care about the convenience of the gui.

.. but 7-zip has a pretty terrible GUI? Hence why PeaZip is so popular, and J-Zip used to be before it was stuffed with adware.

Most people won't use that GUI, but will right click file or folder -> 7-Zip -> Add To ... and it will spit out a file without questions.

Granted Windows 11 has started doing the same for its zip and 7zip compressors.

Same trick goes for opening archives or executables (Installers) as archives.

Re: 7-Zip for Windows can now use more than 64 CPU threads for compression

#27
post #13
post #10

I worry that 7-Zip is going to lose relevance because lack of zstd support. zlib's performance is intolerable for large files and zlib-ng's SIMD implementation only helps here a bit. Which is a shame, because 7-Zip is a pretty amazing container format, especially with its encryption and file splitting capabilities.

Not that many people care about zstd; I would assume most 7-zip users care about the convenience of the gui.

if by gui u mean the ability to right click a .zip file and unzip it just through the little window that pops up ur totally right. At least that + the unzipping progress bar is what I appreciate 7zip for

Re: 7-Zip for Windows can now use more than 64 CPU threads for compression

#28
post #18
post #8

Earlier quoted context omitted.

A lot of synchronization primitives in the NT kernel are based on a register width bit mask of a CPU set, so each collection of 64 hardware threads on 64 bit systems kind of runs in its own instance of the scheduler. It's also unfortunately part of the driver ABI since these ops were implemented as macros and inline functions. Because of that, transitioning a software thread to another processor group is a manual pro…

Wow. That's surprisingly lame.

The NT kernel dates back to 1993. Computers didn’t exceed 64 logical processors per system until around 2014. And doing it back then required a ridiculously expensive server with 8 Intel CPUs.

The technical decision Microsoft made initially worked well for over two decades. I don’t think it was lame; I believe it was a solid choice back then.

Re: 7-Zip for Windows can now use more than 64 CPU threads for compression

#29
post #10

I worry that 7-Zip is going to lose relevance because lack of zstd support. zlib's performance is intolerable for large files and zlib-ng's SIMD implementation only helps here a bit. Which is a shame, because 7-Zip is a pretty amazing container format, especially with its encryption and file splitting capabilities.

I use ZSTD a ton in my programming work where efficiency matters.

But for sharing files with other people, ZIP is still king. Even 7z or RAR is niche. Everyone can open a ZIP file, and they don't really care if the file is a few MBs bigger.

Re: 7-Zip for Windows can now use more than 64 CPU threads for compression

#30
post #18

Earlier quoted context omitted.

Wow. That's surprisingly lame.

The NT kernel dates back to 1993. Computers didn’t exceed 64 logical processors per system until around 2014. And doing it back then required a ridiculously expensive server with 8 Intel CPUs. The technical decision Microsoft made initially worked well for over two decades. I don’t think it was lame; I believe it was a solid choice back then.

I mean, x86 didn't, but other systems had been exceeding 64 cores since the late 90s.

And x86 arguably didn't ship >64 hardware thread systems until then because NT didn't support it.

Post reply on HN