Show HN: Fast integer compression library in C

edit: Apparently this isn't actually a SIMD implementation, so it's basically just a variant of delta compression with no particular advantage (or disadvantage).

Re: Show HN: Fast integer compression library in C

#6

Post by cruppstahl » Mon, Jun 15, 2015, 5:00 AM UTC

anarazel wrote: post #4

Weird name (cruppstahl, nor for). To me it has third Reich connotations...

Absolutely not for me.

Re: Show HN: Fast integer compression library in C

#7

Post by cruppstahl » Mon, Jun 15, 2015, 5:02 AM UTC

yjh0502 wrote: post #3

Faster version with SIMD instructions: https://github.com/lemire/simdcomp

Yes, Simdcomp has faster encryption/decryption, but with Delta compression. FOR is a bit simpler and has faster random access.

Re: Show HN: Fast integer compression library in C

#8

Post by anarazel » Mon, Jun 15, 2015, 3:17 PM UTC

cruppstahl wrote: post #6

anarazel wrote: post #4

Weird name (cruppstahl, nor for). To me it has third Reich connotations...

Absolutely not for me.

Yes, I guessed that it doesn't have a negative connotation for you. That's why I mentioned it, so you could be aware of what the name brings with it in part of the world - perhaps I should have been a bit more verbose about that.

The background is that Hitler used "Hart wie Kruppstahl, zäh wie Leder, flink wie ein Windhund" (Hard as Steel from Krupp, tough as leather, fast as a greyhound) in a bunch of speeches about how to model the german youth. Additionally Krupp Stahl was using forced labour during the war.

Re: Show HN: Fast integer compression library in C

#9

Post by powturbo » Thu, Jun 18, 2015, 8:48 PM UTC

amalcon wrote: post #5

Interesting, this seems to be a SIMD-optimized implementation of delta compression (or very similar, anyway). That's a clever idea. edit: Apparently this isn't actually a SIMD implementation, so it's basically just a variant of delta compression with no particular advantage (or disadvantage).

libfor benchmarked: https://github.com/powturbo/TurboPFor