Love to see Gunnar continuing to produce great stuff!
Hardwood: A New Parser for Apache Parquet
11–14 of 14 posts
Re: Hardwood: A New Parser for Apache Parquet
#12Excited to see this. Have some upcoming work projects that involve Parquet and Java. Fingers crossed I can get approval to use Java 21.
Re: Hardwood: A New Parser for Apache Parquet
#13Cool! I definitely felt the pain of current options when I added parquet support to Planetiler to process overture data. I ended up using parquet-floor to trim the dependencies but it’s a bit of a hacky approach. If there’s a way to use the lower level utilities from my own threads without hardwood spawning it’s own then I’ll have to give it a shot.
Re: Hardwood: A New Parser for Apache Parquet
#14Respect for doing this. I recently implemented a Parquet reader in Swift using parquet-java as a reference and it was by a long way the hardest bit of coding I’ve done. Your bit unpacking is interesting, is it faster then the 74 KLOC parquet-java bit unpacker?
> recently implemented a Parquet reader in Swift using parquet-java as a reference
Is this open / interested in users / PRs?