Live data from Hacker News

Parquet-WASM: Rust-based WebAssembly bindings to read and write Parquet data

github.com

41–50 of 136 posts

Re: Parquet-WASM: Rust-based WebAssembly bindings to read and write Parquet data

#41

Can this read and write Parquet files to S3-compatible storage?

It can read from HTTP urls, but you'd need to manage signing the URLs yourself. On the writing side, it currently writes to an ArrayBuffer, which then you could upload to a server or save on the user's machine.

Re: Parquet-WASM: Rust-based WebAssembly bindings to read and write Parquet data

#42
post #3

in my [albeit outdated] experience ArrowJS is quite a bit slower than using native JS types. i feel like crossing the WASM JS boundary is very expensive, especially for anything other than numbers/typed arrays. what are people's experiences with this?

One of the ArrowJS committers here. We have fixed a few significant performance bottlenecks over the last few versions so try again. Also, I'm also ways curious to see specific use cases that are slow so we can make ArrowJS even better. Some limitations are fundamental and you may be better off converting to the corresponding JS types (which should be fast).
Post reply on HN