Viewing profile — houqp

Very cool and well executed project. Love the sprinkle of Rust in all the other companion projects as well :) The ROAPI( https://github.com/roapi/roapi ) project I built also happe…

bottomless looks really nice, thanks for sharing!

Haha, yeah, we should definitely put a little bit more efforts into SEO :) Everyone is so focused on the hard-core engineering at the moment. I think Matthew from the community is …

Datafusion out performs spark by a large margin. It is on par with photon based on my experiences, see benchmarks at https://github.com/blaze-init/blaze .

Yes, I designed the code base so that the core of the IO and query logic are abstracted into a Rust library called columnq. My plan is to wrap it with pyo3 so the full API can be a…

Most users already have pip installed, so they won't need to install a rust toolchain.

It's manual for now, ROAPI is designed for slowly moving datasets. You just hit the data update API to force a refresh. I have plan to add automated streaming data update in the ba…

We cache all the data in memory in Arrow format so queries don't need to go through google api, it will only hit google api when a data refresh is needed.

We are hiring new grads across the board if you have proofs for exceptional skills. Feel free to take a look at all our engineering postings at: https://neuralink.com/careers .

Up to 2x speed up with 20% of the resource consumption, pretty wild performance boost without changing a single line of code!