Viewing profile — marsupialtail_2

Butterfly flies 2600 miles across the ocean just to be caught by a human in a jar to be DNA sequenced ...

The sincerest form of flattery is when AWS decides to come up with a big consortium to displace you with some open source. Incidentally the most effectively way to stall a project …

code: https://github.com/Vince7778/Emojile

No just curious. I understand how your indexing structure based on SSTables could find it challenging to support substring search in general. I think it tradeoff between fast query…

Glad this is getting some love. This is seriously good software. Have you guys supported generic substring search yet? I recall it was not supported as of a few months ago.

Thanks for the shoutout!

Yes but there is also the inverse carrot problem. E.g. if the pilots have radar, they are more liable to rely on it and neglect other aspects of flying. Similarly in business, it i…

Hi Justin, you might be interested in my blog: https://github.com/marsupialtail/quokka/blob/master/blog/bac... advocating a cloud based approach. You don't have to use the system I…

Perhaps I charged too little when I contracted away my 10x random forest inference solution...

SQL support is very challenging. I work on Quokka ( https://github.com/marsupialtail/quokka ). I support Iceberg reads. Recently we are adding SQL support from just parsing the Duc…

While we are on this topic, the challenge with data lakes for Python based projects like Daft and Quokka (what I work on) is the poor Python support for data lakes like Delta, Iceb…

Hi -- I am the author of Quokka: https://github.com/marsupialtail/quokka , trying to be distributed Polars. I am trying to go for API compatibility, or at least supporting most of …

Open for rebuttals from vector database vendors, especially this one: https://github.com/jdagdelen/hyperDB

You will always be limited by network throughput. Sure that wire is getting bigger but so is your data

In case people are interested, I wrote a post about fault tolerance strategies of data systems like Spark and Flink: https://github.com/marsupialtail/quokka/blob/master/blog/fau...…

I hope in a good way

Can you comment on main differences between this and Aurora?

It's more about the API -- currently the API mimics Polars. I actually use DuckDB for a lot of the computation.

would love to collaborate on an integration with pyquokka ( https://github.com/marsupialtail/quokka ) once I put out a stable release end of this month :-)

If you work on a project long enough eventually you forget about how parts of your project work, and this automatically happens

This could be a nice benchmark for a http client. I wonder if anybody with experience with reqwest in Rust could chime in. Currently using aiohttp I can get around 1k requests/s fr…