Viewing profile — cmollis

yeah.. i just to a daily cost alert.. it was only 23 trillion dollars this month. i thought, hmm seems kind of high this month.

when I was young, we lived with my grandparents after my parents divorce. My grandfather worked in a factory in trenton, NJ; in fact, both of my grandfathers did..now there are no …

amazing.

yes, so bored. yada yada.. i've been 'obsolete' for 36 years and counting.

i have the most bare-bones plan with an HSA.. for me and my three kids, it was 19K per year.. and that was basically nothing more than catastrophic insurance.. I don't think my pro…

It seems to me that if I were actually the Antichrist, the first thing I would do is identify the antichrist as someone else. Then, I would give a lot of pseudo scientific reasons …

have your kid suffer through measles because you believe some clown on tv.. when you could completely prevent it if you had your kid get the same vaccine you yourself got.

can i run a distributed computation in pola.rs cloud on my own AWS infra? or do I need to run it on-prem?

spark is getting a bit long in the tooth.. interesting to see duckdb integrated with Ray for data-access partitioning across (currently) 3FS. probably a matter of time before they …

...and that's why he spent 250MM on the election. (SpaceX contracts coming soon).

clearly talking his book. whatever.

true spark has existed for years and is a great toolset.. i use it ever day. it's also a huge hassle spinning clusters up and down and configuration is complex. I can execute some …

exactly.. parquet is good for append only.. stream mods to parquet in new partitions.. compact, repeat.

Rust and scala

yes.. that is correct (also worked there 2000-01). Bertelsmann offered 1B to settle the suit with the Labels (including the ones Bertelsmann owned, somewhat ironically) so the subs…

Yes. Duckdb works very well with parquet scans on s3 right now.

we've had tornadoes in NJ..

sounds a bit like what Iceberg does with writes on parquet.

I've been testing duckdb's ability to scan multi-tb parquet datasets in S3. I have to say that i've been pretty impressed with it. I've done some pretty hairy SQL (window functions…

I always thought it was easier to read code than to write it.

Also, duckdb allows you convert scan results directly to both pandas and pl dataframes.. so you can mix and match based on need.

I've been testing polars and duckdb recently.. Polars is an excellent dataframe package.. extremely memory efficient and fast. I've experienced some issues with a hive-partitioning…

1. hacker news.. absolutely my favorite daily web experience. The nerdy eclecticism of the topics, coupled with the stripped-down experience are just unequaled on the Web, in my vi…

+1

ok.. thanks.. I'll try it out. I can think of few use-case that we have where this might be a good alternative to athena.