Viewing profile — kootenpv

On phone I typed with a capital letter the correct word but it was considered wrong.

I have 2 popular python projects, one with 4.9k and one with 2.3k stars and I don't qualify :/ https://github.com/kootenpv If anyone knows why pls let me know

Models are cached and not large so the setup time is very low. I'll time it when I get to a PC

Perfect interview questions to get to the juice details haha! The problem is that choice of compression is very much dependent on the sample size, so this is why just choosing the …

Yea, I thought parameters per compression algorithm should indeed be added in a next version :) more compute but definitely an improvement. I think pandas doesn't offer zstd as opt…

Yea zstd is really amazing... if I would choose a single one all the time it'd be zstd for sure.

I can give you this... the larger the data the more useful parquet and compression on it will be...

Yea I am aware of meta hyperparameter approach for ML, except they only focus on accuracy instead of also including train/prediction times in to the equation :) That's what I was r…

Yea, look at jekyll in combination with github pages. You can see my blog for example ( https://vks.ai ), the code is hosted here: https://github.com/kootenpv/kootenpv.github.io

There's TimescaleDB built on top of PostgreSQL.

Indeed, but this is for lossless compression :)

Spot on (I briefly touch on this in the article)! This is why I try to work with cheap-to-compute features. I used to calculate how unique all values were, but ended up taking a sa…

Yea - that is related to genetic programming. That, and using auto-encoders for e.g. image compression are known approaches in "AI". I'm particularly proud of this meta approach an…

I like mine for the fact that it is static and hosted on github pages with a not too bad design. https://vks.ai/

shrynk is not doing any compression itself, it's using ML to do a "meta" approach: it computes features on your data like how many rows, how many columns, how much duplication etc,…

I'm a long time fan of your blog :O

Definitely! I really optimized for "no development time spent" and was just using pandas to extract html tables into csv and just store them :-). 2 lines of code really. I had no i…

Having caught up with the recent episodes I was laughing at the similarity with the TV-show Silicon Valley :) I'll explain the reason why I made the shrynk library. It began when m…

Privacy & Personal Analytics I am working on an open-source implementation that is based on the fundamental idea of privacy. The consumers should have full control eventually. For …

I'm happy to share with you the result of this project, it certainly has been a lot of fun! First of all it was shocking how many messages we had over such a long time (more than 3…

The best article I have read in a long time.