Viewing profile — mejakethomas

Snowflake too. Inefficient sql? Crank the virtual warehouse.

Yes! This!!! Volume != Quality

So what I'm hearing is it's not the size of your data that matters, it's how you use it?

Completely agree. Currently staring at 700k+ BigQuery costs annually and accomplished MUCH more with Snowflake at the same price.

This. Snowflake introspection five years ago looks very, very different than today. Mostly due to enhancement requests.

Totally agree with Redshift sentiments. It's been lovely seeing BigQuery and Redshift step their game up over the past 1.5yrs, because they really should have been doing certain th…

This, 100%. It eats/consolidates formerly-disparate costs around the org. Because it's so good. Which makes it look expensive.

It's not expensive. What it can do, successfully, with three engineers was previously impossible with dozens. What IS expensive is not being careful with it.

Ah yes, the common misconception that trades are simplistic! Most trades (!including plumbing!) have VASTLY more stringent requirements than tech, are often more mentally stimulati…

PipelineDB was awesome - built some v. neat things with it 4-5 years ago. Wouldn't use it now since the team went to Confluent. https://ksqldb.io/ functionality is getting close. F…

big fan of what you're doing @ elevated woodworking! gorgeous stuff

Hey cool! Thanks for sharing :)

You'll still have to anonymize IP addresses, since those are classified as personal data in the EU.

(data engineer here) Nice post! It's always fun reading about people being creative and challenging the analytics status quo (aka GA). Besides the joy of doing it yourself, you've …

Totally agree! I'm running a minimalistic version of snowplow's collection/etl infra for under $1 per month, and it works great: https://bostata.com/client-side-instrumentation-for…

I'm at pycon right now, and this is hilarious.

I totally agree