Viewing profile — rogermavis

rogermavis

HN member

No profile information was provided.

comment
Comment #43902043
To ensure I'm not speaking incorrectly (as I was going from memory), I grep'ed my several years' of databricks notes. Oh boy.. the memories came flooding back! We had 8 data engine…

Tue, May 06, 2025, 5:24 AM UTC
comment
Comment #43901934
> you are comparing it here to something that's always on That's the point. Our org was told databricks would solve problems we just didn't have. Serverful has some wonderful advan…

Tue, May 06, 2025, 4:57 AM UTC
comment
Comment #43901869
My stack atm is neovim, python/R, an EC2 and postgres (sometimes Sql Server). Some use of arrow and duckdb. For queries on less than few hundred GB this stack does great. Fast, fam…

Tue, May 06, 2025, 4:39 AM UTC
comment
Comment #43901677
It provides central place to store and query data. A big org might have a few hundred databases for various purposes - databricks lets data engineers set up pipelines to ETL that d…

Tue, May 06, 2025, 3:56 AM UTC