Viewing profile — data_ders

I think the advantage is simplicity. Why connect first to duckdb and attach the db when you can query it directly with ADBC which is guaranteed to be fast

Yeah for me standardization is the big win. But not just output formatting but cli commands and a guarantee that they’re as past as possible given that all the connectors use ADBC

Reminds me of the common observance of “machine elves” when taking DMT

thanks for the context! > Auto-generating these dbt models and get the manifest aligned between Dagster code location I just added you on LinkedIn. if you accept my connection ther…

hiya, anders from dbt here. cool project -- I especially love the branching and budgeting options you've built in. both are things that I'd love for the dbt standard to include one…

plus 1 for ADBC!

ok, this is definitely up my alley. color me nerd-sniped and forgive the onslaught of questions. my questions are less about the syntax, which i'm largely familiar with knowing bot…

right? like it's a graph and a relational model query and a pipeline and a language and an abstract syntax tree and declarative logical plan

what do you think is the "most bad" thing about SQL?

TIL about Verse looks cool I'll have to check it out. > SQL is not a pipeline, it is a graph. Maybe it's both? and maybe there will always be hard-to-express queries in SQL, and th…

I'm as big a SQL stan as the next person and I'm also very skeptical anytime anyone says that SQL needs to be replaced. At the same time, it's challenging that SQL cannot be iterat…

I agree that CTEs help solve the problem of being able to read a SQL query from top to bottom, but I wouldn't say they're a panacea! Personally, it's weird to me that `FROM` (scan)…

if I could tell myself in 2015 who had just found the feather library and was using it to power my unhinged topic modeling for power point slides work, and explained what feather w…

yeah not necessarily compute (though it has a kernel)! it's actually many things IPC protocol wire protocol, database connectivity spec etc etc. in reality it's about an in-memory …

love the animations! I’ve been dreaming of doing the same to get people from csvs to something like Lance but with stops at page files, parquet, and Iceberg along the way

same! but if you get it inevitably wrong the first time it gives you the pinyin. but i struggled to get it to transcribe the consonants I was making let alone the tones. i'm pretty…

I'm a big SQL stan here and I love the concept and if you ever wanna chat about how it might integrate with dbt let me know :) conceptual questions: 1) why did you pick SQL? to inc…

omg are you me? I had this exact same problem last week

TIL about triple curlies! mind blown

somehow not being logged into GH enterprise (incognito) lets me access individual files in public repos that I otherwise can't access right now

astronomy data is so fascinating to me? do you have any intel about the architecture they're using? Cloudflare? Iceberg?