What Is Dbt and Why Are Companies Using It?
seattledataguy.substack.com
What Is Dbt and Why Are Companies Using It?
1–10 of 74 posts
Re: What Is Dbt and Why Are Companies Using It?
#2Unfortunate typo: It’s about to be a decade since the Harvard article touting data science as the sexist job in the 21st century.
Re: What Is Dbt and Why Are Companies Using It?
#3> It’s about to be a decade since the Harvard article touting data science as the sexist job in the 21st century.
Re: What Is Dbt and Why Are Companies Using It?
#4I recently applied for a job in a data warehousing team that was using this. The way they were using it replace their transformation stage from legacy tools like SSIS,DataStage and Informatica, It was certainly impressive and looked great to work with. I can see dbt becoming a lot more common moving forwards.
Re: What Is Dbt and Why Are Companies Using It?
#5I am a user, and what sets them apart even beyond the product is the amazing community they have built that celebrates the unsexy aspects of data science. Just watch some videos from their annual conference, people are so excited to talk about rationalizing business logic
Re: What Is Dbt and Why Are Companies Using It?
#6I can't argue that dbt isn't great -- it is. It is, however
, unfortunate that Python is still the dominate lingua franca here. Between all the Python data tools and JSON being shuffled around ala singer.io, I just can't help but think there is a huge opportunity awaiting the engineers who build a company around an open source set of products using rigorous languages and schemas.
It's a goddamn madhouse.
Re: What Is Dbt and Why Are Companies Using It?
#7dbt and ELT in general are such a game-changer for allowing rapid iteration on business logic by data analysts; the feedback loop feels much more like "normal" software engineering compared to legacy systems.
Re: What Is Dbt and Why Are Companies Using It?
#8How long before Amazon incorporates this as one of their services?
Re: What Is Dbt and Why Are Companies Using It?
#9I can't argue that dbt isn't great -- it is. It is, however , unfortunate that Python is still the dominate lingua franca here. Between all the Python data tools and JSON being shuffled around ala singer.io, I just can't help but think there is a huge opportunity awaiting the engineers who build a company around an open source set of products using rigorous languages and schemas. It's a goddamn madhouse.
Well part of the benefit is rapid development; it's mind-boggling how quickly someone can stand up a dbt project and begin to iterate on transforms. Using Python/SQL/JSON (at small/medium) scales keeps the data stack consistent and lowers the barrier to entry. No reason to prematurely optimize when your bottleneck is the modeling and not the actual data volume.
Re: What Is Dbt and Why Are Companies Using It?
#10I can't argue that dbt isn't great -- it is. It is, however , unfortunate that Python is still the dominate lingua franca here. Between all the Python data tools and JSON being shuffled around ala singer.io, I just can't help but think there is a huge opportunity awaiting the engineers who build a company around an open source set of products using rigorous languages and schemas. It's a goddamn madhouse.
Can you give a before/after of what the desired state would look like?