Viewing profile — albertstanley

Sure, I’ll clarify some of the terms used in that one-liner in case it’s helpful for anyone else as well. ETL is the process of extracting transforming and loading data from a sour…

Sure, our approach is to define Python classes to handle reusable steps for reading, transforming or loading data. For example, we have a MapTransformer, CastColumnsTransformer, Ge…

This is a completely valid point, we'll be changing the readers to directly read into Spark. Thank for the comment!