Why Are Data Science Leaders Running for the Exit?
1–10 of 102 posts
Re: Why Are Data Science Leaders Running for the Exit?
#2Besides the demands of agile and corporate culture, is there other reasons why data science folks are leaving (if true)? For instance lack of cooperation, or not using the insights/recommendations?
Re: Why Are Data Science Leaders Running for the Exit?
#3Besides the demands of agile and corporate culture, is there other reasons why data science folks are leaving (if true)? For instance lack of cooperation, or not using the insights/recommendations?
Our data scientist left because instead of data science, he ended up doing more ETL and data engineering support than what he originally had signed up for.
A full-time data engineer should probably have been hired.
I wonder if this leads to an analogous discussion as http://wiki.c2.com/?ArchitectsDontCode.
Re: Why Are Data Science Leaders Running for the Exit?
#4Besides the demands of agile and corporate culture, is there other reasons why data science folks are leaving (if true)? For instance lack of cooperation, or not using the insights/recommendations?
Our data scientist left because instead of data science, he ended up doing more ETL and data engineering support than what he originally had signed up for. A full-time data engineer should probably have been hired. I wonder if this leads to an analogous discussion as http://wiki.c2.com/?ArchitectsDontCode .
Not too familiar with the data-this, data-that space. What does a data engineer do? What does a data scientist do? Does either code?
Re: Why Are Data Science Leaders Running for the Exit?
#5Besides the demands of agile and corporate culture, is there other reasons why data science folks are leaving (if true)? For instance lack of cooperation, or not using the insights/recommendations?
Our data scientist left because instead of data science, he ended up doing more ETL and data engineering support than what he originally had signed up for. A full-time data engineer should probably have been hired. I wonder if this leads to an analogous discussion as http://wiki.c2.com/?ArchitectsDontCode .
I know someone who is hired as a data scientist and is mostly doing the same ETL work. The science is literally 10% of the work anyway, and all DS should know that.
Re: Why Are Data Science Leaders Running for the Exit?
#6That's very well put reasons. But another significant reason is very often a highly accurate model is not the right model that an organization wants. Hence when you are taking this modelling exercise to the next level, the whole effort of modelling fails because you have spent your time on something that is not required. Hence the accuracy-sophistication obsession of data scientists - irrespective of they are leaders or just ICs - make it tough to establish their credibility and broader organization vision.
And in many other cases, Media has created a myth of Data Scientists as Magicians, hence a lot of people expect a lot of unknowns from Data Scientists while a lot of people become Data Scientists always expecting to create unknowns and magics which is not going to yield any good better than a mere Exploratory Data Analysis based Insight from Microsoft Excel
Re: Why Are Data Science Leaders Running for the Exit?
#7Earlier quoted context omitted.
Our data scientist left because instead of data science, he ended up doing more ETL and data engineering support than what he originally had signed up for. A full-time data engineer should probably have been hired. I wonder if this leads to an analogous discussion as http://wiki.c2.com/?ArchitectsDontCode .
Not too familiar with the data-this, data-that space. What does a data engineer do? What does a data scientist do? Does either code?
Yes, Ideally, A data scientist works on creating the model or logic while a Data Engineer works on the part of deploying the same.
Re: Why Are Data Science Leaders Running for the Exit?
#8Earlier quoted context omitted.
Our data scientist left because instead of data science, he ended up doing more ETL and data engineering support than what he originally had signed up for. A full-time data engineer should probably have been hired. I wonder if this leads to an analogous discussion as http://wiki.c2.com/?ArchitectsDontCode .
Not too familiar with the data-this, data-that space. What does a data engineer do? What does a data scientist do? Does either code?
They both code. The engineer would pull the data from various sources and structure it in a way that the data scientist is happy with. (Tidy format) The DS would the code the models based on the engineer's work, which takes considerably less time.
Re: Why Are Data Science Leaders Running for the Exit?
#9Earlier quoted context omitted.
Our data scientist left because instead of data science, he ended up doing more ETL and data engineering support than what he originally had signed up for. A full-time data engineer should probably have been hired. I wonder if this leads to an analogous discussion as http://wiki.c2.com/?ArchitectsDontCode .
Not too familiar with the data-this, data-that space. What does a data engineer do? What does a data scientist do? Does either code?
In our environment, the scientist builds the models, the engineer makes them run. Both can code (the scientist to build models, the engineer to execute models).
Re: Why Are Data Science Leaders Running for the Exit?
#10probably some realization that 99% of their actual job is ORDER BY, GROUP BY, SUM...not a bunch of cool math scrawled on a whiteboard
I tried warning people off of this field given that they would be doing sql query monkey work and drawing simple line charts...most definitely not an upgrade from software development like it was sold as