Live data from Hacker News

Is “data scientist” the new “programmer”?

blogs.harvard.edu

11–20 of 246 posts

Re: Is “data scientist” the new “programmer”?

#14
post #4

No. Data scientists exist at the mercy of programmers: without the tooling and the pipes, data science would not be a going concern.

Hah! At my company a decent proportion of engineers spend their lives scrambling to productionalize and operate the Lovecraftian concoctions of R and Python that our data scientists cook up on their laptops.

Where I work, the data scientists are more educated and experienced on containerization, CI tooling, unit testing, profiling tools, web service prototyping including API validation tools, caching layers, queues, GPU systems programming, etc. etc.

We are constantly thwarted by infrastructure teams that use superficial policy basically so they can whine and complain that they don’t want to have to provide support for the extremely heavily researched and tested implementation we create.

They don’t care that different technologies, database systems, whatever are chosen to solve customer use cases and that growing our business means supporting “Lovecraftian concoctions of R and Python” — they just don’t want to do their jobs (which indeed requires providing infrastructure support for crazy screwball data services that repeatedly break all the assumptions)...

Re: Is “data scientist” the new “programmer”?

#15
post #4

No. Data scientists exist at the mercy of programmers: without the tooling and the pipes, data science would not be a going concern.

Hah! At my company a decent proportion of engineers spend their lives scrambling to productionalize and operate the Lovecraftian concoctions of R and Python that our data scientists cook up on their laptops.

It's scary how much this comment applies to my current job. Literally just spent today discussing with entire engineering org how to steer away from this behavior.

Re: Is “data scientist” the new “programmer”?

#17
post #4

No. Data scientists exist at the mercy of programmers: without the tooling and the pipes, data science would not be a going concern.

Well, say that to an actual computer scientist. They will argue without data science/informatics there wouldn't be any computers in the first place. Steven Levy's Hackers is a showcase that it's true. Coders/Programmers/Hackers emerged from that open computer science lab culture. And so on.

Re: Is “data scientist” the new “programmer”?

#19
post #9

The basic premise of the article is that systems programming=irrelevant bloat and abstraction while data reduction=definite purpose and utility People writing python notebooks to do data analysis are probably fairly comparable to the scientific computing programmers of the past, but I feel like this picture tends to dismiss the computer science side of systems programming:things like GUIs, network code, processes and…

Yeah, the author's take is myopic. What they call bloat, people from the 70s would call wondrous: ubiquitous networking with and without wires, beautiful graphical interfaces, encryption everywhere (and expanding), far more open systems than proprietary re-engineered ones, the list goes on and on.
Post reply on HN