Live data from Hacker News

Ask HN: What programming language to learn for a statistician?

news.ycombinator.com

11–14 of 14 posts

Re: Ask HN: What programming language to learn for a statistician?

#12
From a statistics perspective R is the language to learn.

Python is good for data engineering or pipelining, etc - but R is the best for analysis:

- Rstudio is a much more friendly interface than IPython/Jupyter notebooks

- Python's visualization libraries can't come close to ggplot2

- Python lacks an effective grammar of data manipulation better similar to dplyr or magrittr.

I think HN is more engineering focused, hence increased exposure to Python. At the places I've worked/interviewed for data science, 1 was full Python (though they have a high eng bar for data scientists, and very few data engineers), and the rest had a reasonable split of R and Python. Your SO will be fine either way but might find R more intuitive and better suited to statistics work.

Re: Ask HN: What programming language to learn for a statistician?

#13
I'd note that SAS is still used in the public sector and enterprise to a larger degree then you'd think, just because of legacy usage. For example, the FDA had to clarify a few years ago that R was okay, because their regulations required the use of SAS5 formatted data for electronic submissions, and when I worked in a county health department, we used SAS.

Perl was also the bioinformatics golden child for a while, and I expect there are still people using it for that purpose in industry.

That said, looking beyond the public sector I'd look at Python as broadening her prospects more then anything else, just because it's more broadly used in a variety of industries, and general understanding of it is more broadly applicable.

I'd suggest she also learn enough R to import stuff and export stuff. If there are R scripts she needs to use, python can be used to script R from the command line, and she can import data, process it, and be able to export the results back into python as an intermediate step.

Re: Ask HN: What programming language to learn for a statistician?

#14
As a statistician I spend ca. 80% of my time collecting and transforming data. Maybe because I never had the luxury having 1-2 own data engineers doing that for me. Having worked with SAS, SPSS, Matlab and python and tried some other tools I would say that the choice of statistical programming language does not make a big difference. If you once understand a modelling process you can reproduce/use it in any language as long as there is a documented package for it.

On the other side knowing how to work with data is IMHO more important. Being an SQL pro, knowing how to think in data sets instead of data records, when to use flat tables, how to use vectorization and matrix manipulation even for all day tasks especially in "in memory" systems is essential.

I would say SQL + R/python makes a good combination. With that you can solve a lot of problems at least two different ways. R gets integrated step by step in DWHs, what makes a lot easier. I hope SAS dies a short and painful death, but could be also a valid choice.

Post reply on HN