Earlier quoted context omitted.
I cannot understand why I would use Python over R. R is designed from the ground up for massive amounts of data processing at speed and with ease. Even if Python continues accreting computational functionality, it will never be as fast or as efficient as R. Improving Python for something R is designed to do seems to me to be a huge waste of time: familiarity should not be the driving force behind replicating R's func…
> R is designed from the ground up for massive amounts of data processing at speed What? The R ecosystem doesn't provide meaningful out of core capabilities, nevermind the ability to handle anything approaching 'massive amounts of data'. -- Would sure love to know why an agenda-less factual comment is getting downvoted.
A book to learn R and Python in parallel for Data Science
61–70 of 90 posts
Re: A book to learn R and Python in parallel for Data Science
#62Earlier quoted context omitted.
> R is designed from the ground up for massive amounts of data processing at speed What? The R ecosystem doesn't provide meaningful out of core capabilities, nevermind the ability to handle anything approaching 'massive amounts of data'. -- Would sure love to know why an agenda-less factual comment is getting downvoted.
In my experience, R is really fast since I t was designed to store data in columnar format which we now all know is best for data analysis. So, in most cases, scaling up computation is quite easy. To scale out, you can use Apache Spark with R, the interface I’ve worked on, sparklyr is quite easy to use and allows you to scale out computation. Just to give you an example of what’s possible, I was playing around yester…
Column stores are standard in any analytics pipeline today. They make up Python's Pandas, R's dplyr, and Java's DataFrame. How or why does R stand out for 'massive amounts of data'?
R does not have have meaningful out of core compute offerings that compare with something like Dask.
R does not at all have cluster compute offerings that compare to Dask Distributed.
If you want to know what real performance looks like, check out Python's cudf which will shortly fully match the Pandas api. That raytracing example you linked would run at interactive rates with cudf, I really don't see any basis for perf arguments in R's favour, and 'massive data' arguments are laughable here.
Whatever advantages R has, perf or scalability are definitely not amongst them.
Re: A book to learn R and Python in parallel for Data Science
#63I sometimes wonder is there any reason to learn R at all, since python eco system has absorbed most of its advanced statistical functionality, coupled with the factor that python environment is much more general, with capabilities to fetch, decode/encoded data,work with binary data databases, web frameworks for presenting etc.
I don't think there's any reason to learn R for anyone who is already proficient at programming. Despite being proficient with R, the only times I used it in the last two years were for ggplot. And even for data vis, I'm increasingly using Python and JS. There's a bunch of comments below which can be summed up with 'use R because doesn't have a direct python equivalent' but they're all missing the point that the Pyth…
Re: A book to learn R and Python in parallel for Data Science
#64Python and Julia might make more sense today.
Re: A book to learn R and Python in parallel for Data Science
#65Rather than R vs Python I hope one of two things happen. Either both languages get replaced by a 'better' ML language eg Swift / Julia giving us users a 'turtles all the way down' experience and removing the reliance on complied packages. Or, second option, they get relegated even further into being nothing but glue between some common data formats specific to the type of work found in DS allowing you the user basically a choice between syntactic-sugar of one glue-language versus the other. Something like Apache Arrow springs to mind but I'm not sure where they are at the moment
Re: A book to learn R and Python in parallel for Data Science
#66R has a nice web development framework called Shiny. While it is not comparable to say Django or Flask, Shiny does make it incredibly easy to share data analysis. If one wants to share statistical analysis or create a data oriented dashboard, then there is definitely a reason to consider R and Shiny. Note that Python has Dash, which is comparable to Shiny, but it is less mature as far as I know. While previously Shin…
Re: A book to learn R and Python in parallel for Data Science
#67Earlier quoted context omitted.
I use both Python and R. tidyverse/ggplot2 alone are enough reason to use R, and are substantially faster for tasks that utilize those packages than the equivalent in Python (in my opinion). Although I haven't had as much reason to use base R. For more ML-related tasks I do go back to Python.
Here here. Tidyverse also provides a centralised 'this is how you do X' nexus really helps discover-ability. World class stuff, on tap. For example, I know the recommended pipe in R is magrittr's %>%. I have no idea what the respectable pipe library in Python is, or even if there is one. I wouldn't even know where to start finding all the tidyverse equivalents in Python. It isn't as organised and obvious as the R sta…
Re: A book to learn R and Python in parallel for Data Science
#68Shouldn't '<-' be used instead of '=' for variable assignments, as they aren't the same thing in R.
There's a good explanation here: https://stackoverflow.com/questions/1741820/what-are-the-dif...
Re: A book to learn R and Python in parallel for Data Science
#69Shouldn't '<-' be used instead of '=' for variable assignments, as they aren't the same thing in R.
e.g.
divide = function(x, y) {
return(x/y)
}
divide(y = 2, x = 1)
divide(y
These two calls give the same result, as the second results in assignment and then passing the argument by position. Other than this case, they are exactly interchangeable.Re: A book to learn R and Python in parallel for Data Science
#70Python and Julia might make more sense today.
Is Julia actually used that much? I've been hearing people herald it as the next big thing for the last five years or so, but it doesn't seem like it has taken off. I personally don't know anybody who uses it professionally (I know plenty of people who use R professionally). The most recent SO survey also indicates that it is rather unpopular.