Live data from Hacker News

A book to learn R and Python in parallel for Data Science

github.com

71–80 of 90 posts

Re: A book to learn R and Python in parallel for Data Science

#71
post #32

R has a nice web development framework called Shiny. While it is not comparable to say Django or Flask, Shiny does make it incredibly easy to share data analysis. If one wants to share statistical analysis or create a data oriented dashboard, then there is definitely a reason to consider R and Shiny. Note that Python has Dash, which is comparable to Shiny, but it is less mature as far as I know. While previously Shin…

[deleted]

Re: A book to learn R and Python in parallel for Data Science

#72

Earlier quoted context omitted.

In my experience, R is really fast since I t was designed to store data in columnar format which we now all know is best for data analysis. So, in most cases, scaling up computation is quite easy. To scale out, you can use Apache Spark with R, the interface I’ve worked on, sparklyr is quite easy to use and allows you to scale out computation. Just to give you an example of what’s possible, I was playing around yester…

You can plug any compute kernel you want into spark, that's not a pro or con of R. Column stores are standard in any analytics pipeline today. They make up Python's Pandas, R's dplyr, and Java's DataFrame. How or why does R stand out for 'massive amounts of data'? R does not have have meaningful out of core compute offerings that compare with something like Dask. R does not at all have cluster compute offerings that…

> That raytracing example you linked would run at interactive rates with cudf, I really don't see any basis for perf arguments in R's favour, and 'massive data' arguments are laughable here.

I don't see how the "GPU DataFrames" provided in cuDF would enhance a raytracer in any way.

Re: A book to learn R and Python in parallel for Data Science

#73
post #51
post #31

How come there's no source in the git repo? You shouldn't just throw up the PDF and call it a day, github isn't just a trendy file host.

Good point. Just added the code. Thanks!

Thanks for adding the source for all the code snippets. I'd also be interested in the LaTeX (if that's what you used) source for the book itself if you feel like adding that.

Re: A book to learn R and Python in parallel for Data Science

#74
post #32

R has a nice web development framework called Shiny. While it is not comparable to say Django or Flask, Shiny does make it incredibly easy to share data analysis. If one wants to share statistical analysis or create a data oriented dashboard, then there is definitely a reason to consider R and Shiny. Note that Python has Dash, which is comparable to Shiny, but it is less mature as far as I know. While previously Shin…

Dash by plotly is also amazing its like shiny but for python! - we were able to whip together an app that would let you drag and drop xyyy data and get a scatter plot instantly - you can try it here (first load takes 1-2s): https://dash-app-dx9g2r0la6-8000.cloud.kyso.io It was also really easy to make it, maybe 250 lines of python in total (guide to making this app is here: https://kyso.io/KyleOS/creating-an-interact…

I'm not sure if there's a convent way in R Shiny to upload files using drag and drop, but otherwise this would be a dozen lines of code in R, at most. Shiny creates the plumbing and interactivity automatically.

Re: A book to learn R and Python in parallel for Data Science

#75
post #72

Earlier quoted context omitted.

You can plug any compute kernel you want into spark, that's not a pro or con of R. Column stores are standard in any analytics pipeline today. They make up Python's Pandas, R's dplyr, and Java's DataFrame. How or why does R stand out for 'massive amounts of data'? R does not have have meaningful out of core compute offerings that compare with something like Dask. R does not at all have cluster compute offerings that…

> That raytracing example you linked would run at interactive rates with cudf, I really don't see any basis for perf arguments in R's favour, and 'massive data' arguments are laughable here. I don't see how the "GPU DataFrames" provided in cuDF would enhance a raytracer in any way.

You don’t see how a gpu accelerated numeric array would speed up ray tracing?

Re: A book to learn R and Python in parallel for Data Science

#76

Earlier quoted context omitted.

I don't think there's any reason to learn R for anyone who is already proficient at programming. Despite being proficient with R, the only times I used it in the last two years were for ggplot. And even for data vis, I'm increasingly using Python and JS. There's a bunch of comments below which can be summed up with 'use R because doesn't have a direct python equivalent' but they're all missing the point that the Pyth…

Tidyverse is not just some " " -- it's an entire workflow, centered around functional programming and tidy data ( https://vita.had.co.nz/papers/tidy-data.pdf ), and nothing in Python comes close. R has many warts, but its lisp roots and metaprogramming strengths have allowed the tidyverse devs, and other excellent programmers working with R, to dramatically improve the language, and spawn a whole new style of statist…

Can you elaborate on what tidyverse offers you that the python ecosystem doesn't? 'Nothing comes close' is a couple degrees too strong a statement from my experience with R, but maybe you know something I don't.

Re: A book to learn R and Python in parallel for Data Science

#77
post #75
post #72

Earlier quoted context omitted.

> That raytracing example you linked would run at interactive rates with cudf, I really don't see any basis for perf arguments in R's favour, and 'massive data' arguments are laughable here. I don't see how the "GPU DataFrames" provided in cuDF would enhance a raytracer in any way.

You don’t see how a gpu accelerated numeric array would speed up ray tracing?

The bottlenecks for raytracing are primarily in scene traversal/intersection testing--which does not benefit from a GPU-accelerated array structure.

Re: A book to learn R and Python in parallel for Data Science

#78
post #77
post #75

Earlier quoted context omitted.

You don’t see how a gpu accelerated numeric array would speed up ray tracing?

The bottlenecks for raytracing are primarily in scene traversal/intersection testing--which does not benefit from a GPU-accelerated array structure.

You are literally as wrong as it is possible to be wrong.

http://hoxxep.github.io/webgl-ray-tracing-demo/

https://devblogs.nvidia.com/accelerated-ray-tracing-cuda/

Re: A book to learn R and Python in parallel for Data Science

#79
post #78
post #77

Earlier quoted context omitted.

The bottlenecks for raytracing are primarily in scene traversal/intersection testing--which does not benefit from a GPU-accelerated array structure.

You are literally as wrong as it is possible to be wrong. http://hoxxep.github.io/webgl-ray-tracing-demo/ https://devblogs.nvidia.com/accelerated-ray-tracing-cuda/

No, I'm not. I'm well aware of CUDA being used to accelerate raytracing. That cannot be accomplished by simply providing a GPU-accelerated data frame structure, as cuDF provides.

Re: A book to learn R and Python in parallel for Data Science

#80

Earlier quoted context omitted.

In my experience, R is really fast since I t was designed to store data in columnar format which we now all know is best for data analysis. So, in most cases, scaling up computation is quite easy. To scale out, you can use Apache Spark with R, the interface I’ve worked on, sparklyr is quite easy to use and allows you to scale out computation. Just to give you an example of what’s possible, I was playing around yester…

You can plug any compute kernel you want into spark, that's not a pro or con of R. Column stores are standard in any analytics pipeline today. They make up Python's Pandas, R's dplyr, and Java's DataFrame. How or why does R stand out for 'massive amounts of data'? R does not have have meaningful out of core compute offerings that compare with something like Dask. R does not at all have cluster compute offerings that…

You are arguing for Python and speed in the same breath? If you want portable speed, you better "warm up a chair" and master Fortran.

Bonus: modern Fortran is a joy to develop in, far more fun than Python. And you get to compile to machine code, either for a processor or a GPU.

Post reply on HN