Live data from Hacker News

Data wrangling in Elixir with Explorer, the power of Rust, the elegance of R

news.livebook.dev

11–20 of 56 posts

Re: Data wrangling in Elixir with Explorer, the power of Rust, the elegance of R

#11
post #4

Whoa, you know this is hacker news right? You don't get to call R elegant around these parts.

I think R is elegant, what's inelegant in it (other than the code lots of non-programmers write with it)?

The type system is so abhorrent, it makes me wonder if it's actually proper to call R a real programming language

Re: Data wrangling in Elixir with Explorer, the power of Rust, the elegance of R

#12
post #5

Hi everyone, member of the Livebook team here. We’ve been investing a lot in making Elixir great for data exploration. Today we’re taking one step further in this journey by contributing to the Explorer library and integrating it with Livebook. Explorer is an Elixir dataframe library built on top of Polars (from Rust) and inspired by dplyr (from R). Its integration with Livebook (open-source code notebook for Elixir)…

Can you make a pitch to a Python/R user to give this a try? What you’ve built looks very nice and heard nothing but good things about elixir elsewhere, but would take a lot to leave those much more robust ecosystems. Do you hope to grow into that over time? Is there enough in terms of viz, statistical models, and ml to survive?

I'm pitching it to the data science department of the company I work for (huge insurance company in my Country) next week.

They do a lot of prototyping from CSV/parquet sources in Python and R.

I've waited to show them Livebook because Elixir syntax is somewhat alien to many, but now that the Livebook team has integrated ML models and dataframes (Explorer through polar.rs) as smart cells, I think they have a killer feature in their hands, much like Liveview was for Phoenix framework.

Let's see how it goes, I'm fairly optimistic about it.

Re: Data wrangling in Elixir with Explorer, the power of Rust, the elegance of R

#14
post #7

Earlier quoted context omitted.

I think R is elegant, what's inelegant in it (other than the code lots of non-programmers write with it)?

It has 4 ways to do object orientation if IIRC, none of which are compatible.

S3, S4, R6, and reference classes. To be fair they are situational and not one size fits all. The stricter ones are mainly used in biostats where significant metadata makes more sense in OO. S3 is nice and easy, primarily just a list with dispatches. Everything else is less so.

Re: Data wrangling in Elixir with Explorer, the power of Rust, the elegance of R

#15
post #7

Earlier quoted context omitted.

It has 4 ways to do object orientation if IIRC, none of which are compatible.

S3, S4, R6, and reference classes. To be fair they are situational and not one size fits all. The stricter ones are mainly used in biostats where significant metadata makes more sense in OO. S3 is nice and easy, primarily just a list with dispatches. Everything else is less so.

Don't forget R7.

https://rconsortium.github.io/OOP-WG/

Re: Data wrangling in Elixir with Explorer, the power of Rust, the elegance of R

#16
post #4

Whoa, you know this is hacker news right? You don't get to call R elegant around these parts.

I remember when we first used R in a stochastic class. The professor (a mathematician) was in love with the language and the students (computer science) considered the language to be the PHP of science.

Re: Data wrangling in Elixir with Explorer, the power of Rust, the elegance of R

#17

Earlier quoted context omitted.

I think R is elegant, what's inelegant in it (other than the code lots of non-programmers write with it)?

The type system is so abhorrent, it makes me wonder if it's actually proper to call R a real programming language

"There are only two kinds of languages: the ones people complain about and the ones nobody uses."

Re: Data wrangling in Elixir with Explorer, the power of Rust, the elegance of R

#19
post #17

Earlier quoted context omitted.

The type system is so abhorrent, it makes me wonder if it's actually proper to call R a real programming language

"There are only two kinds of languages: the ones people complain about and the ones nobody uses."

This crappy quote is always used to justify bad design.

Re: Data wrangling in Elixir with Explorer, the power of Rust, the elegance of R

#20
post #17

Earlier quoted context omitted.

The type system is so abhorrent, it makes me wonder if it's actually proper to call R a real programming language

"There are only two kinds of languages: the ones people complain about and the ones nobody uses."

I'm sorry, did you mean

    [1] "There are only two kinds of languages: the ones people complain about and the ones nobody uses."
:^)
Post reply on HN