Live data from Hacker News

Pandas Exercises for Data Analysis (Interactive)

machinelearningplus.com

31–35 of 35 posts

Re: Pandas Exercises for Data Analysis (Interactive)

#32

Pandas is terrific, yet even its original author has noted inherent shortcomings [1], and there exist alternatives. Polars seems to be the most prominent competitor in the Python DataFrame space, and DuckDB appears to pursue an approach similar to SQLite, but columnar. I am personally working on a solution to a broader problem, which can also be viewed as an alternative to Pandas [2]. [1] https://wesmckinney.com/blog…

For your link [1], many of those issues have been addressed with pandas 2.0 (which I believe Wes Mckinney [pandas' original author] contributed to). So it's a bit disingenuous to point to that post and say "See? Even Wes disowns it!"

That being said, if I were to start a new project requiring that kind of work today, I would probably try Polars first. Their greenfield implementation allowed them to get rid of many of the crusty edges of pandas.

Re: Pandas Exercises for Data Analysis (Interactive)

#33
post #24

Earlier quoted context omitted.

That's exactly why I am reluctant to do anything with Polars. They are actively running a company and trying to sell a product. At any point they could be acquired and change the license for new releases. Sure you could fork it, or stay on an older version, but if what they offer isn't compelling enough for you then why take the risk? Pandas on the other hand has been open source for almost two decades, and is suppor…

I would broaden the list of risks: - Pandas is interwoven into downstream projects. So it will be here to stay for a long time. This is good for maintenance and stability. Advantage: Pandas. - OTOH, the Pandas experience is awful; this was obvious to many from the outset, and yet it persisted. I haven't tracked the history. But my guess would be the competition from Polars was a key pressure for improvement. Edge: Po…

[deleted]

Re: Pandas Exercises for Data Analysis (Interactive)

#34
post #30

Would be nice to have a polars version of this.

Came here to say the same. We use Pandas now only when forced, Polars and DuckDB are the future.

Made this as well for polars: https://machinelearningplus.com/python/101-polars-exercises-...

I was thinking about it for quite a while, but not sure if there would be interest. Thanks for your comment!

Post reply on HN