Dataframely: A polars-native data frame validation library
tech.quantco.com
Dataframely: A polars-native data frame validation library
1–10 of 10 posts
Re: Dataframely: A polars-native data frame validation library
#2[deleted]
Re: Dataframely: A polars-native data frame validation library
#3Just started using Polars, great to learn that data frame validation even exists. Thanks
Re: Dataframely: A polars-native data frame validation library
#4I've used pandas before, and recently became aware of polars as it's part on Nushell by way of a plugin.
Why would you use polars over pandas?
Re: Dataframely: A polars-native data frame validation library
#5I've used pandas before, and recently became aware of polars as it's part on Nushell by way of a plugin. Why would you use polars over pandas?
Better syntax, speed and memory.
Re: Dataframely: A polars-native data frame validation library
#6I've used pandas before, and recently became aware of polars as it's part on Nushell by way of a plugin. Why would you use polars over pandas?
Better syntax, speed and memory.
Seconding this, the syntax feels SQL-like which I'm a fan of since I also sometimes have to write SQL queries. So they keep the mindset sharp and also are a clear paradigm to think in if I need to think about a polars dataframe.
Re: Dataframely: A polars-native data frame validation library
#7Earlier quoted context omitted.
Better syntax, speed and memory.
Seconding this, the syntax feels SQL-like which I'm a fan of since I also sometimes have to write SQL queries. So they keep the mindset sharp and also are a clear paradigm to think in if I need to think about a polars dataframe.
Thanks both, the sql-like syntax is definitely something I'm enjoying in Nushell.
Re: Dataframely: A polars-native data frame validation library
#8I've used pandas before, and recently became aware of polars as it's part on Nushell by way of a plugin. Why would you use polars over pandas?
Something not mentioned yet is that pandas is eager and copies memory quite liberally so even not too large datasets might blow up your RAM. Polars has an eager API but also a lazy one; I know they're also working on a query optimizer for lazy queries so you could theoretically handle even large data on a laptop for example.
Re: Dataframely: A polars-native data frame validation library
#9I've used pandas before, and recently became aware of polars as it's part on Nushell by way of a plugin. Why would you use polars over pandas?
because this way you wouldn't be using pandas. That must be a good reason by itself.
pandas is extremely powerful, but everything seems way more complex than it needs to be.
Re: Dataframely: A polars-native data frame validation library
#10Could you provide some code example panderas vs Dataframely ?