Viewing profile — ritchie46

Rust engineer Polars TYPE: full-time LOCATION: Amsterdam REMOTE: Optional, Based in the Netherlands is preferred VISA: No DESCRIPTION: Polars is the company founded from the Polars…

Polars does that for you.

Python 3.14 "spawns" by default. However, this is not a Polars issue. Using "fork" can leave ANY MUTEX in the system process invalid (a multi-threaded query engine has plenty of mu…

> but quite a bit of pandas code will run as-is with polars I highly doubt this. Aside from dataframe generation and series assignment, almost everything in the API surface is diff…

We have full iceberg read support. We have done some preliminary work for iceberg write support. I think we will ship that once we have decided which Catalog we will add. The icebe…

He means that he wants our Rust library as easy as our Python lib. Which I understand as our focus has been mostly on Python. It is where most of our userbase is and it is very har…

With Polars Cloud you don't have to choose those either. You can pick cpu/memory and we will offer autoscaling in a few months. Cluster configuration is optional if you want this c…

We also target ad-hoc analysis. If your data doesn't fit on your laptop, you can spin up a larger box or a cluster and run interactive queries.

On-premises is in the works. We expect this in a couple of months. Currently it is managed on AWS only.

Not right now. Our current SQLContext locally inspects schema's to convert the SQL to Polars LazyFrames (DSL). However, this should happend during IR-resolving. E.g. the SQL should…

I am not an expert on Spark RDDs, but AFAIK they are a more low-level data structure that offer resilience and a lower level map-reduce API. Polars Cloud maps the Polars API/DSL to…

You don't have to. Passing cpu and memory works as well. pc.ComputeContext{ cpus=4, memory=16 } We are working on a minimal cluster and auto-scaling based on the query.

Your billing partner is AWS. Polars' markup is on your AWS bill.

Hi, I am the original author and CEO of Polars. We are not focused on SQL at this time and provide a DataFrame native API. Polars cloud will for the moment only support our DataFra…

Polars | Rust Engineer | Amsterdam ONSITE / HYBRID At Polars we're building a fast distributed query engine for Polars DataFrames. Our mission is scale DataFrame processing and off…

Polars | Rust engineers | DevOps | FrontEnd | Hybrid Polars is built on the foundation of a vibrant and active open-source community, and we embrace that philosophy in how we run o…

Yes, you can run `pc.remote(my_udf, schema)` Where `def my_udf() -> DataFrame` We link the appropiate Python version at cluster startup.

import polars.col as C C.blah

Disclosure, I am the author of Polars and this post. The difference with Ibis is that Polars cloud will also manage hardware. It is similar to Modal in that sense. You don't have t…

The cluster runs in your own VPC.

Disclosure, I wrote this post. The compute-plane (cluster) will run in your own VPC.

Nothing. Polars -> pola.rs The Polars name and a hint to the .rs file extension.

Great! A small correction on your post. Polars does have SQL suppor. It isn't the main usecase, so it isn't as good as that of Spark and DuckDB, but it does exist and is being impr…

I do think code should be shared when you are benchmarking. He could be using Polars' eager API for instance, which would not be apples to apples.

*COMPANY*: [polars]( https://pola.rs/ ) *TYPE*: full-time *LOCATION*: Amsterdam *REMOTE*: Optional, Based in the Netherlands is preferred *VISA*: No *DESCRIPTION*: Polars is the co…