Using new spark-connect API with PySpark
blog.madhukaraphatak.com