PyJaws: A Pythonic Way to Define Databricks Jobs and Workflows
1–2 of 2 posts
Re: PyJaws: A Pythonic Way to Define Databricks Jobs and Workflows
#2PyJaws enables declaring Databricks Jobs and Workflows as Python code, allowing for:
- Code Linting
- Formatting
- Parameter Validation
- Modularity and reusability
In addition to those, PyJaws also provides some nice features such as cycle detection out of the box.
Folks who have used Python-based orchestration tools such as Apache Airflow, Luigi and Mage will be familiar with the concepts and the API of PyJaws.