Viewing profile — tchiotludo

All the issues described in this post lead me to create Kestra [0] . Airflow was a true revolution when it was open-source and we need thanks its innovation. But I totally agree th…

We have launched Kestra (https://github.com/kestra-io/kestra), an open source data scheduling and orchestration platform that features high scalability and availability. To achieve…

First of all, the article published is a retrospective, we are talking from decision in 2019, we can't talk from the past that leed us for a choice? Second, not all issues, some of…

There is no documentation for that for now but it's not complicated: - git clone the project - ./gradlew executableJar - cp build/executable/* docker/app/kestra - docker build -t m…

Sorry, I didn't see your comment before. We provide 2 image tag, one with no plugins and one with all plugin, more information here ; https://kestra.io/docs/administrator-guide/dep…

Temporal.io is a really cool framework for building business process like managing microservice workflow (like paiement workflow: user pay, we call the shipping microservice, the b…

You can easily scale down for small project using a mono node using a simple docker compose setup: https://kestra.io/docs/getting-started/ Working well on a standard laptop easily

I know that that some issues are fixed in Airflow 2, they have made a large improvement with that release. But not all issues is resolved with this one. The performance issue is st…

The title was changed by moderators and I can't edit it anymore :'(

Airflow have design issue and performance issue, If you want to have some details, you can find some reason on this article: https://kestra.io/blogs/2022-02-22-leroy-merlin-usage-k…

The project start as a side project (yet another side project I do the night and weekend) but was quickly promoted and used in a French Big Retail Company. This one trust on the pr…

Do you have a screenshot please ? I didn't notice where. Thanks

Agree that both are expensive to scale on multiple node. But keep in mind, you can use it with a single node (like others do with a database like mysql). Just don't go multiple nod…

Yes, of course! You have 3 solutions for that: - you can use this task using runner:DOCKER property and choose the image: https://kestra.io/plugins/core/tasks/scripts/io.kestra.cor…

Ok got it, every task type are able to logged what they want, so basically, there is one task that is sending dirty output, I add a fix on the roadmap in order to clean this task, …