Dolphin Scheduler

#1

Post by based2 » Thu, Dec 26, 2019, 4:32 PM UTC

Re: Dolphin Scheduler

#2

Post by rb808 » Thu, Dec 26, 2019, 5:12 PM UTC

This looks great, I've always wanted something like this. I've always had autosys or controlm at work and they both suck.

I'd just prefer if it had been around longer. Any other open source alternatives out there? I only know of Airflow, k8s Cronjobs.

Re: Dolphin Scheduler

#3

Post by foo_barington » Thu, Dec 26, 2019, 5:12 PM UTC

This may be of interest:

https://github.com/mikub/titanoboa

Re: Dolphin Scheduler

#4

Post by rb808 » Thu, Dec 26, 2019, 5:15 PM UTC

Also interesting that its one of the first open source applications from China I've seen.

Re: Dolphin Scheduler

#5

Post by tbrock » Thu, Dec 26, 2019, 5:33 PM UTC

rb808 wrote: post #2

This looks great, I've always wanted something like this. I've always had autosys or controlm at work and they both suck. I'd just prefer if it had been around longer. Any other open source alternatives out there? I only know of Airflow, k8s Cronjobs.

The only other one I can think of off the top of my head is dagster: https://github.com/dagster-io/dagster

It’s made by Nick Schrock of graphql fame, among others. I’m sure there are 100s of these projects though.

Re: Dolphin Scheduler

#6

Post by Ozzie_osman » Thu, Dec 26, 2019, 6:00 PM UTC

How does this compare to something like Airflow or Luigi?

Re: Dolphin Scheduler

#7

Post by daveFNbuck » Thu, Dec 26, 2019, 6:49 PM UTC

rb808 wrote: post #2

This looks great, I've always wanted something like this. I've always had autosys or controlm at work and they both suck. I'd just prefer if it had been around longer. Any other open source alternatives out there? I only know of Airflow, k8s Cronjobs.

There's also Luigi. https://github.com/spotify/luigi

Re: Dolphin Scheduler

#8

Post by eitland » Thu, Dec 26, 2019, 7:04 PM UTC

foo_barington wrote: post #3

This may be of interest: https://github.com/mikub/titanoboa

That looks interesting but remind me more about Apache Camel.

Re: Dolphin Scheduler

#9

Post by y4mi » Thu, Dec 26, 2019, 7:12 PM UTC

rb808 wrote: post #4

Also interesting that its one of the first open source applications from China I've seen.

I've actually stopped paying attention to https://github.com/vitalets/github-trending-repos because there are so many Chinese repositories each week.

It's just rare to get them on HN, because it's a nightmare to go through their docs and they're usually not even attempting to write their code in English. Basically unusable for all intents and purposes, even if it were quality software.

Re: Dolphin Scheduler

#10

Post by monstrado » Thu, Dec 26, 2019, 7:21 PM UTC

rb808 wrote: post #2

This looks great, I've always wanted something like this. I've always had autosys or controlm at work and they both suck. I'd just prefer if it had been around longer. Any other open source alternatives out there? I only know of Airflow, k8s Cronjobs.

I've had alot of success using Apache NiFi as a distributed scheduler / general purpose workflow tool.