Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Dolphin Scheduler

github.com

Post reply on HN
Print view View original

21–27 of 27 posts

Re: Dolphin Scheduler

#21

Post by bathtub365 »

tasogare wrote: post #12
y4mi wrote: post #9

Earlier quoted context omitted.

I've actually stopped paying attention to https://github.com/vitalets/github-trending-repos because there are so many Chinese repositories each week. It's just rare to get them on HN, because it's a nightmare to go through their docs and they're usually not even attempting to write their code in English. Basically unusable for all intents and purposes, even if it were quality software.

> Basically unusable for all intents and purposes, even if it were quality software. Only if you don’t have anyone who can’t read Chinese on your team. Also most repositories are not documented at well or at all anyway so language hardly matters.

It seems like having only some team members be able to really understand the code would still be a risk.

Re: Dolphin Scheduler

#23

Post by newcrobuzon »

foo_barington wrote: post #3

This may be of interest: https://github.com/mikub/titanoboa

Thanks for linking! There seem to be similarities, but looking (very) briefly at the DolphinScheduler these are the potential differences:

- number of contributors :D

- titanoboa can process even a potentially cyclic graph

- in titanoboa you can write step functions directly in high level programming languages such as clojure and java (so not just bash or python) and deploy them directly during runtime

- the clustering setup in titanoboa is master-less

- titanoboa does not have such direct integration with Spark as it employs some map-reduce patterns internally

But all-in-all I have to say that DolphinScheduler seems quite nice! Also would have to compcomplement it on the nice documentation (again, just briefly skimming through it).

(edit: formatting)

Post reply on HN