Koheesio: Nike's Python-based framework to build advanced data-pipelines
1–10 of 75 posts
Re: Koheesio: Nike's Python-based framework to build advanced data-pipelines
#2Another snakemake?
Re: Koheesio: Nike's Python-based framework to build advanced data-pipelines
#3> Koheesio is not in competition with other libraries.
Yes, it is, because nobody wants to run multiple orchestrators, and the "What sets Koheesio apart from other libraries?" section does little to help users decide why they should pick yours.
Workflow orchestration is a mature category, as evidenced by the length of this list: https://github.com/meirwah/awesome-workflow-engines
I would expect someone who's seriously writing a new orchestrator in 2024 to cite the alternatives, their shortcomings, and how you intend to address them. Bonus points if you make a neat little table.
The fact that you're leading with Python does not inspire confidence. Pretty much all workflow orchestrators use Python for their glue, and that's hardly the interesting part.
What were they using at Nike before this?
Re: Koheesio: Nike's Python-based framework to build advanced data-pipelines
#4Had Nike as a client for a period of time, interacted with quite a few people across their data org. There is absolutely no software you want authored by them.
Re: Koheesio: Nike's Python-based framework to build advanced data-pipelines
#5A probably better explanation of what it is and why you might want to use it (or not) can be found here:
https://engineering.nike.com/koheesio/latest/tutorials/onboa...
Re: Koheesio: Nike's Python-based framework to build advanced data-pipelines
#6Had Nike as a client for a period of time, interacted with quite a few people across their data org. There is absolutely no software you want authored by them.
This is just flat out rude.
Re: Koheesio: Nike's Python-based framework to build advanced data-pipelines
#7> Koheesio is not in competition with other libraries. Yes, it is, because nobody wants to run multiple orchestrators, and the "What sets Koheesio apart from other libraries?" section does little to help users decide why they should pick yours. Workflow orchestration is a mature category, as evidenced by the length of this list: https://github.com/meirwah/awesome-workflow-engines I would expect someone who's seriousl…
This is the kind of attitude that makes people, companies, researchers hesitant to publish code online. Its free code for everyone to see, they don't owe you anything. Its not necessarily a "product" for your consumption, its just a repo.
Re: Koheesio: Nike's Python-based framework to build advanced data-pipelines
#8Had Nike as a client for a period of time, interacted with quite a few people across their data org. There is absolutely no software you want authored by them.
This is just flat out rude.
It's a big organization, but I can understand the feeling, because I had the same attitude towards Microsoft, Oracle, Salesforce and many others.
Re: Koheesio: Nike's Python-based framework to build advanced data-pipelines
#9> Koheesio is not in competition with other libraries. Yes, it is, because nobody wants to run multiple orchestrators, and the "What sets Koheesio apart from other libraries?" section does little to help users decide why they should pick yours. Workflow orchestration is a mature category, as evidenced by the length of this list: https://github.com/meirwah/awesome-workflow-engines I would expect someone who's seriousl…
This is the kind of attitude that makes people, companies, researchers hesitant to publish code online. Its free code for everyone to see, they don't owe you anything. Its not necessarily a "product" for your consumption, its just a repo.
I don't think so; this is a corporate project, not an enthusiast's. They probably had to internally justify building it over using an existing solution, so they could simply share their rationale. I am not trying to rain on their parade.
Re: Koheesio: Nike's Python-based framework to build advanced data-pipelines
#10> Koheesio is not in competition with other libraries. Yes, it is, because nobody wants to run multiple orchestrators, and the "What sets Koheesio apart from other libraries?" section does little to help users decide why they should pick yours. Workflow orchestration is a mature category, as evidenced by the length of this list: https://github.com/meirwah/awesome-workflow-engines I would expect someone who's seriousl…
I'll agree that the pages about Koheesio hosted on nike's website are strangely empty of persuasive specifics (seems like generative AI used by someone who was in charge of writing it up lol..), but maybe the authors believe that someone who's seriously considering a data pipeline library would want to look at the actual code (which by the way, is structured quite well). Python doesn't "inspire confidence"? Think of the target audience. The frameworks claims to take typing and tests quite seriously, so perhaps your confidence is gained elsewhere. I didn't go through the codebase because I'm not interested, but your dismissive attitude doesn't radiate good faith