Live data from Hacker News

Show HN: Gaia – Build pipelines in any programming language

gaia-pipeline.io

11–20 of 69 posts

Re: Show HN: Gaia – Build pipelines in any programming language

#11
post #9

How does this manage processes? From the example code it looks like your pipeline keeps running?

Good question! :-) Gaia is basically a scheduler. It automatically starts your pipeline, executes the functions defined in the pipeline and is also responsible for terminating the pipeline process.

Re: Show HN: Gaia – Build pipelines in any programming language

#12
post #6

Yeah, you definitely need a "What are pipelines?" section. From looking over the examples, my impression is this is some kind of job scheduler, like sidekiq.

Thanks for the feedback. You are absolutely right, this needs some more work!

We have already defined a "Q&A" section in our github README file (https://github.com/gaia-pipeline/gaia#questions-and-answers-...). Does this briefly answer your question or is still too vague?

Re: Show HN: Gaia – Build pipelines in any programming language

#13
So, a task/process queue? Is that what this is? How does this vary from the quite mature task/process queues used by media production companies? (Examples include Deadline, and dozens of tested-by-production proprietary queues at every production studio.)

Re: Show HN: Gaia – Build pipelines in any programming language

#14
post #8

I agree with other commenters that it would be really helpful to understand exactly what you mean by "pipeline", and how they can help/improve a project or workflow. What problem does this solve, and how does it solve that problem better than other solutions? Also, very minor nitpick, but your programming language icons shouldn't be in tags. They appear to be clickable, but do nothing, which gives the appearance that…

Thanks for the feedback. You are absolutely right.

I think we have answered those questions on our github readme page (https://github.com/gaia-pipeline/gaia) but somehow missed that on our webpage. We will work on that!

Edit: Oh and thanks. I will fix the links of the language icons. :-)

Re: Show HN: Gaia – Build pipelines in any programming language

#15

So, a task/process queue? Is that what this is? How does this vary from the quite mature task/process queues used by media production companies? (Examples include Deadline, and dozens of tested-by-production proprietary queues at every production studio.)

Hey bsenftner. Could you provide a link or an example of what you mean? :-) I googled "Deadline" but what I've found looks not correct.

I usually compare Gaia with tools like Jenkins and Spinnaker. For example, many people use Jenkins Pipeline (https://jenkins.io/solutions/pipeline/) which allows you to write CI/CD tasks in Groovy. In my opinion, Gaia fulfills this job way better because it doesn't force you to use a specific language. It's also super fast and provides features like the automatic (re)build of your pipelines.

Re: Show HN: Gaia – Build pipelines in any programming language

#16
post #2

Is there an example video somewhere on how this looks in usage?

Hey simplify. Yes, actually when you open the website ( https://gaia-pipeline.io ) it should automatically start the video. Otherwise, have a look here: https://gaia-pipeline.io/video/gaia.mp4

Oh right, I saw that. The reason I forgot about it is because I couldn't find a connection between that and the example code written in several languages.

Re: Show HN: Gaia – Build pipelines in any programming language

#18
This looks great. To echo other folks’ sentiment - I think you mean CI-like pipelines specifically, though it could be extended to do some other stuff. You probably want to list some concrete use cases on the main site (e.g. CI, cron jobs, ETL?).

I’m curious what differences/trade offs there are in Gaia vs something like Argo (https://github.com/argoproj/argo) or Buildkite (https://buildkite.com/). It looks like at least one difference is an actual API for steps rather than bash commands. Is there anything interesting in terms of cross job caching (e.g. saving npm install data) or persistent runners? And obviously - what else am I not thinking about?

Post reply on HN