Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Show HN: Gaia – Build pipelines in any programming language

gaia-pipeline.io

Post reply on HN
Print view View original

31–40 of 69 posts

Re: Show HN: Gaia – Build pipelines in any programming language

#31

Post by Kalium »

michelvocks wrote: post #12
sam0x17 wrote: post #6

Yeah, you definitely need a "What are pipelines?" section. From looking over the examples, my impression is this is some kind of job scheduler, like sidekiq.

Thanks for the feedback. You are absolutely right, this needs some more work! We have already defined a "Q&A" section in our github README file ( https://github.com/gaia-pipeline/gaia#questions-and-answers-... ). Does this briefly answer your question or is still too vague?

Some might opine that having to search through upwards of 75% of the length of a page before finding out what problem a tool addresses is a situation possessed of wonderful and bountiful opportunity to become even clearer.

Re: Show HN: Gaia – Build pipelines in any programming language

#35

Post by imhoguy »

michelvocks wrote: post #5
simplify wrote: post #2

Is there an example video somewhere on how this looks in usage?

Hey simplify. Yes, actually when you open the website ( https://gaia-pipeline.io ) it should automatically start the video. Otherwise, have a look here: https://gaia-pipeline.io/video/gaia.mp4

The text in video is unreadable and I hardly understand what happens there actually, just jumping thru some CRUDs without commentary and no way to stop. Dunno, maybe some "Use cases"/"Case study" section could show some killer real project usage.

Re: Show HN: Gaia – Build pipelines in any programming language

#36

Post by 0x8BADF00D »

lalaithion wrote: post #30
michelvocks wrote: post #10

Earlier quoted context omitted.

Thanks for the feedback. I will add that! To answer your question, a pipeline is a real application which consists of at least one function (we call it job). You can compare it with a Jenkins Pipeline ( https://jenkins.io/solutions/pipeline/ ). Therefore, a pipeline is one flow of automation task which consists of one or more steps.

"a pipeline is a real application which consists of at least one function" So.... every application is a pipeline? This really clears very little up for someone not already familiar with the concept. The Jenkins link is about testing and deploying code. Is that the intended use case for this tool as well?

I think they meant it is a replacement for existing CI/CD pipelines. As someone who deals with them every day, I like the simplicity of Gaia pipelines. But it seems it only supports running on the host that Gaia is installed on, whereas Jenkins and Gitlab CI will have the ability to run on multiple agents/build slaves.

Edit: gRPC for events is dope too.

Re: Show HN: Gaia – Build pipelines in any programming language

#37

Post by [deleted] »

peterkelly wrote: post #28

I really don't get it. From looking through the front page of the site, I see a bunch of code examples, but no explanation of how this differs from using Unix with a bunch of programs that each read from stdin and write to stdout. I'm sure there's actually something useful about this product, but the website really doesn't give any indication of what that useful thing is.

[deleted]

Re: Show HN: Gaia – Build pipelines in any programming language

#38

Post by iamwil »

YAML in devop is essentially being used as a declarative language. They do have their place in domain specific applications, and can often be quite powerful.

While being able to write in any language gives you flexibility, I do wonder about maintainability down the line. How would this be addressed? Or it doesn't matter as this sort of code tends to be thrown away?

Re: Show HN: Gaia – Build pipelines in any programming language

#39

Post by paulddraper »

weberc2 wrote: post #26
NightMKoder wrote: post #18

This looks great. To echo other folks’ sentiment - I think you mean CI-like pipelines specifically, though it could be extended to do some other stuff. You probably want to list some concrete use cases on the main site (e.g. CI, cron jobs, ETL?). I’m curious what differences/trade offs there are in Gaia vs something like Argo ( https://github.com/argoproj/argo ) or Buildkite ( https://buildkite.com/ ). It looks like…

Some differences at a glance: argo appears to take a dependency on k8s and buildkite appears to be closed source.

Buildkite agent, Cloudformation stacks, etc. are open source.

Buildkite controller and UI is closed source.

Re: Show HN: Gaia – Build pipelines in any programming language

#40

Post by mondoshawan »

michelvocks wrote: post #14
mtrpcic wrote: post #8

I agree with other commenters that it would be really helpful to understand exactly what you mean by "pipeline", and how they can help/improve a project or workflow. What problem does this solve, and how does it solve that problem better than other solutions? Also, very minor nitpick, but your programming language icons shouldn't be in tags. They appear to be clickable, but do nothing, which gives the appearance that…

Thanks for the feedback. You are absolutely right. I think we have answered those questions on our github readme page ( https://github.com/gaia-pipeline/gaia ) but somehow missed that on our webpage. We will work on that! Edit: Oh and thanks. I will fix the links of the language icons. :-)

Not sure your Github readme covers it all that well, either:

>What is a pipeline? A pipeline is a real application with at least one function (we call it Job). Every programming language can be used as long as gRPC is supported. We offer SDKs to support the development.

What is this and how would I use it? More importantly, why do I want to use it? Every application is "real", but it's not clear what the function takes as input and outputs, or how it's dispatched, or... well, anything.

Post reply on HN