Live data from Hacker News

Concourse CI Hits 1.0.0

concourse.ci

51–60 of 72 posts

Re: Concourse CI Hits 1.0.0

#51
I wish documentation would offer a "Concourse made easy" or something.

I imagine the documentation is currently a work in progress. But starting for example from Github, it is extremely easy to go down a deep dark hole trying to figure out all the new terms: I guess I have to use BOSH, what is BOSH (itself a deep dark hole: uhh, stemcell? How does this relate to all the other similar tools? Why would I commit to using this new tool solely for the sake of Concourse?); now I have to learn a new strange distinction between the otherwise similar English words "job" and "task," something about Garden (yet another hole to travel) and a new meaning for the acronym "TSA" and for some reason the command line utility is called "fly" which has no obvious relationship to the project name (what if the command to interact with git were "spudge"?) can I please just install a .deb and run a service and add a build real quick to try this out?

This could be why it is so common to see Jenkins deployed everywhere. While it is wrongly designed in so many frustrating ways, you can still set it up for real work in an hour or so, and you won't need a dictionary to translate from a unique new jargon into English just to try it out. Every new CI that makes this even one bit harder than Jenkins isn't trying hard enough.

Re: Concourse CI Hits 1.0.0

#52
post #51

I wish documentation would offer a "Concourse made easy" or something. I imagine the documentation is currently a work in progress. But starting for example from Github, it is extremely easy to go down a deep dark hole trying to figure out all the new terms: I guess I have to use BOSH, what is BOSH (itself a deep dark hole: uhh, stemcell? How does this relate to all the other similar tools? Why would I commit to usin…

There is a simple 'vagrant up' you can do that allows you to play with Concourse without needing to learn about all the other tooling such as BOSH. It's a great way to get started. Take a look:

Check out VM setup here: http://concourse.ci/vagrant.html Setting up first pipeline here: http://concourse.ci/using-concourse.html

This gets you going with a local Concourse instance that you can experiment with. You're right that it can feel like "turtles all the way down" (quoting @oblio from earlier today), but you do not need to jump in with BOSH right away.

In regards to how to think about 'job' vs 'task', I like to think of 'Job's as a description of what the module is attempting to achieve. For example in the Concourse team's own pipeline[1] you'll see a 'job' named "deploy". 'Task's are on the other hand the individual things that need to happen in order to complete the 'job'.

-- 1. http://ci.concourse.ci/

Re: Concourse CI Hits 1.0.0

#53

Full Disclosure: I also work at Pivotal on a team that has done a large amount of automation using Concourse (check out our pipelines [1]) Things that we've done so far with Concourse: * A dependency check notifier that based on an RSS feed from various language maintainers: Sends an email, updates our pivotal tracker account, sends a message to our slack channel * A job, that based on the completion of a build will…

Do you have a source on the Travis CI style GitHub Pull Request Analysis? When I looked into Concourse it seemed like this was not supported and that was a dealbreaker for us.

Re: Concourse CI Hits 1.0.0

#54
post #51

I wish documentation would offer a "Concourse made easy" or something. I imagine the documentation is currently a work in progress. But starting for example from Github, it is extremely easy to go down a deep dark hole trying to figure out all the new terms: I guess I have to use BOSH, what is BOSH (itself a deep dark hole: uhh, stemcell? How does this relate to all the other similar tools? Why would I commit to usin…

There is a simple 'vagrant up' you can do that allows you to play with Concourse without needing to learn about all the other tooling such as BOSH. It's a great way to get started. Take a look: Check out VM setup here: http://concourse.ci/vagrant.html Setting up first pipeline here: http://concourse.ci/using-concourse.html This gets you going with a local Concourse instance that you can experiment with. You're right…

Sadly, while it's easy to play with the software this way, the 'vagrant up' implementation is missing a bunch of functionality; you don't get any authentication functionality, and you don't get the ability to attach external workers. Also, as of right now, the vagrant build hasn't even been updated to the 1.0 release; it's still limited to version 0.76.0. So you can't play with this new Concourse release using a vagrant box in the first place.

I've had a brief struggle with trying to get the standalone executables to work under Linux, without any success (I'm told that they probably are incompatible with my server's kernel version; note that the documentation does not state what kernel or OS versions are supported). Similarly, I've had a brief look at what it'd take to set up an install using BOSH.. but it looks like that's going to be a massive undertaking.

As a practical matter, if you want to use Concourse for real work, you probably do have to jump in with BOSH right away, since the standalone versions are likely not to work with your VMs, and the vagrant version is missing critical features and hasn't even been updated to the 1.0 release.

Re: Concourse CI Hits 1.0.0

#55
post #42

Full Disclosure: I also work at Pivotal on a team that has done a large amount of automation using Concourse (check out our pipelines [1]) Things that we've done so far with Concourse: * A dependency check notifier that based on an RSS feed from various language maintainers: Sends an email, updates our pivotal tracker account, sends a message to our slack channel * A job, that based on the completion of a build will…

We've also got a decent example of Concourse use. You can see our pipeline at https://capi.ci.cf-app.com (build details are private, but you see the general pipelines), and our configuration is available at https://github.com/cloudfoundry/capi-ci . Check out ci/pipeline.yml for the goods.

[deleted]

Re: Concourse CI Hits 1.0.0

#56
Congratulations for this release.

However as already seen in the case of GoCD, the success of Concourse will depend on how easy it is to convince Jenkins believers.

The "vs Jenkins page" needs to be augmented with more information regarding workers, plugins and simple jobs scripts.

At the moment that page is not really convincing

1)"Jenkins servers become snowflakes" All configuration is saved on the disk as XML files. Backing them up or putting them in version control is very easy. Restoring Jenkins servers is very easy. I have done this actually.

2)"Jenkins has no first class support for pipelines" True. But Jenkins 2.0 will be designed around pipelines, so once it is released this argument will no longer hold. And even today with 1.x not all organizations use pipelines (or are happy with the existing plugins)

3)"Trying to find the build output log for a failed build in Jenkins can be up to 3 clicks from the home page" That is not really an argument. I get an email when my build fails.

As others have mentioned having readers understand new concepts in order to run/use if effectively is problematic.

The UI is impressive! Congrats! I think you should market this more.

Basically if the effort required to setup Concourse with 2 workers is bigger then setting up the respective Jenkins setup, Concourse adoption will suffer.

It needs to be stressed that for a lot of small/middle sized companies, the build server is just an afterthought. Not everybody has full time people working on setting up pipelines.

Re: Concourse CI Hits 1.0.0

#57
post #36
post #33

Earlier quoted context omitted.

Can you ELI5 Concourse's architecture? (I haven't installed it yet, it's possible that some of my follow up questions are answered by installing Concourse and testing it a bit) I saw this page ( http://concourse.ci/architecture.html ) but it's turtles all the way down... Or just validate if my understanding is correct: Concourse has the following components: * ATC: web UI + job scheduler; can be clustered; uses Postg…

You pretty much got it right. That page is still a bit rough; we'll give it some TLC soon. Workers are just machines running a container management daemon (much like a Docker daemon) and a volume manager (a custom daemon for managing caches and efficient artifact propagation between containers). Not sure how you got to Cloud Foundry though, it's not really related. Garden lives in the Cloud Foundry GitHub organizatio…

I will jump in with a question: what about FreeBSD? Can I have a FreeBSD slave / Garden?

Re: Concourse CI Hits 1.0.0

#58
post #54

Earlier quoted context omitted.

There is a simple 'vagrant up' you can do that allows you to play with Concourse without needing to learn about all the other tooling such as BOSH. It's a great way to get started. Take a look: Check out VM setup here: http://concourse.ci/vagrant.html Setting up first pipeline here: http://concourse.ci/using-concourse.html This gets you going with a local Concourse instance that you can experiment with. You're right…

Sadly, while it's easy to play with the software this way, the 'vagrant up' implementation is missing a bunch of functionality; you don't get any authentication functionality, and you don't get the ability to attach external workers. Also, as of right now, the vagrant build hasn't even been updated to the 1.0 release; it's still limited to version 0.76.0. So you can't play with this new Concourse release using a vagr…

And I just want to add.. I really like Concourse. I'd love to use it instead of Jenkins.

But at the moment, I haven't been able to get it to work, apart from in a vagrant box running an old version of the software, which I can't deploy to a real server, and to which I can't attach workers. Which, from a brass-tacks point of view, means that I haven't be able to get it to work at all.

I'd be thrilled if you can make it less painful to install on a proper server. I totally would jump on board in a heartbeat. But I've already spent a couple days trying to make it work, and I just can't afford to throw more of my time at it right now, particularly since I already have a fully functional (albeit somewhat unpleasant and occasionally unreliable) Jenkins install, which only took me 20 minutes to set up and configure.

I'd be very interested in taking another look if and when the whole install process has been streamlined somewhat! There's lots of promise here; I just can't get into it.

Re: Concourse CI Hits 1.0.0

#59

Full Disclosure: I also work at Pivotal on a team that has done a large amount of automation using Concourse (check out our pipelines [1]) Things that we've done so far with Concourse: * A dependency check notifier that based on an RSS feed from various language maintainers: Sends an email, updates our pivotal tracker account, sends a message to our slack channel * A job, that based on the completion of a build will…

Do you have a source on the Travis CI style GitHub Pull Request Analysis? When I looked into Concourse it seemed like this was not supported and that was a dealbreaker for us.

https://github.com/jtarchie/pullrequest-resource

Re: Concourse CI Hits 1.0.0

#60

Congratulations for this release. However as already seen in the case of GoCD, the success of Concourse will depend on how easy it is to convince Jenkins believers. The "vs Jenkins page" needs to be augmented with more information regarding workers, plugins and simple jobs scripts. At the moment that page is not really convincing 1)"Jenkins servers become snowflakes" All configuration is saved on the disk as XML file…

I think it's less about putting a list of features in a spreadsheet and checking off boxes, and more about how the tool thinks.

Jenkins can "do" the things that Concourse does, if you assemble enough plugins, click through enough configuration pages and write enough shell scripts. But that's not its native way of thinking.

I agree that lots of Jenkins users will look at Concourse, scratch their head and leave it. But for those who switch, it's really that much better. I think it'll spread largely by word of mouth, especially once it begins to appear in downstream distribution channels.

> It needs to be stressed that for a lot of small/middle sized companies, the build server is just an afterthought. Not everybody has full time people working on setting up pipelines.

I'm in a team of four -- two pairs. We maintain and extend a medium-sized app, central to our revenue, that has some surprisingly complex and legally scary business rules.

These days whenever we're annoyed by something, it's common for us to think "how can we get Concourse to do this for us?", instead of checklists or wiki pages or Just Hoping Somebody Remembers.

I think people tend to set up Jenkins and never touch it again because it's scary to tinker with your CI/CD. Concourse is, despite being configured by flat files and a CLI, much more approachable in this regard.

Post reply on HN