Live data from Hacker News

GitHub Actions Down

news.ycombinator.com

41–50 of 54 posts

Re: GitHub Actions Down

#41

Earlier quoted context omitted.

Azure, .net, office, office 365, teams, ml.net, ... Not a single one i could manage building ( eg. Teams has bots, quick to create apps and pretty advanced cam features)

Teams UX is a hot mess; it's just astonishingly bad.

I sometimes think MS product owners are on coke all the time or something. Last week or so i was in the middle of a conference call and MS teams just decided to restart itself with a new update.

Re: GitHub Actions Down

#42

Earlier quoted context omitted.

What do you use to run the self-hosted runners?

In our case, we use a mac mini solely for building mobile applications via fastlane with a self-runner. Doing that with the GitHub runner on Mac would be mega expensive. The rest of the CI/test process runs on GitHub runners.

Does that work with M1/Apple Silicon Macs or Intel-only?

Re: GitHub Actions Down

#43
post #4

So now I am expecting a major GitHub Actions incident (worst case, the whole of GitHub) to go down every single month at least once. Last time this went down was last month. [0] I now doubt if they can consistently manage more than a month without a major incident like this one. [0] https://news.ycombinator.com/item?id=26666843

Isn't this normal with hosted solutions? IIRC, GitHub, Bitbucket and GitLab.com are all unusable for a few hours at least once a month as far back as I can remember. Isn't this just commonly accepted as a tradeoff for not having to manage the servers yourself?

Nope, this isn't normal at all for products on AWS, GCP, or pretty much any other cloud provider. Azure is simply a subpar product and its time to stop attempting to sweep its awful downtime under the rug.

Re: GitHub Actions Down

#44
post #33

We only use GH Actions for check builds right now, which are easily disabled as a temporary measure. Having the ability to build & deploy your software outside the confines of a cloud vendor is essential to survival. When the automation works, its great. When it doesn't, have a manual process that you can follow on a local workstation. At the end of the day, you can always email the customer a zip file and walk them…

Great advice. How is this managed where you are? Do you share the same code between CI and the local workstation?

Everything required to build our application lives in a single code base & Visual Studio solution. The application is capable of building itself from source.

If you know how to do things like Process.Start, there's really no excuse for not being able to automate your build processes using code. MSBuild has a pretty damn simple set of CLI args if you are just doing modern .NET 3.x/5.x apps.

  git clone 
  cd 
  dotnet build --configuration Release
  //copy build artifacts to where ever they need to go
That's about it for us.

We use SQLite, so there aren't any dependencies outside of any particular checkout of the repo.

Re: GitHub Actions Down

#46

Earlier quoted context omitted.

My wife works as an AWS/Azure consultant, and she mentions that in our area it's much more common for the non-technical management to push Azure than it is for technology to choose it. Sounds quite IBM-ish/Oracle-ish.

I've had a couple of Fortune 500 companies as clients. Microsoft/Azure is usually brought it as a place that is treated like VMs in the cloud. The setup and management is often handled by Accenture and Infosys. Impossible that that decision was made by Engineering. In fact those Accenture managed setups are almost unusable for engineers. I can't even begin to fathom how much these companies spend on Accenture to setu…

I worked on a project automating some parts of an Azure infrastructure for a big company. Half-way through development, JSON integers returned by Azure changed from strings to ints, back to strings. E.g., "42" became 42, then a few weeks later went back to "42".

This and other API weirdness gave me such Azure PTSD that I promised myself I would never touch it again.

Re: GitHub Actions Down

#47
post #20

Earlier quoted context omitted.

I would say it's normal for businesses which are engaged in competitive feature development. Stability & reliability are relatively easy to achieve if you aren't changing the software frequently.

I'm pretty sure they're constantly working on their software (at least GitLab is), so "aren't changing anything" does probably not apply.

That was my point. If you want stability, look for someone who is no longer funding a substantial development team to work on the software.

Re: GitHub Actions Down

#48

We build an Electron app for MacOS regularly. We run these builds on Github’s MacOS VMs. The internet fails to connect when running yarn install about 3 out of every 5 times. We’ve gotten multiple refunds for this issue, but it’s still a complete mess. Unfortunately we’ve built much of our process around GH Actions... if not I’m sure we would be on CircleCI or TravisCI already. We’ve also considered switching to self…

We're using https://next.yarnpkg.com/features/zero-installs , and it gets rid of one off issues like this (unless you have native deps which require an install).

Thank you for the link, looks interesting! I wish this were available in Yarn V1 :/

Re: GitHub Actions Down

#49
post #12

My workflows have been queued for at least four hours. It's a hotfix commit. GitHub Actions helped me a lot in synchronizing updates with other repositories automatically, but this time I have to manually apply it. Because I'm the first time expecting GitHub Actions incident, I was wondering that I ran out of my free quota for this month... By the way, should GitHub send an email to the owner if any workflow has been…

Personally I'd rather they focus on the issue rather than negotiating with PR and legal to formulate an e-mail. If you rely on an external service and don't monitor it that's on you.

What a trite response.

The question was do they do a email if your job is delayed or late for whatever reason?

Not, hey why don't they email us all right now about the issue.

And no, it's not on me to monitor every little thing I rely on. Do you monitor kernel updates? I bet you don't. Besides that monitoring and logging for any provided service is exactly how one is supposed to monitor said external services so asking about monitoring options and being told, look buddy it's your job to monitor for this is just fucking rude.

Re: GitHub Actions Down

#50
post #8

Earlier quoted context omitted.

I was amused by reports when Microsoft was in talks with Discord that one of the reasons why Microsoft wanted to buy Discord was because they wanted Discord on Azure. Like, was the grand customer acquisition strategy for Azure just acquiring the companies and then migrating over?

My wife works as an AWS/Azure consultant, and she mentions that in our area it's much more common for the non-technical management to push Azure than it is for technology to choose it. Sounds quite IBM-ish/Oracle-ish.

That's exactly the situation I'm in at my current work environment now. All Azure, and everyone in Engineering/Devops hates it. It's a business decision though.
Post reply on HN