GitHub is down

#1

Post by romellem » Thu, May 04, 2023, 4:07 PM UTC

Re: GitHub is down

#2

Post by openthc » Thu, May 04, 2023, 4:09 PM UTC

Mine looks like (on git push):

  remote: Resolving deltas: 100% (4/4), completed with 4 local objects.
  remote: fatal error in commit_refs
  To $REPO
   ! [remote rejected] main -> main (failure)
  error: failed to push some refs to '$REPO'

Status Page: https://www.githubstatus.com/ -- actually shows red -- it was almost updated as fast as HN.

Re: GitHub is down

#3

Post by ehayes » Thu, May 04, 2023, 4:10 PM UTC

Hmm, will it turn out to be DNS?

Re: GitHub is down

#4

Post by roughly » Thu, May 04, 2023, 4:12 PM UTC

Hearts out to all the GitHub SREs who get to fix this, and all the SREs at GitHub’s customers who get to spend the next week convincing management and their peers that moving git in house won’t result in fewer outages.

Re: GitHub is down

#5

Post by bityard » Thu, May 04, 2023, 4:13 PM UTC

I sense a disturbance in the force...

Re: GitHub is down

#6

Post by gondaloof » Thu, May 04, 2023, 4:14 PM UTC

Everything is down. How can this happen? Many of these services are unrelated, like even the brand-new Codespaces and Copilot are completely down. Do they all have a single point of failure? (Presumably the git server)

Re: GitHub is down

#7

Post by edgyquant » Thu, May 04, 2023, 4:14 PM UTC

Wonder why mine[1] got marked as a duplicate when it was posted first?

1. https://news.ycombinator.com/item?id=35817640

Re: GitHub is down

#8

Post by SketchySeaBeast » Thu, May 04, 2023, 4:15 PM UTC

openthc wrote: post #2

Mine looks like (on git push): remote: Resolving deltas: 100% (4/4), completed with 4 local objects. remote: fatal error in commit_refs To $REPO ! [remote rejected] main -> main (failure) error: failed to push some refs to '$REPO' Status Page: https://www.githubstatus.com/ -- actually shows red -- it was almost updated as fast as HN.

> Status Page: https://www.githubstatus.com/ -- actually shows red -- it was almost updated as fast as HN.

I think we should applaud this when it actually happens. Far too many services are terrible for this. While I'd rather the service not be down, it makes me feel a bit better if they don't lie about it.

Re: GitHub is down

#9

Post by ehayes » Thu, May 04, 2023, 4:16 PM UTC

gondaloof wrote: post #6

Everything is down. How can this happen? Many of these services are unrelated, like even the brand-new Codespaces and Copilot are completely down. Do they all have a single point of failure? (Presumably the git server)

Yeah but they probably all share DNS or something related to networking

Re: GitHub is down

#10

Post by andrewfromx » Thu, May 04, 2023, 4:16 PM UTC

roughly wrote: post #4

Hearts out to all the GitHub SREs who get to fix this, and all the SREs at GitHub’s customers who get to spend the next week convincing management and their peers that moving git in house won’t result in fewer outages.

so true. At this moment everyone's like, well! This is UNACCEPTABLE. We'll just, we'll just... what, what are you going to do better than github?