Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Status.github.com: “We're failing over a data storage system”

news.ycombinator.com

Post reply on HN
Print view View original

11–20 of 173 posts

Re: Status.github.com: “We're failing over a data storage system”

#11

Post by cesarb »

karaokeyoga wrote: post #4

Is it just me or is that status message wonky? Failing over something to restore access?

In this context, "failing over" means switching the active system to a replica. Which means their primary data storage system had some issue, and they were switching to a secondary data storage system, which hopefully contains the same data (replicated in real time, or nearly real time). Clearly that switch didn't quite work as expected, otherwise it would have taken just a couple of minutes before everything went back to normal...

Re: Status.github.com: “We're failing over a data storage system”

#12

Post by igni »

Before all the trolling about Microsoft starts up, does anyone have current information on what these systems are?

In the enterprise space, a 'data storage system' could be an Array or a SAN or a lightpath etc, with usually quite long failover times. For an org like GitHub I'd think more like an object store (an Array-of-Hosts, if you will) or whatever storage mechanism holds their database files. Do they self host this sort of thing or is it an AWS/GCE/Azure service?

FWIW, all git commands are working fine for me (create a branch, push, colleagues can fetch my branch), but the UI doesn't show my branch & nor can I review/comment on PRs.

Re: Status.github.com: “We're failing over a data storage system”

#13

Post by reindeerer »

igni wrote: post #12

Before all the trolling about Microsoft starts up, does anyone have current information on what these systems are? In the enterprise space, a 'data storage system' could be an Array or a SAN or a lightpath etc, with usually quite long failover times. For an org like GitHub I'd think more like an object store (an Array-of-Hosts, if you will) or whatever storage mechanism holds their database files. Do they self host t…

I think it's obvious that it's their SQL storage that holds the website up that is pretty much in read-only mode, and has been for a couple hours now, not the git repos themselves.

Re: Status.github.com: “We're failing over a data storage system”

#16

Post by geerlingguy »

reindeerer wrote: post #13
igni wrote: post #12

Before all the trolling about Microsoft starts up, does anyone have current information on what these systems are? In the enterprise space, a 'data storage system' could be an Array or a SAN or a lightpath etc, with usually quite long failover times. For an org like GitHub I'd think more like an object store (an Array-of-Hosts, if you will) or whatever storage mechanism holds their database files. Do they self host t…

I think it's obvious that it's their SQL storage that holds the website up that is pretty much in read-only mode, and has been for a couple hours now, not the git repos themselves.

Yeah, been trying to post comments and new issues and keep getting "405 Not Allowed" responses.

Re: Status.github.com: “We're failing over a data storage system”

#18

Post by geerlingguy »

keyle wrote: post #14
dfcowell wrote: post #3

PR comments are also failing with HTTP 405 error code. Great way to start the week.

Well for the poor sods fixing it in the US, it's still Sunday evening...

It's when I typically get an hour or two to crank out some open source PRs and issue queue cleanup. Sadly, the outage means I don't get that time to devote this week :(

Re: Status.github.com: “We're failing over a data storage system”

#20

Post by keyle »

I don't know if they keep changing the text updates with a slightly different version to

- prove it's a human that typed it

- there is code the prevents repeating twice the same message

either way it's entertaining... But it's Monday morning in Australia and we need to release! (yep we do this via pr/tagging etc.)

Post reply on HN