Live data from Hacker News

Tell HN: HN was down

news.ycombinator.com

231–240 of 343 posts

Re: Tell HN: HN was down

#231

Earlier quoted context omitted.

Sometimes I'll catch myself absentmindedly reopening the browser and checking two or three front pages, seconds after having just checked them and closed the browser.

That's a sign of addiction and I highly recommend changing your behaviour towards those pages!

I feel like I need to avoid channelling Bob Saget from Half Baked when I say that is not addiction. That's a habit.

Re: Tell HN: HN was down

#232

Earlier quoted context omitted.

Do you carry a literal pager? We use the PagerDuty app.

It may interest you to know that pagers are still a thing, Motorola still makes them, and I know that one major use case is volunteer fire departments I used to work on Motorola Minitor 5 pagers. Looks like they recently released their newest model, the Minitor 7 I wonder if pagers are still used in hospitals? I imagine so

The AUBMC hospital is definitely using them as well as the paramilitary in that country, at least until recently.

Re: Tell HN: HN was down

#233
post #54

When it was down my thought was "damnit, I'll actually have a productive workday now."

Next time you can avoid that fate by opening HN in a private browsing (or whatever your browser calls its equivalent) window. This outage, like the vast majority of HN outages, only affected logged in requests. I suppose you could also just clear your HN cookies in regular browsing window, but then when they fix it you'd have to log in again.

I couldn't access it in private or regular.

Re: Tell HN: HN was down

#234

Earlier quoted context omitted.

Do you carry a literal pager? We use the PagerDuty app.

It may interest you to know that pagers are still a thing, Motorola still makes them, and I know that one major use case is volunteer fire departments I used to work on Motorola Minitor 5 pagers. Looks like they recently released their newest model, the Minitor 7 I wonder if pagers are still used in hospitals? I imagine so

Doctors on call at hospitals also routinely still use pagers. There was a planet money episode on it a couple years ago: https://www.npr.org/2023/12/08/1197955913/doctors-pagers-bee...

Re: Tell HN: HN was down

#235
post #144

Yes, sorry! We're investigating, but my current theory is we got overloaded because I relaxed some of our anti-crawler protections a few days ago. (The reason I did that is that the anti-crawler protections also unfortunately hit some legit users, and we don't want to block legit users. However, it seems that I turned the knobs down too far.) In this case, we also had a secondary failure: PagerDuty woke me up at 5:24…

Frankly, I don't understand why someone would even try to crawl Hacker News.

There is an official dump which doesn't even require parsing HTML at all: https://console.cloud.google.com/marketplace/details/y-combi...

Re: Tell HN: HN was down

#236
post #122

I'm with Hund. Our hn.hund.io page did not catch this because it was requesting the cached, unauthenticated page. It now monitors authentication as well.

You should add a graph of visitors per-minute for the status page for the past 24 hours or so. Would really help for situations like this

Re: Tell HN: HN was down

#237
post #144

Yes, sorry! We're investigating, but my current theory is we got overloaded because I relaxed some of our anti-crawler protections a few days ago. (The reason I did that is that the anti-crawler protections also unfortunately hit some legit users, and we don't want to block legit users. However, it seems that I turned the knobs down too far.) In this case, we also had a secondary failure: PagerDuty woke me up at 5:24…

In a situation like this one, good crisis leadership is essential. dang, HN will help you with tips from vast collected experience (please chip in):

1. Blame: The first thing to do is to point the finger. That doesn't mean analysing the technical issue, which can delay this step and limit your options, but figuring out who is politically easiest to blame. Often, that's the new guy, but outside contractors and vendors without good connections are also a common solution. Even if you are technically responsible for hiring them, you can always push them under the bus with a little skill. This small sacrifice helps unify, focus, and motivate the rest of the team.

2. Emotion: Inject your emotion into the situation and make that the implicit, but indisputable priority. Particularly, outrage and anger - This is completely _____. These people are utterly _____ (I'd use all caps, but that's not allowed on HN). Make sure everyone's attention is over their shoulder, on your emotion, and infect the team with it. Threats are an effective tool here - this is a crisis, and anyone who is calm is not emotionally engaged. Otherwise, they won't care enough about this problem - without you driving them, they probably wouldn't care much at all. Anyway, you don't have time for niceties like empathy or even basic respect.

3. Speed: Respnsiveness to stakeholders is very important. People need answers now. Give them answers they want to hear, outcomes they will be comfortable with. Don't worry if different groups hear different things. Your team will find a way to make it all work - that's their job.

4. Communication: Good communication is essential. Make sure you clearly tell your team what they should be doing; repeat it several times to prevent misunderstanding. Especially people with experience can have minds of their own; keep them on track. The situation is a crisis so you can't take any risks; stay on top of them and everything they do, and give input if you're not certain they are doing exactly what you would be doing.

5. Victimhood: Find a way to turn the tables: Make it about you, and how you're the victim here, and feed the fire with more outrage. With this and outrage, nobody will undermine the team by challenging your ideas or authority, which is the most essential component of a successful outcome. Remember, without you this all falls apart.

Have I missed anything?

Re: Tell HN: HN was down

#238
post #210

Earlier quoted context omitted.

It's entirely possible that this is the smartest place on the internet, but also often dumb. In fact, it seems likely. More of an indictment of the rest of the places on the internet.

> It's entirely possible that this is the smartest place on the internet, but also often dumb. In fact, it seems likely. More of an indictment of the rest of the places on the internet. Almost every (non-troll) online community that is relatively peaceful and has some semblance of moderation to remove flamewars thinks of itself as "the best community". Usually as compared to reddit, though if it's on reddit they will…

> It goes without saying HN is not the smartest or more thoughtful online community.

How does that go without saying? Name some others then, compare and contrast. As-is your argument is just posturing.

Re: Tell HN: HN was down

#239
post #221

It would be a nice feature if hackernews had a simple news.ycombinator.com/status page that I could trust. I don't like loading those some-sketchy-domain/status-right-now sites.

> news.ycombinator.com/status page That's not so useful when news.ycombinator.com is having problems.

True. how about https://ycombinator-status.com or https://status.ycombinator.com. They can drop that link on their official ycombinator.com site just so it is easy to tell that it is legit when they are not down. They can maintain the status for all of their official sites there. Well, with the exception of ycombinator-status.com of course. I guess they can post that status on some-sketchy-domain/status-right-now - LOL!

Maybe ycombinator does have an official status page somewhere, but it is not easy to find if that is the case.

Re: Tell HN: HN was down

#240
post #217
post #189

Earlier quoted context omitted.

How does this happen? Not the person you are asking. Bot operators have an incentive to make crawlers look as much like a human as possible so they do not get blocked. Some of them fail miserably and some nearly succeed. That makes it trivial to accidentally block a real person. I am personally fine with that given I do not pay for this site and have no SLA or contract with it.

some humans also try their best to make themselves look like bots...

You're absolutely right!
Post reply on HN