Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

HN is up again

news.ycombinator.com

Post reply on HN
Print view View original

301–310 of 390 posts

Re: HN is up again

#301

Post by Pakdef »

sillysaurusx wrote: post #20

HN was down because the failover server also failed: https://twitter.com/HNStatus/status/1545409429113229312 Double disk failure is improbable but not impossible. The most impressive thing is that there seems to be no dataloss, almost whatsoever. Whatever the backup system is, it seems rock solid.

> Double disk failure is improbable but not impossible.

Were they connected on the same power supply? I had 4 different disks fail at the same time before, but they were all in the same PC... (lightning)

Re: HN is up again

#302

Post by sillysaurusx »

dang wrote: post #295
jbverschoor wrote: post #79

Earlier quoted context omitted.

So that means dataloss.. Probably restored from backup. Good news for people who were banned, or for posts that didn't get enough momentum :) edit: Was restored from backup.. so def. dataloss

8 hours of downtime, but not data loss, since there was no data to lose during the downtime. Last post before we went down (2022-07-08 12:46:04 UTC): https://news.ycombinator.com/item?id=32026565 First post once we were back up (2022-07-08 20:30:55 UTC): https://news.ycombinator.com/item?id=32026571 (hey, that's this thread! how'd you do that, tpmx?) So, 7h 45m of downtime. What we don't know is how many posts (or vo…

Curiosity got the better of me. Why was there a 6 ID gap between the last post and first post? The answer seems to be that admins were making posts, which is neat. (There was also one lonely Flexport job ad.)

Is your backup system tied to your API? Algolia is a third party service, and streaming the latest HN data to Algolia seems pretty similar to streaming it to a backup system.

Re: HN is up again

#303

Post by dang »

sillysaurusx wrote: post #302
dang wrote: post #295

Earlier quoted context omitted.

8 hours of downtime, but not data loss, since there was no data to lose during the downtime. Last post before we went down (2022-07-08 12:46:04 UTC): https://news.ycombinator.com/item?id=32026565 First post once we were back up (2022-07-08 20:30:55 UTC): https://news.ycombinator.com/item?id=32026571 (hey, that's this thread! how'd you do that, tpmx?) So, 7h 45m of downtime. What we don't know is how many posts (or vo…

Curiosity got the better of me. Why was there a 6 ID gap between the last post and first post? The answer seems to be that admins were making posts, which is neat. (There was also one lonely Flexport job ad.) Is your backup system tied to your API? Algolia is a third party service, and streaming the latest HN data to Algolia seems pretty similar to streaming it to a backup system.

I posted a bunch of test things and then deleted them.

Re: HN is up again

#305

Post by clepto »

olingern wrote: post #84

While the naysayers will say, "Why isn't this in the cloud?," I think the response times and uptime of hackernews is really impressive. If anyone has a write-up of the infrastructure that runs HN, I would be interested. Maybe startups really can be run off of a rasberry pi

I made the comment that some of our web portals could run off of a raspberry pi perfectly fine, and I wasn’t necessarily suggesting we go do that, but merely trying to get the point across that we don’t need 700 interweaved AWS systems to do what a single host with Apache + Postgres has been doing fine for years.

Re: HN is up again

#307

Post by mikiem »

kabdib wrote: post #231
davedunkin wrote: post #66

Earlier quoted context omitted.

> Double disk failure is improbable but not impossible. It's not even improbable if the disks are the same kind purchased at the same time.

I once had a small fleet of SSDs fail because they had some uptime counters that overflowed after 4.5 years, and that somehow persistently wrecked some internal data structures. It turned them into little, unrecoverable bricks. It was not awesome seeing a bunch of servers go dark in just about the order we had originally powered them on. Not a fun day at all.

You are never going to guess how long the HN SSDs were in the servers... never ever... OK... I'll tell you: 4.5years. I am not even kidding.

Re: HN is up again

#309

Post by kabdib »

mikiem wrote: post #307
kabdib wrote: post #231

Earlier quoted context omitted.

I once had a small fleet of SSDs fail because they had some uptime counters that overflowed after 4.5 years, and that somehow persistently wrecked some internal data structures. It turned them into little, unrecoverable bricks. It was not awesome seeing a bunch of servers go dark in just about the order we had originally powered them on. Not a fun day at all.

You are never going to guess how long the HN SSDs were in the servers... never ever... OK... I'll tell you: 4.5years. I am not even kidding.

Let me narrow my guess: They hit 4 years, 206 days and 16 hours . . . or 40,000 hours.

And that they were sold by HP or Dell, and manufactured by SanDisk.

Do I win a prize?

(None of us win prizes on this one).

Re: HN is up again

#310

Post by swyx »

sillysaurusx wrote: post #302
dang wrote: post #295

Earlier quoted context omitted.

8 hours of downtime, but not data loss, since there was no data to lose during the downtime. Last post before we went down (2022-07-08 12:46:04 UTC): https://news.ycombinator.com/item?id=32026565 First post once we were back up (2022-07-08 20:30:55 UTC): https://news.ycombinator.com/item?id=32026571 (hey, that's this thread! how'd you do that, tpmx?) So, 7h 45m of downtime. What we don't know is how many posts (or vo…

Curiosity got the better of me. Why was there a 6 ID gap between the last post and first post? The answer seems to be that admins were making posts, which is neat. (There was also one lonely Flexport job ad.) Is your backup system tied to your API? Algolia is a third party service, and streaming the latest HN data to Algolia seems pretty similar to streaming it to a backup system.

i got that Flexport ad too.. haha kinda alarming if they are the only YC company still hiring
Post reply on HN