Live data from Hacker News

Fire destroys S. Korean government's cloud storage system, no backups available

koreajoongangdaily.joins.com

141–150 of 987 posts

Re: Fire destroys S. Korean government's cloud storage system, no backups available

#141
post #13
post #2

> However, due to the system’s large-capacity, low-performance storage structure, no external backups were maintained — meaning all data has been permanently lost. Yikes. You'd think they would at least have one redundant copy of it all. > erasing work files saved individually by some 750,000 civil servants > 30 gigabytes of storage per person That's 22,500 terabytes, about 50 Backblaze storage pods. Or even just mir…

It's even worse. According to other articles [1], the total data of "G drive" was 858 TB. It's almost farcical to calculate, but AWS S3 has pricing of about $0.023/GB/month, which means the South Korean government could have reliable multi-storage backup of the whole data at about $20k/month. Or about $900/month if they opted for "Glacier deep archive" tier ($0.00099/GB/month). They did have backup of the data ... in…

I made an 840TB storage server last month for $15,000.

Re: Fire destroys S. Korean government's cloud storage system, no backups available

#142
post #67
post #60

Earlier quoted context omitted.

The Egyptians send their condolences.

Has there been a more recent event, or are you referring to Alexandria?

https://en.wikipedia.org/wiki/Library_of_Alexandria#Burning_...

the destruction of the library of alexandria is under dispute.

Re: Fire destroys S. Korean government's cloud storage system, no backups available

#143

Earlier quoted context omitted.

Because these companies never lose data, like during some lightning strikes, oh wait: https://www.bbc.com/news/technology-33989384 As a government you should not be putting your stuff in an environment under control of some other nation, period. That is a completely different issue and does not really relate to making backups.

Yeah, I heard that consumer clouds are only locally redundant and there aren't even backups. So big DC damage could result in data loss.

What do you mean by "consumer clouds"?

Re: Fire destroys S. Korean government's cloud storage system, no backups available

#144

Earlier quoted context omitted.

Because these companies never lose data, like during some lightning strikes, oh wait: https://www.bbc.com/news/technology-33989384 As a government you should not be putting your stuff in an environment under control of some other nation, period. That is a completely different issue and does not really relate to making backups.

Yeah, I heard that consumer clouds are only locally redundant and there aren't even backups. So big DC damage could result in data loss.

I mean… at the risk of misinterpreting sarcasm—

Except for the backup strategy said consumers apply to their data themselves, right?

If I use a service called “it is stored in a datacenter in Virginia” then I will not be surprised when the meteor that hits Virginia destroys my data. For that reason I might also store copies of important things using the “it is stored in a datacenter in Oregon” service or something.

Re: Fire destroys S. Korean government's cloud storage system, no backups available

#145
post #74

Earlier quoted context omitted.

Did you expect government IT in a hierarchical respect-your-superiors-even-when-wrong society to be competent?

South Korea isn't some sort of backwards nation and I'm sure it's chaebols share the same culture. Having had unfortunate encounters with government IT in other countries I can bet that the root cause wasn't the national culture. It was the internal culture of "I want to do the same exact same thing I've always done until the day I retire." Absent outside pressure, civil services across the word tend advance scientif…

[deleted]

Re: Fire destroys S. Korean government's cloud storage system, no backups available

#147
I was smirking at this until I remembered that I have just one USB stick as my 'backup'. And that was made a long time ago.

Recently I have been thinking about whether we actually need governments, nation states and all of the hubris that goes with it such as new media. Technically this means 'anarchism' with everyone running riot and chaos. But, that is just a big fear, however, the more I think through the 'no government' idea, the less ludicrous it sounds. Much can be devolved to local government, and so much else isn't really needed.

South Korea's government have kind-of deleted themselves and my suspicion is that, although a bad day for some, life will go on and everything will be just fine. In time some might even be relieved that they don't have this vast data store any more. Regardless, it is an interesting story regarding my thoughts regarding the benefits of no government.

Re: Fire destroys S. Korean government's cloud storage system, no backups available

#148

Meanwhile, Estonia has a "data embassy" in Luxembourg: https://e-estonia.com/solutions/e-governance/data-embassy/ TL;DR: Estonia operates a Tier 4 (highest security) data center in Luxembourg with diplomatic immunity. Can actively run critical government services in real-time, not just backups.

"secured against cyberattacks or crisis situations with KSI Blockchain technology"

hmmmm

Re: Fire destroys S. Korean government's cloud storage system, no backups available

#149
post #42

Mindblowing. Took a walk. All I can say is that if business continues "as usual" and the economy and public services continue largely unaffected then either there were local copies of critical documents, or you can fire a lot of those workers; either one of those ways the "stress test" was a success.

>or you can fire a lot of those workers

Sometimes things can seem to run smoothly for years when neglected... until they suddenly no longer run smoothly!

Re: Fire destroys S. Korean government's cloud storage system, no backups available

#150

The government official who insisted that commercial AWS/GCP/Azure couldn't possibly be trusted with keeping the information will be keeping their head low for a few days then... "The Interior Ministry explained that while most systems at the Daejeon data center are backed up daily to separate equipment within the same center and to a physically remote backup facility, the G-Drive’s structure did not allow for extern…

What a lame excuse. “The G-Drive’s structure did not allow for backups” is a blatant lie. It’s code for, “I don’t value other employees’ time and efforts enough to figure out a reliable backup system; I have better things to do.”

Whoever made this excuse should be demoted to a journeyman ops engineer. Firing would be too good for them.

Post reply on HN