Live data from Hacker News

Advice needed for backing up and hosting large amount of files

news.ycombinator.com

1–10 of 97 posts

Advice needed for backing up and hosting large amount of files

#1
Some of you may know Hong Kong has been attacked by China and most of the pro democratic media companies have shut down.

A number of us have been working hard to backup whatever we can and some oversea universities thankfully would allow hosting on their private library domain.

However I also would like to host these files on a public domain, just to ensure more people can revisit on these events in the future.

I am considering to start a very basic category based (eg event based) website, with text and picture files, while video files (close to 6tb) will be uploaded to censorship resistant sites. And a torrent file that contains all files in that particular page.

It will be ran by my own fund/donation with monero.

What kind of option do I have? I am guessing it wouldn't be safe for me to self hosting, given the nature of these files.

If someone can give me a pointer, that will be great.

Thanks!

Re: Advice needed for backing up and hosting large amount of files

#4
post #2

Have you looked at the Internet Archive or Archive Team? The Internet Archive provides free storage (last I knew from ~2014). https://archive.org/services/docs/api/ias3.html

thanks, this is actually what we used for the initial backup, but what we foresee in the future is how to "get" the information out, because in a few decades, these media name may get forgotten all together. We also need to host the video files, which can be tricky on there.

Re: Advice needed for backing up and hosting large amount of files

#5
I'm not sure what to make of the monero mention, is it a requirement that you can pay anonymously? or do you have a fund that is able wire money? If you're avoiding the eye of China I suppose it's the former.

I believe there's services to "pin" content to the IPFS network, but I'd be surprised if there aren't torrent seedboxes you can pay for with crypto, but I'm afraid I'm short on specifics. Would the idea be, to keep the files available, there would be a wallet that anyone can pay into to pay for hosting ? It's what I assumed we would get with all these blockchain projects but I haven't really seen it yet, there's filecoin and arweave but I don't know if that they are trustworthy for the long haul what with the market crashing

EDIT: After reading some blogs on FileCoin it seems like they fit the bill, and I think my notion of "anyone can fund the maintainance of this specific dataset" is known as a DataDAO and maybe doesn't exist yet?

Post reply on HN