Live data from Hacker News

Advice needed for backing up and hosting large amount of files

news.ycombinator.com

51–60 of 97 posts

Re: Advice needed for backing up and hosting large amount of files

#51
post #42

Earlier quoted context omitted.

Would it be against your ToS if the OP hosted a small $5 Hetzner server that mounted your FS with sshfs and hosted files with a simple proxy?

Don't use hetzner for shit like this. They're EXTREMELY strict on abuse.

[deleted]

Re: Advice needed for backing up and hosting large amount of files

#52
If you want to store a lot of data, the solution is known as an object storage file system.

Check this list: https://datacadamia.com/file/edge_storage

There is a lot of other pricing implied if you want or not retrieve your data but this is mostly one write, several read solution.

Re: Advice needed for backing up and hosting large amount of files

#53
post #42

Earlier quoted context omitted.

Would it be against your ToS if the OP hosted a small $5 Hetzner server that mounted your FS with sshfs and hosted files with a simple proxy?

Don't use hetzner for shit like this. They're EXTREMELY strict on abuse.

https://nixnet.social/notice/AEy1Ug6nABnYuFytTE

Re: Advice needed for backing up and hosting large amount of files

#54
post #43

Please upload to https://ipfs-gateway.cloud/ 1. This hosting is based on IPFS, which mean the data is immutable and no censorship can be apply, you can retrieve the data from another gateway in this list https://ipfs.github.io/public-gateway-checker/ . You can find out more detail about IPFS here https://ipfs.io/ 2. The owner of this hosting has donated his storage to the community and you can upload for free, this w…

IPFS is a good solution in theory, but in my experience it works so poorly in practice that I wouldn't trust it as my only form of archival. Certainly add files to IPFS too if you want, but not exclusively .

Is Dat/hypercore or other similar alternative more reliable in practice? Are torrents better? (But wouldn't tracker hosting be a "chicken vs. egg" issue?)

Re: Advice needed for backing up and hosting large amount of files

#55

Please upload to https://ipfs-gateway.cloud/ 1. This hosting is based on IPFS, which mean the data is immutable and no censorship can be apply, you can retrieve the data from another gateway in this list https://ipfs.github.io/public-gateway-checker/ . You can find out more detail about IPFS here https://ipfs.io/ 2. The owner of this hosting has donated his storage to the community and you can upload for free, this w…

ipfs is transport, not storage.

Re: Advice needed for backing up and hosting large amount of files

#56

I wonder why nobody mentioned torrents over I2P: https://geti2p.net . It's distributed, anonymous and anyone can help without risking to reveal their IP. It's slow of course but might be faster if many people join.

What torrent clients offer native I2P support?

Re: Advice needed for backing up and hosting large amount of files

#57
Everyone here has been jumping in and saying "use my great service" or "use this great service".

But could I be the voice of reason here and jump in and remind the OP and everyone else to avoid putting all their eggs in one basket.

Even if you can't afford to replicate 6TB on multiple services, you should at the very least seriously consider picking, say three hosting services (preferably in different jurisdictions) and putting 2TB in each one.

In terms of offline/non-live backup itself, 6TB is really not that much these days. You could just buy a bunch of high-capacity hard drives, create multiple copies and spread them out via old-school "sneakernet" to your collaborators in different jurisdictions. Sometimes KISS is the best solution.

Re: Advice needed for backing up and hosting large amount of files

#58

Earlier quoted context omitted.

Don't use hetzner for shit like this. They're EXTREMELY strict on abuse.

https://nixnet.social/notice/AEy1Ug6nABnYuFytTE

I think this is the first time I've seen a Pleroma link "in the wild" without me searching for it.

I am very happy it's catching on. Cheers!

Re: Advice needed for backing up and hosting large amount of files

#59

Earlier quoted context omitted.

if you want to stream the video... you need hosting in a neutral country like Switzerland and you will pay a lot for it, especially if it gets any attention at all and the unfriendly government starts to dDos it. You probably want to have it as a set of torrents, mirrors, and pop it up in different locations. Don't rely on a single locale. Again, 6Tb is not a lot. Make a site with nothing but links, hold the data in…

>you need hosting in a neutral country like Switzerland Switzerland is only neutral on paper and has a history of letting itself and it's tech companies influenced by powerful foreign nations (the German-US - Crypto AG scandal , ProtonMail sharing info on some of its French users to the French authorities, etc.) You might get good protection if you're a Swiss citizen living in Switzerland, but if you think Switzerlan…

I don't think Swiss authorities would take down a site with video evidence of human rights abuses at the behest of the Chinese government. But hey, maybe times have changed.
Post reply on HN