Live data from Hacker News

Advice needed for backing up and hosting large amount of files

news.ycombinator.com

71–80 of 97 posts

Re: Advice needed for backing up and hosting large amount of files

#71
post #33

Please allow me to offer you a free rsync.net account, in perpetuity, for the backup portion of your requirements. We don’t do hosting of any kind so you’ll have to secure that elsewhere. Just email info@rsync.net to discuss.

I am looking to wean off Dropbox. Do you know if Syncthing in combination with rsync is a good combo?

I forget - isn’t syncthing straight up SFTP ?

Should work perfectly…

Re: Advice needed for backing up and hosting large amount of files

#73

> Some of you may know Hong Kong has been attacked by China and most of the pro democratic media companies have shut down... I also would like to host these files on a public domain, just to ensure more people can revisit on these events in the future. I'm interested now. What happened?

No post body was provided.

Re: Advice needed for backing up and hosting large amount of files

#74
post #42

Earlier quoted context omitted.

Would it be against your ToS if the OP hosted a small $5 Hetzner server that mounted your FS with sshfs and hosted files with a simple proxy?

Don't use hetzner for shit like this. They're EXTREMELY strict on abuse.

Anecdata: Hetzner does not care what files are on their servers as long as you don't also serve them publicly from their servers. So if they only use it as a network storage for another server, it should be fine.

Re: Advice needed for backing up and hosting large amount of files

#75
post #55

Please upload to https://ipfs-gateway.cloud/ 1. This hosting is based on IPFS, which mean the data is immutable and no censorship can be apply, you can retrieve the data from another gateway in this list https://ipfs.github.io/public-gateway-checker/ . You can find out more detail about IPFS here https://ipfs.io/ 2. The owner of this hosting has donated his storage to the community and you can upload for free, this w…

ipfs is transport, not storage.

exactly.

Re: Advice needed for backing up and hosting large amount of files

#76
post #71

Earlier quoted context omitted.

I am looking to wean off Dropbox. Do you know if Syncthing in combination with rsync is a good combo?

I forget - isn’t syncthing straight up SFTP ? Should work perfectly…

Usually every node that share a folder need to have syncthing installed.

The only way to make it work with rsync.net would be to mount a sshfs on a machine running syncthing.

Not sure if the performance will be good.

Maybe with Rclone ?

Re: Advice needed for backing up and hosting large amount of files

#77

I'm planning to look into https://www.storj.io/pricing (150GB free if I understand this correctly) for my own backup needs. You could theoretically host your own node somewhere on a cheap VPS, get credits and pay for your own storage? Not sure - I myself have to do some research. Then you'd need a fronend capable mounting Storj and they seem to have pretty good documentation. Again, unaffiliated, and not tested (yet)…

They also provide S3 compatible gateway meant to be used to share content stored on the bucket publicly.

https://docs.storj.io/dcs/api-reference/s3-compatible-gatewa...

Re: Advice needed for backing up and hosting large amount of files

#78

I'm planning to look into https://www.storj.io/pricing (150GB free if I understand this correctly) for my own backup needs. You could theoretically host your own node somewhere on a cheap VPS, get credits and pay for your own storage? Not sure - I myself have to do some research. Then you'd need a fronend capable mounting Storj and they seem to have pretty good documentation. Again, unaffiliated, and not tested (yet)…

Time4vps is EU. They have excellent prices for storage servers. I've been using one to backup for afew years.

my affiliate link (https://www.time4vps.com/?affid=1881)

Re: Advice needed for backing up and hosting large amount of files

#79
https://web3.storage

regardless of your opinion of crypto, you can get 1TB+ free filecoin storage per account, and have the data pinned 6 times for about 2.5 years. You can later extend the punning, and add estuary.tech and nft.storage for redundancy.

Fast upload, global distributed backups, fast reliable access, but you'll need to encrypt before upload if you don't want them public.

Post reply on HN