Earlier quoted context omitted.
Isn't that enterprise HDD going to be slower for a cloud instance though?
SSDs are definitely not "cost-effective" for 10 TB if that's what you're suggesting.
Ask HN: Suggestions to host 10TB data with a monthly +100TB bandwidth
181–190 of 199 posts
Re: Ask HN: Suggestions to host 10TB data with a monthly +100TB bandwidth
#182Earlier quoted context omitted.
10TB storage + 100TB bandwidth and S3 will easily be +1000 USD per month, while there are solutions out there that are fast and secure with unrestricted bandwidth for less than 100 USD per month. Magnitude cheaper with same grade in "enterprisey".
Well, I said, if you store small data. For large data, sure, prohibitively expensive! I don’t think many other solutions are equally fast and secure. AWS operation is pretty transparent, documented, audited and used by governments. You can lock it down heavily with IAM and a CMK KMS key, and audit the repository. The physical security is also pretty tight, and there is location redundancy. Even hetzner doesn’t have p…
Re: Ask HN: Suggestions to host 10TB data with a monthly +100TB bandwidth
#183Earlier quoted context omitted.
Man, thanks so much for this. I’m using Wasabi with a Yarkon front end right now and it’s great, but Backblaze/Cloudflare is looking like a serious contender.
FYI, video files (and potentially anything not text/HTML) is prohibited through Cloudlare in their TOS (some services like r2 excluded)
https://blog.cloudflare.com/updated-tos/
The prohibition on non-HTML content seems to only apply to CDN usage now.
Re: Ask HN: Suggestions to host 10TB data with a monthly +100TB bandwidth
#184That reminds me of the entertaining "I just want to serve 5 terabytes. Why is this so difficult?" video that someone made inside Google. It satirizes the difficulty of getting things done at production scale. https://www.youtube.com/watch?v=3t6L-FlfeaI
Re: Ask HN: Suggestions to host 10TB data with a monthly +100TB bandwidth
#185It's impossible to answer this question without more information. What is the use profile of your system? How many clients, how often, what's the burst rate, what kind of reliability do you need? These all change the answer.
Re: Ask HN: Suggestions to host 10TB data with a monthly +100TB bandwidth
#186Earlier quoted context omitted.
Yep, resellers of dedicated machines rent servers in bulk so you can often get boxes for way cheaper than you would directly from the host. Take a look at https://hostingby.design as an example.
I've been using a HostingBy.Design seedbox (formerly Seedbox.io) for years to distribute content to my patrons for 3 years. They have excellent uptime and their customer service is knowledgeable.
Re: Ask HN: Suggestions to host 10TB data with a monthly +100TB bandwidth
#187It's impossible to answer this question without more information. What is the use profile of your system? How many clients, how often, what's the burst rate, what kind of reliability do you need? These all change the answer.
"Impossible", yet many others have succeeded commendably... explore what they can do but you cannot. Or else offer examples wherein your constraints exist and drive another solution. "No solution without more info" is a cop-out.
It's kind of like someone going to a group of doctors and saying "I'm in pain", and then the doctors start throwing out reasons the person may be in pain and solutions to that pain.
Sure, there may be some interesting ideas there, but it doesn't really do OP any good without describing where the pain is, when it started, if they have any other known conditions, etc. etc.
I know you think you were helping with this comment, but you really weren't.
Re: Ask HN: Suggestions to host 10TB data with a monthly +100TB bandwidth
#188Earlier quoted context omitted.
If you just want to be able to sync a directory between multiple devices with encryption options I'd recommend Syncthing. It's dead easy to set up, I've currently got it on a rpi backing up all my photos from my phone while syncing my Obsidian vault beteen my phone and desktop.
I use Syncthing, but how prone is it to data loss of any kind? Bitrot?
Re: Ask HN: Suggestions to host 10TB data with a monthly +100TB bandwidth
#189Earlier quoted context omitted.
"Impossible", yet many others have succeeded commendably... explore what they can do but you cannot. Or else offer examples wherein your constraints exist and drive another solution. "No solution without more info" is a cop-out.
I'm sorry, let me clarify since you seem to be very pedantic. It's impossible to answer well without a bunch more information. Yes, there are other answers in this thread, but I would argue they aren't particularly helpful to either OP or any other reader. It's kind of like someone going to a group of doctors and saying "I'm in pain", and then the doctors start throwing out reasons the person may be in pain and solut…
Re: Ask HN: Suggestions to host 10TB data with a monthly +100TB bandwidth
#190Depends on what exactly you want to do with it. Hetzner has very cheap Storage boxes (10TB for $20/month with unlimited traffic) but those are closer to FTP boxes with a 10 connection limit. They are also down semi-regularly for maintenance. For rock-solid public hosting Cloudflare is probably a much better bet, but you're also paying 7 times the price. More than a dedicated server to host the files, but you get more…
Been looking at hetzner for their arm cloud offering. But I can’t figure out if instances upgraded or do you need to terminate and rebuild. support seems non existent cos no one answers emails or web chat…