Live data from Hacker News

Ask HN: Suggestions to host 10TB data with a monthly +100TB bandwidth

news.ycombinator.com

181–190 of 199 posts

Re: Ask HN: Suggestions to host 10TB data with a monthly +100TB bandwidth

#181
post #32

Earlier quoted context omitted.

Isn't that enterprise HDD going to be slower for a cloud instance though?

SSDs are definitely not "cost-effective" for 10 TB if that's what you're suggesting.

Unless you need the performance. if you compare a single ssd to a raid 6 with 5+ drives to lower the seek times the ssd will always come on top

Re: Ask HN: Suggestions to host 10TB data with a monthly +100TB bandwidth

#182
post #86

Earlier quoted context omitted.

10TB storage + 100TB bandwidth and S3 will easily be +1000 USD per month, while there are solutions out there that are fast and secure with unrestricted bandwidth for less than 100 USD per month. Magnitude cheaper with same grade in "enterprisey".

Well, I said, if you store small data. For large data, sure, prohibitively expensive! I don’t think many other solutions are equally fast and secure. AWS operation is pretty transparent, documented, audited and used by governments. You can lock it down heavily with IAM and a CMK KMS key, and audit the repository. The physical security is also pretty tight, and there is location redundancy. Even hetzner doesn’t have p…

> Ask HN: Suggestions to host 10TB data with a monthly +100TB bandwidth

Re: Ask HN: Suggestions to host 10TB data with a monthly +100TB bandwidth

#183
post #171

Earlier quoted context omitted.

Man, thanks so much for this. I’m using Wasabi with a Yarkon front end right now and it’s great, but Backblaze/Cloudflare is looking like a serious contender.

FYI, video files (and potentially anything not text/HTML) is prohibited through Cloudlare in their TOS (some services like r2 excluded)

They have updated their TOS a few days ago:

https://blog.cloudflare.com/updated-tos/

The prohibition on non-HTML content seems to only apply to CDN usage now.

Re: Ask HN: Suggestions to host 10TB data with a monthly +100TB bandwidth

#184
post #47

That reminds me of the entertaining "I just want to serve 5 terabytes. Why is this so difficult?" video that someone made inside Google. It satirizes the difficulty of getting things done at production scale. https://www.youtube.com/watch?v=3t6L-FlfeaI

It satirizes corporate ways of doing stuff

Re: Ask HN: Suggestions to host 10TB data with a monthly +100TB bandwidth

#185
post #52

It's impossible to answer this question without more information. What is the use profile of your system? How many clients, how often, what's the burst rate, what kind of reliability do you need? These all change the answer.

"Impossible", yet many others have succeeded commendably... explore what they can do but you cannot. Or else offer examples wherein your constraints exist and drive another solution. "No solution without more info" is a cop-out.

Re: Ask HN: Suggestions to host 10TB data with a monthly +100TB bandwidth

#186
post #124

Earlier quoted context omitted.

Yep, resellers of dedicated machines rent servers in bulk so you can often get boxes for way cheaper than you would directly from the host. Take a look at https://hostingby.design as an example.

I've been using a HostingBy.Design seedbox (formerly Seedbox.io) for years to distribute content to my patrons for 3 years. They have excellent uptime and their customer service is knowledgeable.

I actually signed up for one of their boxes last night based on your recommendation. Good so far.

Re: Ask HN: Suggestions to host 10TB data with a monthly +100TB bandwidth

#187
post #52

It's impossible to answer this question without more information. What is the use profile of your system? How many clients, how often, what's the burst rate, what kind of reliability do you need? These all change the answer.

"Impossible", yet many others have succeeded commendably... explore what they can do but you cannot. Or else offer examples wherein your constraints exist and drive another solution. "No solution without more info" is a cop-out.

I'm sorry, let me clarify since you seem to be very pedantic. It's impossible to answer well without a bunch more information. Yes, there are other answers in this thread, but I would argue they aren't particularly helpful to either OP or any other reader.

It's kind of like someone going to a group of doctors and saying "I'm in pain", and then the doctors start throwing out reasons the person may be in pain and solutions to that pain.

Sure, there may be some interesting ideas there, but it doesn't really do OP any good without describing where the pain is, when it started, if they have any other known conditions, etc. etc.

I know you think you were helping with this comment, but you really weren't.

Re: Ask HN: Suggestions to host 10TB data with a monthly +100TB bandwidth

#188
post #155

Earlier quoted context omitted.

If you just want to be able to sync a directory between multiple devices with encryption options I'd recommend Syncthing. It's dead easy to set up, I've currently got it on a rpi backing up all my photos from my phone while syncing my Obsidian vault beteen my phone and desktop.

I use Syncthing, but how prone is it to data loss of any kind? Bitrot?

The biggest problems in aware of is sync conflicts, which just make things a little difficult. If they're text files it's not so bad, since vimdiff can easily merge. But if they're encrypted or more complex formats ... :/

Re: Ask HN: Suggestions to host 10TB data with a monthly +100TB bandwidth

#189

Earlier quoted context omitted.

"Impossible", yet many others have succeeded commendably... explore what they can do but you cannot. Or else offer examples wherein your constraints exist and drive another solution. "No solution without more info" is a cop-out.

I'm sorry, let me clarify since you seem to be very pedantic. It's impossible to answer well without a bunch more information. Yes, there are other answers in this thread, but I would argue they aren't particularly helpful to either OP or any other reader. It's kind of like someone going to a group of doctors and saying "I'm in pain", and then the doctors start throwing out reasons the person may be in pain and solut…

The comment that is unhelpful is the one that has to be voiced but refuses to participate. You're just creating a clamor where a conversation used to be by adding your noise. If you aren't going to participate in the answer beyond saying "I'm not going to answer." Then just don't.

Re: Ask HN: Suggestions to host 10TB data with a monthly +100TB bandwidth

#190

Depends on what exactly you want to do with it. Hetzner has very cheap Storage boxes (10TB for $20/month with unlimited traffic) but those are closer to FTP boxes with a 10 connection limit. They are also down semi-regularly for maintenance. For rock-solid public hosting Cloudflare is probably a much better bet, but you're also paying 7 times the price. More than a dedicated server to host the files, but you get more…

Been looking at hetzner for their arm cloud offering. But I can’t figure out if instances upgraded or do you need to terminate and rebuild. support seems non existent cos no one answers emails or web chat…

You can rescale cloud servers at hetzner, but you will need to shutdown the server in the process
Post reply on HN