Personally, at home, I have ~600 TiB and 2 Gbps without a data cap. I can't justify colo unless I can get 10U for $300/month with 2kW of PDU, 1500 kWh, and 1 GbE uncapped.
This is pretty close:
Ask HN: Suggestions to host 10TB data with a monthly +100TB bandwidth
111–120 of 199 posts
Re: Ask HN: Suggestions to host 10TB data with a monthly +100TB bandwidth
#112whats your budget?
who are you serving it to?
how often does the data change?
is it read only?
What are you optimising for, speed, cost or availability? (pick two)
Re: Ask HN: Suggestions to host 10TB data with a monthly +100TB bandwidth
#113I would go with BunnyCDN at front of some storage.
Re: Ask HN: Suggestions to host 10TB data with a monthly +100TB bandwidth
#114That reminds me of the entertaining "I just want to serve 5 terabytes. Why is this so difficult?" video that someone made inside Google. It satirizes the difficulty of getting things done at production scale. https://www.youtube.com/watch?v=3t6L-FlfeaI
Nothing in that video is about scale. Or the difficulty of serving 5TB. It's about the difficulty of implementing n+1 redundancy with graceful failover inside cloud providers.
User: "I want to serve 5TB."
Guru: "Throw it in a GKE PV and put nginx in front of it."
Congratulations, you are already serving 5TB at production scale.
Re: Ask HN: Suggestions to host 10TB data with a monthly +100TB bandwidth
#115Personally, at home, I have ~600 TiB and 2 Gbps without a data cap. I can't justify colo unless I can get 10U for $300/month with 2kW of PDU, 1500 kWh, and 1 GbE uncapped.
This is pretty close: http://he.net/colocation.html
While Hurricane is nice, they're 1800 miles from me. :)
I'll take the risk of colo within the same region. If this region were gone, my data would be meaningless.
Re: Ask HN: Suggestions to host 10TB data with a monthly +100TB bandwidth
#116Depends on what exactly you want to do with it. Hetzner has very cheap Storage boxes (10TB for $20/month with unlimited traffic) but those are closer to FTP boxes with a 10 connection limit. They are also down semi-regularly for maintenance. For rock-solid public hosting Cloudflare is probably a much better bet, but you're also paying 7 times the price. More than a dedicated server to host the files, but you get more…
> Hetzner has very cheap Storage boxes (10TB for $20/month with unlimited traffic)
* based on fair use
at 250 TB/mo:
> In order to continue hosting your servers with us, the traffic use will need to be drastically reduced. Please check your servers and confirm what is using so much traffic, making sure it is nothing abusive, and then find ways of reducing it.
Re: Ask HN: Suggestions to host 10TB data with a monthly +100TB bandwidth
#117Earlier quoted context omitted.
If we are talking about serving files publicly I'd go with the €40 server for flexibility (the storage boxes are kind of limited), but still get a €20 Storage Box to have a backup of the data. Then add more servers as bandwidth and redundancy requires. But if splitting your traffic across multiple servers is possible you can also get the €20 storage box and put a couple Hetzner Cloud servers with a caching reverse pr…
> even if you factor in the cost of your time you should come out ahead There is always the hidden cost of not spending time on activities that are core to your business (if this is indeed for a business) that would make multiples of the money CF costs you.
There is more and more that can be done like proxmox to help make self hosted as much as an appliance as anything else.
Re: Ask HN: Suggestions to host 10TB data with a monthly +100TB bandwidth
#118Earlier quoted context omitted.
Storage Boxes are even cheaper, 20 EUR (or less if you’re outside Europe) for 10TB + unlimited bandwidth.
1gbit is 300T a month, 10g is 3000T a month. There’s always a limit, that might be measured in TB, PB or EB, and may be what you determine practical or not, but it’s there
Really good way of putting it.
Re: Ask HN: Suggestions to host 10TB data with a monthly +100TB bandwidth
#119I'd suggest looking into "seedboxes" which are intended for torrenting. I suspect the storage will be a bigger concern. Seedhost.eu has dedicated boxes with 8TB storage and 100TB bandwidth for €30/month. Perhaps you could have that and a lower spec one to make up the space. Prices are negotiable so you can always see if they can meet your needs for cheaper than two separate boxes.
Ultra.cc is pretty great too.
Re: Ask HN: Suggestions to host 10TB data with a monthly +100TB bandwidth
#120BuyVM has been around a long time and have a good reputation. I’ve used them on and off for quite a while. They have very reasonably priced KVM instances with unmetered 1G (10G for long-standing customers) bandwidth that you can attach “storage slabs” up to 10TB ($5 per TB/mo). Doubt you will find better value than this for block storage. https://buyvm.net/block-storage-slabs/
Nice. How have you found their uptime and reliability?