Live data from Hacker News

Ask HN: Suggestions to host 10TB data with a monthly +100TB bandwidth

news.ycombinator.com

61–70 of 199 posts

Re: Ask HN: Suggestions to host 10TB data with a monthly +100TB bandwidth

#61
post #55
post #23

Earlier quoted context omitted.

I do my archiving to S3 Glacier Deep Archive but my data volume is still so low that Amazon doesn't bother charging my card.

how much data are we talking about?

Some tens of gigabytes at this point? It's definitely not a lot. Mostly just some stuff that doesn't make sense to keep locally but I still want to have a copy in case a disaster strikes.

Re: Ask HN: Suggestions to host 10TB data with a monthly +100TB bandwidth

#62
post #29

Earlier quoted context omitted.

Does it accumulate month to month and eventually they charge you once a threshold is reached?

I think they'll charge me only when my current monthly statement is enough to charge. Pretty sure I've never been charged so far with my monthly statement being like 0.02€.

I have the same situation with backblaze B2, cents a month bill, they roll that into one ~ yearly charge.

Re: Ask HN: Suggestions to host 10TB data with a monthly +100TB bandwidth

#63
Sounds like you could find someone with a 1Gbps symmetric fiber net connection, and pay them for it and colo. I have 1Gbps and push that bandwidth every month. You know, for yar har har.

And that's only 309Mbits/s (or 39MB/s).

And a used refurbished server you can easily get loads or ram, cores out the wazoo, and dozens of TB's for under $1000. You'll need a rack, router, switch, and batt backup. Shouldn't cost much more than $2000 for this.

Re: Ask HN: Suggestions to host 10TB data with a monthly +100TB bandwidth

#64

I would also like to ask everyone about suggestions for deep storage of personal data, media etc. 10TB with no need for access unless in case of emergency data loss. I'm currently using S3 intelligent tiering.

I like to use rsync.net for backups. You can use something like borg, rsync, or just sftp/sshfs mount. Its not as cheap as something like S3 deep (in terms of storage) but it is pretty convient. The owner is a absolute machine and frequently visits HN too.

Re: Ask HN: Suggestions to host 10TB data with a monthly +100TB bandwidth

#65
post #45

Wasabi, unlimited bandwidth. $5.99/tb/month. Though it is object storage. See: https://wasabi.com/cloud-storage-pricing/#cost-estimates They could really do with making the bandwidth option on this calculator better.

Wasabi does not have any sort of unlimited bandwidth. In fact, they explicitly say that if your download exceeds 100TB/month your use case is not a good fit. https://wasabi.com/paygo-pricing-faq/#free-egress-policy

The 100TB was just an example. They don't want you using more bandwidth than your storage. If you're storing 500GB, then your bandwidth usage should be less than 500GB.

Wasabi isn't meant for scenarios where you're going to be transferring more than you're storing.

Re: Ask HN: Suggestions to host 10TB data with a monthly +100TB bandwidth

#66
post #49

Hetzner auctions have a 4x 6TB server for €39.70/mo. Throw that in RAID10 and you'll have 12TB usable space with > 300TB bandwidth.

Storage Boxes are even cheaper, 20 EUR (or less if you’re outside Europe) for 10TB + unlimited bandwidth.

If we are talking about serving files publicly I'd go with the €40 server for flexibility (the storage boxes are kind of limited), but still get a €20 Storage Box to have a backup of the data. Then add more servers as bandwidth and redundancy requires.

But if splitting your traffic across multiple servers is possible you can also get the €20 storage box and put a couple Hetzner Cloud servers with a caching reverse proxy in front (that's like 10 lines of Nginx config). The cheapest Hetzner Cloud option is the CAX11 with 4GB RAM, 40GB SSD and 20TB traffic for €3,79. Six of those plus the Storage Box gives you the traffic you need, lots of bandwidth for usage peaks, SSD cache for frequently requested files, and easily upgradable storage in the Storage Box, all for €42. Also scales well at $3,79 for every additional 20TB traffic, or $1/TB if you forget and pay fees for the excess traffic instead.

You will be babysitting this more than the $150/month cloudflare solution, but even if you factor in the cost of your time you should come out ahead.

Re: Ask HN: Suggestions to host 10TB data with a monthly +100TB bandwidth

#68
post #8

Wasabi.com is usually a good bet when your primary cost is bandwidth.

> If your monthly egress data transfer is less than or equal to your active storage volume, then your storage use case is a good fit for Wasabi’s free egress policy > If your monthly egress data transfer is greater than your active storage volume, then your storage use case is not a good fit for Wasabi’s free egress policy. https://wasabi.com/paygo-pricing-faq/

wow, that's news to me. thanks for the info.

Re: Ask HN: Suggestions to host 10TB data with a monthly +100TB bandwidth

#70
If it's for internal use, I have had good results with Resilio Sync (formerly BitTorrent Sync).

It's like Dropbox except peer to peer. So it's free, limited only by your client side storage.

The catch is it's only peer to peer (unless they added a managed option), so at least one other peer must be online for sync to take place.

Post reply on HN