Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Ask HN: Suggestions to host 10TB data with a monthly +100TB bandwidth

news.ycombinator.com

Post reply on HN
Print view View original

151–160 of 199 posts

Re: Ask HN: Suggestions to host 10TB data with a monthly +100TB bandwidth

#151

Post by nuclearsugar »

GOATS- wrote: post #124
psychphysic wrote: post #56

I'd suggest looking into "seedboxes" which are intended for torrenting. I suspect the storage will be a bigger concern. Seedhost.eu has dedicated boxes with 8TB storage and 100TB bandwidth for €30/month. Perhaps you could have that and a lower spec one to make up the space. Prices are negotiable so you can always see if they can meet your needs for cheaper than two separate boxes.

Yep, resellers of dedicated machines rent servers in bulk so you can often get boxes for way cheaper than you would directly from the host. Take a look at https://hostingby.design as an example.

I've been using a HostingBy.Design seedbox (formerly Seedbox.io) for years to distribute content to my patrons for 3 years. They have excellent uptime and their customer service is knowledgeable.

Re: Ask HN: Suggestions to host 10TB data with a monthly +100TB bandwidth

#152

Post by chaxor »

I always assumed having a raspberry pi with a couple HDs in raid1 with IPFS or torrent would be the best way to do this.

Giving another one of these raid1 rpis to a friend could make it reasonably available.

I am very interested to know if there are good tools around this though, such as a good way to serve a filesystem (nfs-like for example) via torrent/ipfs and if the directories could be password protected in different ways, like with an ACL. That would be the revolutionary tech to replace huggingface/dockerhub, or Dropbox, etc.

Anyone know of or are working on such tech?

Re: Ask HN: Suggestions to host 10TB data with a monthly +100TB bandwidth

#153

Post by foobarbecue »

kens wrote: post #47

That reminds me of the entertaining "I just want to serve 5 terabytes. Why is this so difficult?" video that someone made inside Google. It satirizes the difficulty of getting things done at production scale. https://www.youtube.com/watch?v=3t6L-FlfeaI

This video has always made me wonder: "Why would someone cut open a wet bag of groceries?"

Re: Ask HN: Suggestions to host 10TB data with a monthly +100TB bandwidth

#154

Post by yakubin »

stavros wrote: post #145
yakubin wrote: post #108

Earlier quoted context omitted.

Wow! It's the first time I'm hearing of this Hetzner offering. It's ideal for my offsite backup needs. Thanks!

I think rsync.net is much cheaper. They frequently run offers, I think I pay $40/yr for 2 TB or something.

I don't know about any special offers, but looking at standard pricing on rsync.net it would cost me $15/month for 1TB, while on Hetzner the same would cost me €3.94/month.

Re: Ask HN: Suggestions to host 10TB data with a monthly +100TB bandwidth

#155

Post by Voklen »

chaxor wrote: post #152

I always assumed having a raspberry pi with a couple HDs in raid1 with IPFS or torrent would be the best way to do this. Giving another one of these raid1 rpis to a friend could make it reasonably available. I am very interested to know if there are good tools around this though, such as a good way to serve a filesystem (nfs-like for example) via torrent/ipfs and if the directories could be password protected in diff…

If you just want to be able to sync a directory between multiple devices with encryption options I'd recommend Syncthing. It's dead easy to set up, I've currently got it on a rpi backing up all my photos from my phone while syncing my Obsidian vault beteen my phone and desktop.

Re: Ask HN: Suggestions to host 10TB data with a monthly +100TB bandwidth

#157

Post by rsync »

yakubin wrote: post #154
stavros wrote: post #145

Earlier quoted context omitted.

I think rsync.net is much cheaper. They frequently run offers, I think I pay $40/yr for 2 TB or something.

I don't know about any special offers, but looking at standard pricing on rsync.net it would cost me $15/month for 1TB, while on Hetzner the same would cost me €3.94/month.

Email us … HN readers’ discount, etc.

Re: Ask HN: Suggestions to host 10TB data with a monthly +100TB bandwidth

#158

Post by hatf0 »

fragmede wrote: post #150
wongarsu wrote: post #17

Depends on what exactly you want to do with it. Hetzner has very cheap Storage boxes (10TB for $20/month with unlimited traffic) but those are closer to FTP boxes with a 10 connection limit. They are also down semi-regularly for maintenance. For rock-solid public hosting Cloudflare is probably a much better bet, but you're also paying 7 times the price. More than a dedicated server to host the files, but you get more…

That's if you use their CDN. Cloudflare R2 doesn't charge for egress bandwidth. If you have 100TB/mo to serve, try it and see what happens. I haven't heard of anyone being kicked off of R2 for using too much egress bandwidth yet. At scale, you'll pay a couple thousand dollars for Class B operations on R2, and another bunch for storing the 10 TB in the first place, but that's relatively cheap compared to other offerin…

CF is not particularly fond of non-Enterprise customers serving more than a few TB/mo. Source: $corp serves 150 TB/mo via CF and pays somewhere north of 50k+/yr for it

Re: Ask HN: Suggestions to host 10TB data with a monthly +100TB bandwidth

#159

Post by brianwawok »

trhr wrote: post #114
kens wrote: post #47

That reminds me of the entertaining "I just want to serve 5 terabytes. Why is this so difficult?" video that someone made inside Google. It satirizes the difficulty of getting things done at production scale. https://www.youtube.com/watch?v=3t6L-FlfeaI

Nothing in that video is about scale. Or the difficulty of serving 5TB. It's about the difficulty of implementing n+1 redundancy with graceful failover inside cloud providers. User: "I want to serve 5TB." Guru: "Throw it in a GKE PV and put nginx in front of it." Congratulations, you are already serving 5TB at production scale.

Nginx? You can add cloud CDN with one click to a GCS

Re: Ask HN: Suggestions to host 10TB data with a monthly +100TB bandwidth

#160

Post by qingcharles »

stavros wrote: post #145
yakubin wrote: post #108

Earlier quoted context omitted.

Wow! It's the first time I'm hearing of this Hetzner offering. It's ideal for my offsite backup needs. Thanks!

I think rsync.net is much cheaper. They frequently run offers, I think I pay $40/yr for 2 TB or something.

2TB is currently $324/yr if paid yearly at rsync.net.

I would love to use them as they hang out here, but their prices are way too expensive for my needs.

Post reply on HN