91–100 of 374 posts
If you have good sysadmin/devops types, this is a few racks of storage in a datacenter. Ceph is pretty good at managing something this size, and offers an S3 interface to the data (with a few quirks). We were mostly storing massive keys that were many gigabytes, so if you have smaller keys, so I'm not sure about performance/scalding limits with smaller keys and 10PB. I'd be sure to give your team a few months to buil…
The is amazing. Thank you. I’ve been looking at Backblaze storage pods that seem to be designed for that use case. Never rented rack space. Do you remember somehow the math on how much cheaper it was or how you thought about upfront cost vs ongoing. Just order of magnitude would be great.
Earlier quoted context omitted.
10x Supermicro SSG-6049P-E1CR60H servers (60 x 3,5" HDD in 4U enclosure) - $5k each 600x WESTERN DIGITAL Ultrastar DC HC550 18TB (10800PB in total) - $500 each ~$350k in hardware, up to 20kW energy consumption, should fit in two rack towers. You can host it for about $1.5k somewhere. All assuming no redundancy :)
Don’t forget labor. You need to find talent to manage your little data center. And deal with it when it shits the bed at 4:12am on Christmas morning. So toss in at least one SRE type person. Say $200k/year. Since you only have one, they are gonna be on call 24/7, so assume you’ll burn them out after a year and a half and need to hire a new one.... Since redundancy is a thing, double that $350k. And 10pb is what they…
This person's entire job is managing a few racks of hard drives? How often do you think they're actually going to get called in?
> Since redundancy is a thing, double that $350k.
True, but you can do redundancy for cheaper with parity or tape.
> And 10pb is what they have now so double it again for 20pb.
> So probably you are looking at a million dollars of capital plus labor to actually execute on this.
You can go a couple PB at a time if the upfront cost is daunting.
> Add in $10k per rack for switches, routers, wires, etc.
Yep, though that's not very much in comparison.
> Plus all the configuration management that needs to be built up. Not to mention monitoring. So maybe a quarter of work just to have it functional.
This is the one I'd really worry about.
> I haven’t even factored in opportunity costs. What could this business be doing that adds more value than building out a little data center?
You always have to keep opportunity costs in mind, but something like this can pay for itself in under a year if there's significant bandwidth cost too, and that's an amazing ROI.
Earlier quoted context omitted.
If you can solve that for me without affecting revenue I have $1m in cash for you right there. We are a photo/video storage service.
So from a completely evil (well, capitalist) perspective, do you have data on how often people retrieve backups, and at what 'age' they do so? Because there may be an inflection point that offering monetary compensation for data loss, rather than actually trying to store the data, would make more financial sense. I.e., "All data > than 2 years gets silently expunged, and anyone trying to retrieve it at that point get…
Earlier quoted context omitted.
You could probably put a fun marketing spin on that. "We use ML to ensure we only store the highest quality data, freeing you from the chains of having too much worthless data and nothing to do with it."
GPT-3 that convinces you why you don't need to store this thing
Here's an unpopular answer - don't store 10PB of data. Find a way for your startup to work without needlessly having to store insane amounts of data that will likely never be needed.
If you can solve that for me without affecting revenue I have $1m in cash for you right there. We are a photo/video storage service.
Sticking points I see are, 1. If you get it wrong you'll need some form of UX that keeps the users from getting to angry about it. 2. The cost of moving the data between hot/cold storage might make this prohibitive until a much larger scale. 3. User behaviors might not be predictable enough.
If you have good sysadmin/devops types, this is a few racks of storage in a datacenter. Ceph is pretty good at managing something this size, and offers an S3 interface to the data (with a few quirks). We were mostly storing massive keys that were many gigabytes, so if you have smaller keys, so I'm not sure about performance/scalding limits with smaller keys and 10PB. I'd be sure to give your team a few months to buil…
The is amazing. Thank you. I’ve been looking at Backblaze storage pods that seem to be designed for that use case. Never rented rack space. Do you remember somehow the math on how much cheaper it was or how you thought about upfront cost vs ongoing. Just order of magnitude would be great.
Note that we were getting significantly cheaper bandwidth than S3 and similar providers, which made up over half of our savings.