Live data from Hacker News

We saved $500k per year by rolling our own "S3"

engineering.nanit.com

31–40 of 261 posts

Re: We saved $500k per year by rolling our own "S3"

#31
I’m mostly just impressed that some janky baby monitor has racked up server fees on this scale. Amazing example of absolutely horrible engineering.

Also, just take an old phone from your drawer full of old phones, slap some free camera app on it, zip tie a car phone mount to the crib, and boom you have a free baby monitor.

Re: We saved $500k per year by rolling our own "S3"

#33

Earlier quoted context omitted.

It's the government who lost 850TB of citizen data with no backups[0] Because Cloud bad. [0] https://www.techradar.com/pro/security/the-south-korean-gove...

Storing the data in a foreign cloud would allow foreign nation to play funny tricks on the country. What they need is not the cloud but sane backup system.

Isolated partitions exist.

Re: We saved $500k per year by rolling our own "S3"

#34
post #4

I'm curious how many engineers per year this costs to maintain

And I am curious how many engineer years it requires to port code to cloud services and deal with multiple issues you cannot even debug due to not having root privileges in the cloud. Without cloud, saving a file is as simple as "with open(...) as f: f.write(data)" + adding a record to DB. And no weird network issues to debug.

Ah that is where logging and traceability comes in! But not to worry, the cloud has excellent tools for that! The fact that logging and tracing will become half your cloud cost, oh well let's just sweep that under the rug.

Re: We saved $500k per year by rolling our own "S3"

#35
S3 certainly saves a lot of hassle, but in certain use cases, it really is prohibitively expensive. Has anyone tried self-hosted alternatives like MinIO or SeaweedFS? Or taken even more radical approaches? How do you balance between stability, maintenance overhead, and cost savings?

Re: We saved $500k per year by rolling our own "S3"

#36

I’m mostly just impressed that some janky baby monitor has racked up server fees on this scale. Amazing example of absolutely horrible engineering. Also, just take an old phone from your drawer full of old phones, slap some free camera app on it, zip tie a car phone mount to the crib, and boom you have a free baby monitor.

If you don’t have fifty to a hundred dodgy PoE cameras from Alibaba tied to the crib do you even really love the baby?

Re: We saved $500k per year by rolling our own "S3"

#37
post #35

S3 certainly saves a lot of hassle, but in certain use cases, it really is prohibitively expensive. Has anyone tried self-hosted alternatives like MinIO or SeaweedFS? Or taken even more radical approaches? How do you balance between stability, maintenance overhead, and cost savings?

MinIO has moved away from having a free community fork, and I think it's base cost is close to $100k a year. I've been using Garage and been happy, but as a single dev and orders of magnitude smaller than the OP, so there are certainly edge cases I'm missing to compare the two.

Re: We saved $500k per year by rolling our own "S3"

#39
post #17

Earlier quoted context omitted.

A small fraction of 1, probably? It sounds like a fairly simple service that shouldn't require much ongoing development

You're going to run a production system with a bus number of 1? I think you mean a small fraction of 3 engineers. And small fractions aren't that small.

So far I have seen a lot more production systems with a bus factor of zero than production systems with a bus factor greater one.

Re: We saved $500k per year by rolling our own "S3"

#40
So, you want a place to store many files in a short period of time and when there's a new file, somebody must be notified?

Have you ever thought of using a postgresql db (also on aws) to store those files and use CDC to publish messages about those files to a kafka topic? In your original way, we need 3 aws services: s3, lambda and sqs. With this way, we need 2: postgresql and kafka. I'm not sure how well this method works though :-)

Post reply on HN