There are a number of fine options for blob storage (S3, R2, Ceph, Azure Storage, etc.), but with that many documents it's likely access control and audit logging will be important. If that's the case, something heavyweight like SharePoint may be a better choice.
Ask HN: Best document storage solution in 2023
11–15 of 15 posts
Re: Ask HN: Best document storage solution in 2023
#12There are a number of fine options for blob storage (S3, R2, Ceph, Azure Storage, etc.), but with that many documents it's likely access control and audit logging will be important. If that's the case, something heavyweight like SharePoint may be a better choice.
Are those blob storage options significantly cheaper than Google? I fear we are being pushing down a GCP route as it is what out consultancy know, rather than the best solution.
Re: Ask HN: Best document storage solution in 2023
#13There are a number of fine options for blob storage (S3, R2, Ceph, Azure Storage, etc.), but with that many documents it's likely access control and audit logging will be important. If that's the case, something heavyweight like SharePoint may be a better choice.
Are those blob storage options significantly cheaper than Google? I fear we are being pushing down a GCP route as it is what out consultancy know, rather than the best solution.
R2 would probably be significantly cheaper because they don't bill for bandwidth, but S3, GCP storage, and Azure storage would likely be in the same ballpark. Blob storage is a commodity service, so the major providers mostly match each other's prices and features.
If you are already using a particular cloud provider for the web application that will be accessing these documents, you should use their blob storage unless you have a compelling reason not to. Communication between a cloud provider's compute and storage services within the same region will have minimal latency.
Re: Ask HN: Best document storage solution in 2023
#14I use B2 and Wasabi because I don't like relying on a single cloud provider. Files are uploaded to both. OpenResty (Nginx+Lua) sits in front to provide caching, and the logic for deciding which provider to pull from.
Wasabi gives you a free bandwidth allowance equal to the number of bytes stored per month. When I use up most of that, I start pulling from B2. And of course, if one of them is down, I pull from the other.
It's more time up front to build instead of just relying completely on GCP/Azure/AWS. But I don't have to worry as much about spontaneous account terminations destroying my business.
Re: Ask HN: Best document storage solution in 2023
#15The file system was designed to hold documents and does a pretty good job of it, there are several to choose from depending on what OS you run. Backing them up and restoring them is easy. An API to retrieve documents is trivial to write and customize or there are a few tools and APIs already available.