Is there any open source S3 compatible software? I know Riak Cloud Storage ( http://docs.basho.com/riak/cs/2.1.1/ ), but I think it’s not maintained anymore.
Joyent's Manta has an S3 adapter, all open-source.
Object Storage: AWS vs Google Cloud Storage vs Azure Storage vs DigitalOcean
81–90 of 115 posts
Re: Object Storage: AWS vs Google Cloud Storage vs Azure Storage vs DigitalOcean
#82This is great, but I’m disappointed Backblaze B2 isn’t included. That seems like an oversight unless someone can point out how B2 doesn’t hold its own with these options in a glaring way. There are tradeoffs, but B2 seems to be very competitive overall. B2 is cheaper than every option here for both storage ($0.005/GB) and egress ($0.01/GB).[1] Their transaction pricing is also cheaper.[2] Despite being cheaper, it’s…
there are also many other missing.... OVH object storage, online.net C14, Rackspace, Delimiter ObjSpace etc.etc.etc.
The world is not only Google, Amazon, Azure and DigitalOcean!
Re: Object Storage: AWS vs Google Cloud Storage vs Azure Storage vs DigitalOcean
#83Would be nice to add things like: - Consistency - First byte latency - Limits on requests - Max upload size - Extra features
Yes, for example GCP does not have S3's "eventual consistent" behavior. When data is written to GCP, it's available to read immediately.
Re: Object Storage: AWS vs Google Cloud Storage vs Azure Storage vs DigitalOcean
#84Cool site, but noticing an error: This compares AWS S3 single region pricing ($0.024/gb) to GCP GCS multi-region pricing ($0.026/gb) rather than GCP GCS single region pricing ($0.020/gb). Hopefully the creator/author will correct the discrepancy... Disclosure: I'm a pricing dweeb at Google Cloud
I sincerely hope your business card says "Pricing Dweep, Google Cloud Products". If not, you need to get this fixed.
New Card Order: Submitted.
Re: Object Storage: AWS vs Google Cloud Storage vs Azure Storage vs DigitalOcean
#85Re: Object Storage: AWS vs Google Cloud Storage vs Azure Storage vs DigitalOcean
#86Azure storage is available in way more than 10 regions FYI: https://azure.microsoft.com/en-us/global-infrastructure/serv...
Re: Object Storage: AWS vs Google Cloud Storage vs Azure Storage vs DigitalOcean
#87Earlier quoted context omitted.
I really wanted to like B2. I love the docs and super-clean interface. But B2 was just too "weird" when it came to uploading an object. You can't replace an object key, so you always get a new object key when uploading. This is unlike any normal object store, where you can just upload to an existing key. Also, if you upload an object with the same name (e.g. myphoto.png) it creates a new version, and there's no way t…
If you upload an object with the same 'name' to S3, you also get a new version. When you say 'key', do you mean the opaque object ID granted to objects in B2 which object stores like S3 doesn't have at all? I don't understand the rant here. S3 only operate by 'name' (key). I have had no problem integrating B2 side-by-side with S3 and GCP in the products I have written. Their high-level models are largely compatible.
S3 allows you to turn versioning on and off for a bucket; my understanding is that B2 does not.
Re: Object Storage: AWS vs Google Cloud Storage vs Azure Storage vs DigitalOcean
#88Earlier quoted context omitted.
What are bandwidth costs? This comes up again and again, people see HE.net / Cogent / Level3 / Hibernia / NTT whatever offering 10gig handoff IP transit at a colo neutral location for X per month and somehow determine the true cost. When I suspect the reality is that much of cost is invested in routing equipment both internally and externally, evolving SDN and all the goodness it affords, being able to offer SLA per…
I met a network engineer for amazon about a year ago and I brought up the prices since I had heard about them being expensive here on hacker news. He laughed about it and said it was one of their most profitable departments with like a 90% margin.
Gotta be able to negotiate wiggleroom somewhere when the Netflix-types come knocking
Re: Object Storage: AWS vs Google Cloud Storage vs Azure Storage vs DigitalOcean
#89Earlier quoted context omitted.
B2 is great as a backup store. I use it for backup. I wouldn't use it for non backup object storage, as it's in a single data center. S3 and Google Cloud are completely different, I'm not sure on the Google specifics but S3 has data replicated across three AZs.
Isn't backing up the last place where you want zero redundancy?
In fairness backing up is the last place I want to hand over redundancy responsibility. Better I consider B2 as one part of the 3-2-1 backups than the be-all end-all
Re: Object Storage: AWS vs Google Cloud Storage vs Azure Storage vs DigitalOcean
#90Earlier quoted context omitted.
I really wanted to like B2. I love the docs and super-clean interface. But B2 was just too "weird" when it came to uploading an object. You can't replace an object key, so you always get a new object key when uploading. This is unlike any normal object store, where you can just upload to an existing key. Also, if you upload an object with the same name (e.g. myphoto.png) it creates a new version, and there's no way t…
If you upload an object with the same 'name' to S3, you also get a new version. When you say 'key', do you mean the opaque object ID granted to objects in B2 which object stores like S3 doesn't have at all? I don't understand the rant here. S3 only operate by 'name' (key). I have had no problem integrating B2 side-by-side with S3 and GCP in the products I have written. Their high-level models are largely compatible.
S3 versioning is optional and off by default. Writes (including rewrites) to S3 are also atomic, so you’ll never see partial writes.