Now that we're talking about B2, has or is anyone using them for latency-sensitive small-file object storage? I'm about to take the plunge and set up benchmarks, my use-case is that I want to store and serve ~ 500k small files (30b-1MB) per day to website visitors. So far B2 support has told me that it shouldn't be a problem, and early benchmarking indicates the same, just curious if anyone had stories from the trenches.
Backblaze B2 Cloud Storage Now Has S3 Compatible APIs
61–70 of 293 posts
Re: Backblaze B2 Cloud Storage Now Has S3 Compatible APIs
#62Actually excited by this. I was benchmarking S3 vs B2 vs others 2 years ago and I had to give up on B2 because its implementation for performance was so much more difficult. (88 lines vs 36 lines for all others in Ruby)
Yev from Backblaze here -> Glad that you took a look at us in the past, excited that this announcement will warrant another look! :)
Re: Backblaze B2 Cloud Storage Now Has S3 Compatible APIs
#63Earlier quoted context omitted.
It's possible they're eating the cost of the load balancing necessary to multiplex from their backends to client requests, which should theoretically stoke an increase in business due to reduced switching costs (and what timing, with an economic contraction likely pushing cost reductions at those needing cloud storage). Disclaimer: Happy Backblaze Mac client and B2 customer, no other affiliation. EDIT: @yev: I took t…
Yev here -> saw my Yev-signal. That's right, Gleb actually answered that question on our blog ( https://www.backblaze.com/blog/backblaze-b2-s3-compatible-ap... ) but we're eating the cost. Om nom nom.
Interesting. Implementation wise, is it some form of Minio gateway + hardware?
Re: Backblaze B2 Cloud Storage Now Has S3 Compatible APIs
#64Earlier quoted context omitted.
Digital Ocean, OVH and others seem to use the S3 API. It does give you the benefit of clients written against S3 can now be used for your platform, and unlike a lot of AWS the API contract seems pretty reasonable and well kept. Edit: Confused Hetzner and OVH, sorry
Hetzner offers S3 compatible storage? I didn't find anything about that...
Woops, looks like I mixed up their storage offering with OVH. Sorry about that!
Re: Backblaze B2 Cloud Storage Now Has S3 Compatible APIs
#65This is great. Their current API requires you to identify a unique host to send data to, so you’re constantly performing a metric ton of DNS queries. Until I white listed the base domain it was the #1 client of my Pihole installation by multiple orders of magnitude.
Yev here -> Glad you're excited and that this will make things a bit easier for you!
Re: Backblaze B2 Cloud Storage Now Has S3 Compatible APIs
#66Earlier quoted context omitted.
How does that work? Can I just dumb two terabytes of video into Backblaze B2, setup a Cloudflare account and have people watch those videos with it costing me only $10 a month? Because that doesn't sound right.
The Cloudflare ToS explicitly exclude that use-case. 2.8 Limitation on Serving Non-HTML Content The Service is offered primarily as a platform to cache and serve web pages and websites. Unless explicitly included as a part of a Paid Service purchased by you, you agree to use the Service solely for the purpose of serving web pages as viewed through a web browser or other functionally equivalent applications and render…
From what I can tell that's more about their caching service. It mentions exceptions for hosting from a paid service and correct me if I'm wrong but wouldn't Backblaze be that paid service?
Re: Backblaze B2 Cloud Storage Now Has S3 Compatible APIs
#67I have a decent sized music collection consisting a lot of lossless vinyl rips that I've made from my record collection. It totals around 200gigs at the moment but is growing weekly. I've been looking for somewhere to back this all up in the cloud and backblaze is looking most promising at the moment. Anyone here have any thoughts on where I should go with this?
There are lots of tools you can use to back up to Backblaze, including their comsumer backup service. If you want to sync to B2 specifically with a lightweight tool, check out https://rclone.org/
Any good tips on a DIY backup setup using something like a home NAS and B2? In particular, something I can use on a load of devices including phones?
Re: Backblaze B2 Cloud Storage Now Has S3 Compatible APIs
#68S3 is now the standard for cloud storage APIs? Not sure if that's good or bad. I guess competitors have to reduce switching costs.
I don't see Google, MS Azure or Rackspace switching their API anytime soon, but yes, smaller players and new ones do.
Re: Backblaze B2 Cloud Storage Now Has S3 Compatible APIs
#69As a Synology user, please let this mean that Hyper Backup can work with B2 now (or at least soon).
Re: Backblaze B2 Cloud Storage Now Has S3 Compatible APIs
#70Just a year ago B2 couldn't do server-side file copying.[1] If you wanted to rename or move a file you had to re-upload the whole thing (not great for large multi-gigabyte files)! That ruled them out of consideration for storing my personal backups. Glad to see they've since fixed that, and with this update are clearly continuing to improve ergonomics. I'll have to give B2 a fresh look. [1]: https://github.com/Backbl…
Yev here -> thanks! We're constantly working on making the platform better, and copy-file was definitely a widely requested feature! That plus S3 Compatibility, for folks who wanted to integrated with B2 Cloud Storage but didn't have the resources to write code to our B2 Native API.
I've been using B2 to disrupt a bunch of ugly & entrenched vendors in the price sensitive K12 market. Thanks for building it. :)