Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Backblaze B2 Cloud Storage Now Has S3 Compatible APIs

backblaze.com

Post reply on HN
Print view View original

41–50 of 293 posts

Re: Backblaze B2 Cloud Storage Now Has S3 Compatible APIs

#41

Post by Hamuko »

ksec wrote: post #38

Backblaze is also the founding member of Bandwidth Alliance, meaning getting those B2 via Cloudflare is essentially free. So you are only paying for Storage. ( Correct me if I am on this one ) I wonder why doesn't ALL non HyperScale Cloud Vendors, like Linode and DO provide one click third party backup to B2. You should always store offsite backup somewhere. And B2 is perfect.

How does that work? Can I just dumb two terabytes of video into Backblaze B2, setup a Cloudflare account and have people watch those videos with it costing me only $10 a month? Because that doesn't sound right.

Re: Backblaze B2 Cloud Storage Now Has S3 Compatible APIs

#42

Post by hartator »

Hamuko wrote: post #41
ksec wrote: post #38

Backblaze is also the founding member of Bandwidth Alliance, meaning getting those B2 via Cloudflare is essentially free. So you are only paying for Storage. ( Correct me if I am on this one ) I wonder why doesn't ALL non HyperScale Cloud Vendors, like Linode and DO provide one click third party backup to B2. You should always store offsite backup somewhere. And B2 is perfect.

How does that work? Can I just dumb two terabytes of video into Backblaze B2, setup a Cloudflare account and have people watch those videos with it costing me only $10 a month? Because that doesn't sound right.

Curious as well.

Re: Backblaze B2 Cloud Storage Now Has S3 Compatible APIs

#43

Post by waffle_ss »

nicolaslem wrote: post #35
waffle_ss wrote: post #21

Just a year ago B2 couldn't do server-side file copying.[1] If you wanted to rename or move a file you had to re-upload the whole thing (not great for large multi-gigabyte files)! That ruled them out of consideration for storing my personal backups. Glad to see they've since fixed that, and with this update are clearly continuing to improve ergonomics. I'll have to give B2 a fresh look. [1]: https://github.com/Backbl…

For backups, mapping one file to one object rarely works well. Tools that use this strategy come with a long list of scenarios requiring expensive operations. For instance renaming a directory or changing a few bytes in a large file. On the other hand tools that don't view the object storage as a file system have way less gotchas. In my experience B2 + restic works really well.

That's a fair point but this is for my family photos and videos; in the event I die I'd rather the S3 bucket I hand over to my wife/kids in my last wishes look like a real filesystem rather than a bazillion blobs that require a special tool with a programmer's expertise to reassemble

Re: Backblaze B2 Cloud Storage Now Has S3 Compatible APIs

#44

Post by varikin »

Hamuko wrote: post #41
ksec wrote: post #38

Backblaze is also the founding member of Bandwidth Alliance, meaning getting those B2 via Cloudflare is essentially free. So you are only paying for Storage. ( Correct me if I am on this one ) I wonder why doesn't ALL non HyperScale Cloud Vendors, like Linode and DO provide one click third party backup to B2. You should always store offsite backup somewhere. And B2 is perfect.

How does that work? Can I just dumb two terabytes of video into Backblaze B2, setup a Cloudflare account and have people watch those videos with it costing me only $10 a month? Because that doesn't sound right.

I believe you still pay Cloudflare costs, but the traffic between Cloudflare and B2 is free on both platforms. But it might be worth double-checking the fine print.

Re: Backblaze B2 Cloud Storage Now Has S3 Compatible APIs

#45

Post by Hamuko »

varikin wrote: post #44
Hamuko wrote: post #41

Earlier quoted context omitted.

How does that work? Can I just dumb two terabytes of video into Backblaze B2, setup a Cloudflare account and have people watch those videos with it costing me only $10 a month? Because that doesn't sound right.

I believe you still pay Cloudflare costs, but the traffic between Cloudflare and B2 is free on both platforms. But it might be worth double-checking the fine print.

Isn't the Cloudflare CDN included in the free plan as well?

Re: Backblaze B2 Cloud Storage Now Has S3 Compatible APIs

#46

Post by Fritsdehacker »

qmmmur wrote: post #37
l3s2d wrote: post #25

Earlier quoted context omitted.

I would recommend restic with B2. Really simple to set up. I use it for nightly homedir backups for multiple machines. Currently at ~400GB and it's costing me < $3/month.

Do you automate your process somehow? I'm trying to develop a strategy where if I open my laptop after a certain time it backups in the background. My go to for this kind of thing was hammerspoon but it won't execute the shell task in the background thread and completely locks my machine. I guess I could cron it?

I've made systemd profiles and timers to do restic backups. It's really clean and works well. Also much better testable than cron. It will most likely also work for more complex scenarios, like you're mentioning.

Re: Backblaze B2 Cloud Storage Now Has S3 Compatible APIs

#47

Post by terseus »

tams wrote: post #12
dopamean wrote: post #5

I have a decent sized music collection consisting a lot of lossless vinyl rips that I've made from my record collection. It totals around 200gigs at the moment but is growing weekly. I've been looking for somewhere to back this all up in the cloud and backblaze is looking most promising at the moment. Anyone here have any thoughts on where I should go with this?

There are lots of tools you can use to back up to Backblaze, including their comsumer backup service. If you want to sync to B2 specifically with a lightweight tool, check out https://rclone.org/

Rclone is really a fantastic tool, its configurability based on backends allow for amazing combinations!

You can configure any cloud storage backend (B2, S3, GCS ...) and combine it with other utility storage backends, like "crypt" [1], "cache" [2] and "chunker" [3], I highly recommend it to anyone searching for a backup solution.

The only feature I miss from Rclone is automatic directory monitoring and mirroring, which I solved using Syncthing (but forces me to host an additional server for it).

[1] https://rclone.org/crypt/ [2] https://rclone.org/cache/ [3] https://rclone.org/chunker/

Re: Backblaze B2 Cloud Storage Now Has S3 Compatible APIs

#48

Post by kwesthaus »

qmmmur wrote: post #37
l3s2d wrote: post #25

Earlier quoted context omitted.

I would recommend restic with B2. Really simple to set up. I use it for nightly homedir backups for multiple machines. Currently at ~400GB and it's costing me < $3/month.

Do you automate your process somehow? I'm trying to develop a strategy where if I open my laptop after a certain time it backups in the background. My go to for this kind of thing was hammerspoon but it won't execute the shell task in the background thread and completely locks my machine. I guess I could cron it?

I also use restic and I have a cron script which runs early Monday morning every week. Restic supports auto-pruning, so I have it set up to backup a new snapshot then purge all except the most recent 100 years, 12 months, and 5 weeks.

Re: Backblaze B2 Cloud Storage Now Has S3 Compatible APIs

#49

Post by whalesalad »

This is great. Their current API requires you to identify a unique host to send data to, so you’re constantly performing a metric ton of DNS queries. Until I white listed the base domain it was the #1 client of my Pihole installation by multiple orders of magnitude.
Post reply on HN