Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Replacing Dropbox in favor of DigitalOcean spaces

mitjafelicijan.com

Post reply on HN
Print view View original

41–50 of 201 posts

Re: Replacing Dropbox in favor of DigitalOcean spaces

#41

Post by 22c »

geonic wrote: post #27
quaffapint wrote: post #12

You could also go the route of using Backblaze for storage and Cloudflare for delivery. You'll pay $1.25 for the same 250gb ($0.005/gb) and get free bandwidth through CF.

Can you expand on that? I store my backups on B2. Are you saying I can download all data via cloudflare without paying for B2 egress?

Interested in this myself. There appears to be some sort of partnership between Backblaze and CloudFlare

https://help.backblaze.com/hc/en-us/articles/217666928-Using...

https://help.backblaze.com/hc/en-us/articles/360010017893-Ho...

Re: Replacing Dropbox in favor of DigitalOcean spaces

#42

Post by freedomben »

mitjafelicijan wrote: post #17
ev1 wrote: post #16

Earlier quoted context omitted.

DO will also use "machine learning" and "AI" to shut down your machines or terminate your account if your usage pattern is disliked.

Has this been happening already? I have been using this script for about 4 months now, and I had no problems yet. I do syncing once a day.

Oh yes, https://news.ycombinator.com/item?id=20064169

Re: Replacing Dropbox in favor of DigitalOcean spaces

#43

Post by lanstin »

mitjafelicijan wrote: post #21
muxator wrote: post #20

I wouldn't trust that script too much: there is no error checking at all. What happens when s3cmd fails and after two months you discover the "Vault sync succeded" emails you have been getting were all illusory? If the author is reading: please take the time to update your example, including proper error checking (at least "set -eu"), otherwise the people on the internet that are going to copy your script are in for…

I agree with you. I should add a disclaimer that this is still being worked on. I will add what you proposed. Thanks for your input.

Always start all your bash scripts with

set -e

You'll never regret it and might be very very very happy it was there. And if you start with that, then as you work on the shell script, you'll be more likely to make the script be idempotent (checking for files before copying, checking for lines in files before appending/sed'ing etc.) Idempotent >> non-idempotent for "alter the state on an end point" things.

Re: Replacing Dropbox in favor of DigitalOcean spaces

#44

Post by jamesmunns »

I actually really like DO spaces, I use it for hosting a small audio podcast. One downside is they give you NO way to see your bandwidth usage, other than seeing whether you got a bill overage or not. It was pretty surprising to me that they HAVE the information for billing, but don't expose it to the user of spaces in any way.

Re: Replacing Dropbox in favor of DigitalOcean spaces

#45

Post by freedomben »

jph wrote: post #13

You wrote about deplatforming-- heads up that DigitalOcean does deplatform people. I have direct firsthand knowledge of DigitalOcean deplatforming a security disclosure professional reporting a root breach bug. For your secure backups, I can suggest Tarsnap by Colin Percival, who's a security expert and a frequent contributor on Hacker News. I don't get anything for recommending Tarsnap; I'm just a customer. https://…

I had a terrible, terrifying experience with DO where they hard locked my account for days (and it would have been weeks if I hadn't made a huge stink) because of a misunderstanding. They ban/lock first, ask questions later, and that's not cool and I can't have my (and my customer's) important infrastructure treated that way.

I now use Linode for most of my stuff, and once they have cloud firewalls available in Dallas I'll be moving the rest of infrastructure over as I can.

I really need to write up my story into a blog post I can link to, but until then, I put a recap here a few days ago for anyone interested in the details. Mine wasn't as bad as some people's, but pretty scary personally: https://news.ycombinator.com/item?id=25806086

Re: Replacing Dropbox in favor of DigitalOcean spaces

#46

Post by centimeter »

High efficiency and very high performance trustless backup setup: send incremental (encrypted, compressed) ZFS snapshots to rsync.net, hetzner, or buyvm. This produces smaller backups than rsync or similar tools, produces them faster, and also shields your data from prying eyes, as it’s all encrypted when it leaves your machine.

Re: Replacing Dropbox in favor of DigitalOcean spaces

#47

Post by jmuguy »

jamesmunns wrote: post #44

I actually really like DO spaces, I use it for hosting a small audio podcast. One downside is they give you NO way to see your bandwidth usage, other than seeing whether you got a bill overage or not. It was pretty surprising to me that they HAVE the information for billing, but don't expose it to the user of spaces in any way.

I also found that to be really bizarre and there’s threads of users requesting usage info going back to over a year ago.

Re: Replacing Dropbox in favor of DigitalOcean spaces

#48

Post by mitjafelicijan »

lanstin wrote: post #43
mitjafelicijan wrote: post #21

Earlier quoted context omitted.

I agree with you. I should add a disclaimer that this is still being worked on. I will add what you proposed. Thanks for your input.

Always start all your bash scripts with set -e You'll never regret it and might be very very very happy it was there. And if you start with that, then as you work on the shell script, you'll be more likely to make the script be idempotent (checking for files before copying, checking for lines in files before appending/sed'ing etc.) Idempotent >> non-idempotent for "alter the state on an end point" things.

Will do. Thanks for this.

Re: Replacing Dropbox in favor of DigitalOcean spaces

#49

Post by Osiris »

freedomben wrote: post #42
mitjafelicijan wrote: post #17

Earlier quoted context omitted.

Has this been happening already? I have been using this script for about 4 months now, and I had no problems yet. I do syncing once a day.

Oh yes, https://news.ycombinator.com/item?id=20064169

Did they ever post the post mortem? It doesn't sound like they changed policies that automatically block flags accounts.

Re: Replacing Dropbox in favor of DigitalOcean spaces

#50

Post by azinman2 »

jph wrote: post #13

You wrote about deplatforming-- heads up that DigitalOcean does deplatform people. I have direct firsthand knowledge of DigitalOcean deplatforming a security disclosure professional reporting a root breach bug. For your secure backups, I can suggest Tarsnap by Colin Percival, who's a security expert and a frequent contributor on Hacker News. I don't get anything for recommending Tarsnap; I'm just a customer. https://…

My issue with tarsnap vs Dropbox is entirely workflow. Right now I can treat my Dropbox effectively as an external drive that happens to live on my file system by making everything selectively synced. If I want something backed up, I just drag it into that folder. But once it’s backed up I can turn on selective sync and free up my disk space.

Backup of personal data is often a 1-way endeavor — here’s a dump of photos I scanned that I don’t need to look at anytime soon. But with tarsnap I can’t do that, nor can I then have the ease of browsing to the file and just opening it while it transparently downloads on demand.

Post reply on HN