Borgbase backups have been unavailable for 3 days
status.borgbase.com
Borgbase backups have been unavailable for 3 days
1–10 of 88 posts
Re: Borgbase backups have been unavailable for 3 days
#2Their current ETA for service restoration is another 2-4 days.
Despite the warning banner the uptime for customers on us10 instance which has been unavailable for almost a week now is showing at 100%.
They are compensating affected customers by crediting 4 weeks subscription but I must say this does make me wonder about their redundancy and recovery architecture.
Opshugs to the folks at Borgbase.
--
> box-us10 offline for storage expansion
> We are currently experiencing a temporary outage on our box-us10 server due to an unplanned expansion process. We added two new hard drives to the server in an effort to enhance capacity and accommodate future growth. However, we did not anticipate that the expansion process would require the server storage to be temporarily offline.
> To prioritize the safety and integrity of your existing data, we have decided to keep the box-us10 server offline until the expansion is successfully completed. It's estimated that about a week of downtime will be needed for the expansion. We understand the inconvenience this may cause and sincerely apologize for any disruption to your services.
> Current progress: 26% (Sunday morning UTC) > Date Created: 2023-08-11 16:17:36 (3 days ago) > Last Updated: 2023-08-13 18:15:53 (15 hours ago)
Re: Borgbase backups have been unavailable for 3 days
#3A vague description or white lie might have been better here - a storage company with a fleet of servers shouldn’t ever be in this situation for the reason given
Re: Borgbase backups have been unavailable for 3 days
#4A vague description or white lie might have been better here - a storage company with a fleet of servers shouldn’t ever be in this situation for the reason given
Personally I appreciate the honesty and look for it in vendors, there are too many that cover up the truth (MS/Github etc...).
However I agree that it doesn't look good for a storage company.
Re: Borgbase backups have been unavailable for 3 days
#5I guess now is a fun time to describe my cheap backup process. All of this is related to Linux and the backups are fully encrypted client-side. Under the hood `borgbackup` is used, but I use the PikaBackup app (see Flathub) to make it easier to interface with.
First I have a local copy of my data living on my actual hard drive.
Next I use PikaBackup (via borg) to encrypt and sync that to a cloud server I run that has about 200GB of storage for these backups for about $1/mo added cost.
Next I use the Backblaze Cloud tool to synchronize those encrypted backups to B2 using `b2 sync --delete` command. It runs automatically via cron every night. The costs here are about $0.01 per month since I only get charged what I actually use.
Backups are pruned and I can easily control the schedule, copies, etc. If I need to recover a file it mounts as a file system that I can easily navigate using any tools I want, including the command line. I can also mount older or different snapshots.
Re: Borgbase backups have been unavailable for 3 days
#6A vague description or white lie might have been better here - a storage company with a fleet of servers shouldn’t ever be in this situation for the reason given
Personally I appreciate the honesty and look for it in vendors, there are too many that cover up the truth (MS/Github etc...). However I agree that it doesn't look good for a storage company.
I agree with you.
I’d like further transparency on this: why didn’t they anticipate that the array would be offline for this expansion? Expanding a storage environment can certainly be a mine-filled exercise for even the most experienced. But why was this expansion unexpectedly an offline operation?
I’m not throwing shade here. I’m genuinely curious because I’ve been considering Borg and Borgbase for an upcoming project.
Re: Borgbase backups have been unavailable for 3 days
#7Their current ETA for service restoration is another 2-4 days. Despite the warning banner the uptime for customers on us10 instance which has been unavailable for almost a week now is showing at 100%. They are compensating affected customers by crediting 4 weeks subscription but I must say this does make me wonder about their redundancy and recovery architecture. Opshugs to the folks at Borgbase. -- > box-us10 offlin…
[deleted]
Re: Borgbase backups have been unavailable for 3 days
#8Their current ETA for service restoration is another 2-4 days. Despite the warning banner the uptime for customers on us10 instance which has been unavailable for almost a week now is showing at 100%. They are compensating affected customers by crediting 4 weeks subscription but I must say this does make me wonder about their redundancy and recovery architecture. Opshugs to the folks at Borgbase. -- > box-us10 offlin…
>unplanned expansion process
Sounds like an Elon Musk euphemism after a bad day at SpaceX.
Re: Borgbase backups have been unavailable for 3 days
#9My borgbase backups have been great, although according to my dashboard I'm on a different server instance.
I don't envy their sysadmin team right now. Good luck, folks.
Re: Borgbase backups have been unavailable for 3 days
#10Their current ETA for service restoration is another 2-4 days. Despite the warning banner the uptime for customers on us10 instance which has been unavailable for almost a week now is showing at 100%. They are compensating affected customers by crediting 4 weeks subscription but I must say this does make me wonder about their redundancy and recovery architecture. Opshugs to the folks at Borgbase. -- > box-us10 offlin…
> unplanned expansion process Sounds like an Elon Musk euphemism after a bad day at SpaceX.
Someone added disk to an array without understanding what would happen next.