[deleted]
Keep Your Stuff, for Life
51–60 of 119 posts
Re: Keep Your Stuff, for Life
#52Wow, it was really hard to find out what this software does. I finally found a demo at the end of an hour-long talk from 2 years ago: https://youtu.be/PlAU_da_U4s?t=2687 So it seems to have a bunch of scripts to import data into its database from a variety of sources (including cloud services), and provides a search interface to navigate that historical data. And it has a lot of under-the-hood stuff about replication…
[deleted]
Re: Keep Your Stuff, for Life
#53I admire the goal of reliable long term data storage. I don't need to store tweets or 5TB videos, but my current solution is duplicate DVDs with a bunch of par2 files to hopefully ward off bit rot. I feel like there's some room for improvement.
Most BD-R discs are physically higher quality than DVD-R's. They can be comparable to archival-quality M-Disc media.
Re: Keep Your Stuff, for Life
#54Earlier quoted context omitted.
no wonder looking at the funding, is it?
You don't need funding for focusing on ease of operation, it's a mindset. Either you're user-centered, or you're not.
Agreed. It's really about benefits vs features. Features are what. Benefits are why; why you should care. Addressing why is essential.
Re: Keep Your Stuff, for Life
#55Wow, it was really hard to find out what this software does. I finally found a demo at the end of an hour-long talk from 2 years ago: https://youtu.be/PlAU_da_U4s?t=2687 So it seems to have a bunch of scripts to import data into its database from a variety of sources (including cloud services), and provides a search interface to navigate that historical data. And it has a lot of under-the-hood stuff about replication…
You initial confusion and nice summary made me thought of camlistore which I looked at 4 or 5 years ago. And here it is, renamed!
This is sad because the project looks interesting, it is not the usual quick kludge or vaporware, but the bad or inexistent documentation is a terrible disservice to the project.
Re: Keep Your Stuff, for Life
#56Earlier quoted context omitted.
Hook up ZRaid SSDs on a low powered machine (like raspberry pi). Set up regular ZFS scrubbing, and connect that to a monitoring service. You're not going to prevent silent bitrot no matter what modern technology you use, so take a proactive approach instead to prevent data loss.
Agreed. I used to back up onto DVDs, creating a set of (say) 12 DVDs with an extra couple generated by par2, to take care of the case where some of the DVDs just straight aren't readable. However, I found that I had a lot of data to back up, and it was actually cheaper and less tedious to get 4TB USB hard drives for ~£100 each, and plug them into an old defunct EeePC901 (with the added advantage that if the power goe…
Re: 4Tb drives, I do the dollars-per-mb calculation before buying hard drives. The most recent time I included the enclosure cost and found that it was actually cheaper to go huge. Granted the enclosure was a Synology, but buying 16TB drives is the closest I’ve been so ‘solving’ storage in a long time.
Formatting them and adding them to the array was brutal, and they are noisy, but it has been worth it.
Re: Keep Your Stuff, for Life
#57Earlier quoted context omitted.
HDDs are also prone to silent bitrot, where it will simply return incorrect bytes for a sector, even without any smart errors. (Optical disks also bitrot; but so does HDDs). This is usually a precursor to SMART errors happening in the near future, but unfortunately, it can still result in corrupted replication and corrupted backups; as your backups would be backing up the rotten (corrupt) data. I've witnessed this ha…
Interestingly, on my home ZFS raidz with 3 4TB hard drives, I have had to replace a drive a couple of times because ZFS scrub was reporting silent corruption. They were consumer-grade SATA drives. However, at work, I have backed up ~200TB of data to a large server with RAID-6 and ext4, storing the backups as large .tar files with par2 checksums and recovery data, and regularly scrubbing the par2 data. I have yet to s…
Thanks. What are the drives at your workplace?
Re: Keep Your Stuff, for Life
#58Earlier quoted context omitted.
You can always try an affordable online service like Backblaze B2 as one of your options. I haven't checked lately but I think they cost around $5 per terabyte per month. Plus usage, but that would be minimal for an archive.
Your credit card may expire or get blocked, and you might be in hospital, or billing alert emails may simply go to your spam folder for 45 days. Your data will be irreversibly deleted by Backblaze. There are LOTS of failure cases with any cloud provider, especially one with a crazy policy of deleting data in just 45 days. There is at least 1 reddit post a month about how someone lost data with Backblaze. Their reddit…
This.
I was backing up an external drive on a very very slow connection. I plugged it in to the machine late in the month, but forgot to turn the power on at the wall. The upload didn’t start and I lost the full backup and had to Re-upload the whole drive.
A good lesson was learned but it hurt. The upload took weeks to complete.
Re: Keep Your Stuff, for Life
#59Wow, it was really hard to find out what this software does. I finally found a demo at the end of an hour-long talk from 2 years ago: https://youtu.be/PlAU_da_U4s?t=2687 So it seems to have a bunch of scripts to import data into its database from a variety of sources (including cloud services), and provides a search interface to navigate that historical data. And it has a lot of under-the-hood stuff about replication…
You initial confusion and nice summary made me thought of camlistore which I looked at 4 or 5 years ago. And here it is, renamed! This is sad because the project looks interesting, it is not the usual quick kludge or vaporware, but the bad or inexistent documentation is a terrible disservice to the project.
Yeah, I've seen this project multiple times over the year, was always interested in it but never managed to figure out what it's for, let alone how to use it.
Re: Keep Your Stuff, for Life
#60exporting/mirror content from clearnet social network to zeronet is also interesting.
For popular content, you'll see it has many seeds, instead of likes