Live data from Hacker News

Ask HN: How do you organize your data and maintain digital hygiene?

news.ycombinator.com

1–10 of 24 posts

Ask HN: How do you organize your data and maintain digital hygiene?

#1
The organization of my digital assets is rather ... haphazard! Some files (create, downloaded, received from others) on one computer. Some on another computer. Some files are backed up, some of those backups are not regular. Photos are on the phone, but not on the computer. The phone syncs photos to a large cloud provider, but photos deleted from the phone don't get deleted in the cloud. Videos occasionally get copied to a USB drive connected to the TV. Some data is shared with others via cloud providers, other is not. Files in the various computers are disorganized across folders, filenames, multiple versions in different places.. and so on.

I'm imagining that many of you have clean, well-organized, backed up digital assets across a variety of computers and cloud providers. Curious how you do it in terms of i) Motivation ii) organization schemes (e.g. Johnny Decimal? PARA?) iii) Tools and processes, potentially across file-types (e.g. Photos vs documents, files created by yourself vs obtained elsewhere) iv) Any sharing you do (e.g. with Spouse, family, friends) v) Prevent entropy from growing. vi) Any other points/topics to be considered?

Please share your data organization best practices, warnings, success stories, pitfalls etc.

Re: Ask HN: How do you organize your data and maintain digital hygiene?

#2
I'm a windows user so I put files I want to store long term on onedrive. If it's a really important file (old photos), I have an external hard drive for backups as well.

Code is all backed up on github

Files that I don't care about losing someday remain local on my PC and those get messy. Most things end up in my downloads folder and I delete them every couple months.

Every couple years I'll get a new laptop and my strategy is to move over nothing. No settings, no files, no wallpapers. Just start over from scratch

Re: Ask HN: How do you organize your data and maintain digital hygiene?

#3
I run a zfs array on a home server. The server's off most of the time, so I don't have any fancy services running from it.

When my phone gets low on space, I move my photos and videos across via plain old USB.

Same when I reformat a machine: I gather all the files I want to keep into a single folder, then move it to the server.

I used to run zfs with one redundant drive. I had a drive failure, bought a replacement drive, swapped it in, and had zero loss to my knowledge.

I later read that drives tend to die around the same age, and doing a drive replacement is a very strenuous activity, so you shouldn't just have one redundant drive. So now I have two.

Re: Ask HN: How do you organize your data and maintain digital hygiene?

#5
I use google drive and google photos.

Photos go in photos, everything else goes in drive.

Within google drive I follow a getting-things-done-ish approach. I have two folders at the root -- one for general filing, one for current projects.

I use a combination of google keep + taking pictures of things to capture things quickly that need later attention.

This isn't perfect. I don't like having to use google docs for all text, for example. Would much prefer to use plain text files in most cases, but they aren't editable within the google drive ui. Luckily they've released the pageless layout relatively recently, which improves the experience a lot.

The pains I have are not worth investing in a custom setup. I just don't have time for that. I want to spend my time accomplishing things, not organizing files, or even worse -- keeping my organizing system online and constantly having to tinker with it. I just can't be bothered.

I'm happy with the fact that at any moment I could have any of my physical devices stolen, ruined, etc. and I would be mostly back on my way as soon as I get another.

Re: Ask HN: How do you organize your data and maintain digital hygiene?

#6
The local files I have to care about are my photo, video, and music libraries, which sit inside Photos and Music on my Mac. Photo/video gets auto synced from my iPhone when I connect it. Code and work documents are on Github and Google Docs respectively, but if they weren't, they'd just have a folder. Photo lib is stored on a secondary SSD because my boot disk isn't that big.

Time Machine backs everything up to a local pair of HDDs. I also periodically create a read-only, encrypted disk image containing my libraries and upload that to Google Drive because I happen to have a lot of free storage there. Before I had any cloud stuff, I used to put one of the backup disks in the bank then later swap it with my other one. My wife also copies some extra special things like wedding photos to her laptop and other disks.

Lastly, some big files I care less about are basically in unorganized places, but not very many. They're either in my downloads folder or on one of the HDDs. I've got another laptop I don't use as much anymore, and my policy is that everything on there is temporary.

Re: Ask HN: How do you organize your data and maintain digital hygiene?

#7
post #5

I use google drive and google photos. Photos go in photos, everything else goes in drive. Within google drive I follow a getting-things-done-ish approach. I have two folders at the root -- one for general filing, one for current projects. I use a combination of google keep + taking pictures of things to capture things quickly that need later attention. This isn't perfect. I don't like having to use google docs for al…

Ummm.. hate to play the devil's advocate here, I am sure you must have 2FA setup and all, but in the off chance that you loose access to your google account(for the sake of argument lets say for an "alleged" violation of ToS).

How do you plan to regain access?

Re: Ask HN: How do you organize your data and maintain digital hygiene?

#8
Well.. you asked for it!

I use my laptop running Linux for everything. I store files in the usual suspects (~/Documents, ~/Videos, ~/Pictures) etc. I also have ~/Storage for random files/isos/vm images, etc. I use ~/Workspace for my local code.

I use dejadup to automatically encrypt and backup core files to my remote server that runs my personal site. This backs up files like my ssh keys, gpg keys, environment configs, secrets, gnu pass vault, etc.

My personal server is where all of my git repositories reside. The personal server is backed up every day automatically by Linode.

I have a second nvme drive in my laptop that acts as a mirror of my main hard drive. I manually run a "backup" script every month that syncs my laptop's primary folders to the mirrored hard drive's folders. This mainly serves as a backup in the event something horrible happens to the main drive.

I have an external hard drive I also mirror to once a month. This acts as an external backup, in the event the entire laptop dies (stolen, goes up in flames, etc). This hard drive stays in a fire proof safe.

I symmetrically encrypt my ssh key and send a copy to my wife and a burner email address in the event I need my key to get inside my personal server (assuming my laptop is gone and my external drive is missing).

That's it!

Re: Ask HN: How do you organize your data and maintain digital hygiene?

#9
I chuck it into unorganized piles (file system, Google Drive, Apple Notes, and Obsidian Notes) and have good search systems and make sure I know how to use them.

It works fine and doesn't require fiddling or cleanup time. I can find what I need pretty quickly.

Re: Ask HN: How do you organize your data and maintain digital hygiene?

#10
It was painful, but I managed to collect all my data onto a single 2TB NVMe drive in my laptop,

folder structure is kinda messy, but under Windows "Everything" gives me instantaneous search, so sorting everything perfectly is not worth the time I run a duplicate finder periodically to avoid wasting too much space

monthly backup via duplicati onto a USB HDD and continuous Backblaze backup

Post reply on HN