Live data from Hacker News

Google Drive misplaces months' worth of customer data

theregister.com

221–230 of 293 posts

Re: Google Drive misplaces months' worth of customer data

#221
post #172

I’ve been self hosting images with https://github.com/immich-app/immich and I‘m really happy. Decent mobile apps, even has good face recognition and H/W accelerated video transcoding. Can be served either with Tailscale or, as I did, with a reverse proxy on a cheap Hetzner box. Good backups are a must obviously, I have a backup server on a separate VLAN that syncs ZFS snapshots daily, and daily incremental encrypted…

Dies It hace any native app? The default mobile web UI seems a bit too overcrowded by other elements rather than pictures (at least on Firefox/Android). I'm using Photoprism currently and looking for some alternative that has better face detection system and an integrated "X years ago" automatic slideshow thing (I don't care about the "splish splash", "out in the wild", "magic hour" compilations that GPhoto automatic…

Yes, native apps are available and are quite good. Sometimes I get hangs after first opening the iOS app, but only briefly. Quite handily it has an option to allow self signed certificates, to make within-LAN use easier. I‘m binding my Immich domain to a local IP with unbound and don’t need to bother with letsencrypt internally that way. Only the hetzner box needs the certificate (obviously).

The quality of face tagging surprised me, it uses one of the open source algos by Microsoft.

Re: Google Drive misplaces months' worth of customer data

#222

Earlier quoted context omitted.

If a crime was committed, the state generally assumes the prosecution --- i.e. no expense to you. You can't get blood out of a rock but you can incarcerate it.

That's free if it's big enough to get their attention, and the culprit is known. But I don't want free revenge, I want my stuff/money back. An actual remedy.

I want my stuff/money back.

As the Rolling Stones pointed out years ago (maybe before you were born), "You can't always get what you want" --- yadda, yadda, etc., etc..

It is not just about giving you what you want. The fact that *legal* retribution of some sort applies if someone takes or destroys your stuff is a defining characteristic of "ownership".

Re: Google Drive misplaces months' worth of customer data

#223
post #219

All lights are green: https://www.google.com/appsstatus/dashboard/ No recent/active incident for Google Drive is shown: https://www.google.com/appsstatus/dashboard/summary https://www.google.com/appsstatus/dashboard/products/VHNA7p3...

What a shame. The mighty Google is after all in the same league as some random LLC providing cloud storage for $1.99/mo.

Re: Google Drive misplaces months' worth of customer data

#224

Anecdotal, but with Google Photos, I've observed data loss to the point where I no longer trust the service with anything valuable. Photos I know I've taken are missing. There are periods of time when I walked around a city 10+ years ago taking a large volume of photos, like when I first moved to Seattle. Going back to that window of time in Google Photos, I only have a handful of photos from that walk. There are als…

I did not notice direct data loss yet, but I noticed other behavior that made me reconsider how much I trust it.

For example in the past I had several occurrences of duplicate photos where each of the two instances has exactly the same bytes as the other one. Usually that should have gotten deduplicated, but it hasn't. What's even stranger is that deleting one of the two pictures also deleted the other one. Re-uploading the original photo usually made both duplicates show up again. The way how I was able to get rid of those duplicates was to wait a day or so until I re-upload the data and to attempt that process several times. At some point only a single photo showed up.

Also those duplicates only showed up in the regular photo view. Even if both of the duplicate instances were added to an album viewing the album would only show the photo once.

Re: Google Drive misplaces months' worth of customer data

#228

Earlier quoted context omitted.

I mount it using their desktop client and use voidtools' everything to search for files. Works reasonably well, though Google seems intent on breaking stuff every so often. Also Google hasn't figured out how to make it stop creating desktop.ini files everywhere yet. I'd say it makes them look like amateurs, but amateurs tend to be better at making software.

You can blame a different megacorp for the desktop.ini files: those are artifacts from windows explorer (I’m assuming you’re using a windows machine with the google drive mounted)

Partially yeah, but that's usually a system file, which isn't supposed to be visible. Google drive for some reason decides to make it visible, which is damn annoying.

This is a bit like Google drive adding two files named '.' and '..' to each folder in unix.

Re: Google Drive misplaces months' worth of customer data

#229

Anecdotal, but with Google Photos, I've observed data loss to the point where I no longer trust the service with anything valuable. Photos I know I've taken are missing. There are periods of time when I walked around a city 10+ years ago taking a large volume of photos, like when I first moved to Seattle. Going back to that window of time in Google Photos, I only have a handful of photos from that walk. There are als…

I have backup both to Google Photos and iCloud. The probability of both failing and/or both deciding to just delete my account because I look "suspicious" is very small. But I _have_ had iCloud mysteriously not being able to retreive old photos.

Never had iCloud lose any of my data and I've been using it since not long after it launched, but now I'm a little concerned.

With photos I do keep them all local to my MacBook, but not documents. Maybe I should.

Re: Google Drive misplaces months' worth of customer data

#230
post #71

Earlier quoted context omitted.

This works fine for smaller accounts, but on larger accounts it seems to be regularly failing (based on my own experience and based on other postings and reports that I found online). Exporting my Google Photos sometimes fails consistently even with lots of attempts. Out of well over 10 export attempts or so this year maybe a single one succeeded. I have a few hundred GB of data stored on that account. I also current…

I was trying to set up a similar thing. I already do the google takeouts every few months (~400GB, I don’t have issues with export though), but so far have been storing all of them. How do you do the diff between the old and new encrypted versions? Do you encrypt and upload the takeout .tar.gz files, or do extract first then encrypt?

My personal Internet connection is a bit too slow to wait for re-uploading all the data and my vserver doesn't have enough disk space to temporarily store all the data so I pretty much do everything in a streaming fashion: I use a Firefox extension that gives me the wget command (which includes cookies, etc.) when triggering a local download from Google Takeout, then I patch that command to stream to stdout, this first (tee-)pipes to a Python script that decompresses the data on the fly and dumps the hashes for each file into a log, and it also goes to "age" for encryption, and then to s3cmd for uploading the encrypted data to Wasabi.

For the comparison I pretty much only use the logged hashes which allow me to figure out if any hashes (and associated files) are missing in the new version of the backup. This isn't a perfect solution yet as a few things aren't detected. For example Google Takeout bundles mails in mbox files and I currently don't check for missing mails. It would be better to convert the mbox files to a Maildir first so that the comparison can be done on a per-mail basis.

Post reply on HN