Live data from Hacker News

Cleaning up my 200GB iCloud with some JavaScript

andykong.org

31–40 of 192 posts

Re: Cleaning up my 200GB iCloud with some JavaScript

#31

The thing I detest the most is the weird tier that jumps from 200GB to 2TB. There’s no way to pay for incremental storage for 500GB or 1TB, which would be perfect for many families. In today’s age where storage is a commodity, this ought to be priced per GB used.

You can chuck as many 50GB increments on your 200GB if you need it.

Re: Cleaning up my 200GB iCloud with some JavaScript

#32

Surprisingly, I've received a similar storage notice from Apple before the holidays and I decided to download all photos/videos into my own media server instead of hosting it on iCloud. There is not an easy, straight-forward way to download your archive from iCloud. I am slowly getting there using multiple machines and devices. The issue with the recent changes with Apple is that they increase the prices for no good…

What about the Photos app on MacOS if you have one? I keep a local copy of my iCloud Photo Library and sync it through the MacOS Photos app.

Photos app for offline storage is also woefully neglected by Apple. They don't really design it for use with an external drive (you are expected to locate your library on a internal storage or permanently attached storage). The reason is that the photo library constantly gets corrupted on external drives, forcing a long rebuild/repair process.

Often the photos app doesn't even detect the iphone even when plugged in, and it's a serious bug that Apple has neglected for years.

Re: Cleaning up my 200GB iCloud with some JavaScript

#33
post #8

Am I reading this right? If this is widespread, this could be seen as apple bloating figures to push people to upgrade, which could lead to a lawsuit, no? IANAL

Funny, this was may take on the article too. I suppose one could download x amount of files from one cloud storage and upload it to another to see if there is any obvious discrepancy. Perhaps Apple are still using their old file system format for icloud? It's been around for a good few years now and perhaps they simply haven't bothered to ever change the type of storage format they use. Maybe those with older account…

I don't believe iCloud is a filesystem, it's not block-level. It's object-level, like S3, with a bunch of OS-side jank to make it look like a conventional directory and filesystem (which often fails miserably and dangerously).

It's similar levels of reliability to an FTP account mounted with curlftpfs[1] - except the latter at least fails in understandable ways and can be debugged.

[1]: https://news.ycombinator.com/item?id=9224

Re: Cleaning up my 200GB iCloud with some JavaScript

#34
post #18

Okay, so it could be a bug, but it is possible that iCloud is secretly storing more than one version of the file in some cases? (After all, Apple does similar things with other media files.) The example given at the end is interesting: > So iCloud says the video is 128MB, I download it and the video is actually 48MB, and my free storage increases by ~170MB when I deleted it. Interesting! This suggests that iCloud isn…

That's probably indeed the case, but it doesn't excuse it. When you buy a hard drive or USB stick, you get a certain amount of GBs to use as you please. If you put a 1GB file on it your free space decreases by 1GB (yes this is filesystem dependent and you might lose a few KBs for metadata, but the choice of filesystem is up to you and not mandated by the storage decide). It doesn't matter that the NAND controller pro…

>That's new and unexpected.

For you (and me) perhaps, but not for most people[1] who appreciate having the file system abstracted away.

[1]: https://news.slashdot.org/story/21/09/27/2032200/students-do...

Re: Cleaning up my 200GB iCloud with some JavaScript

#35
post #18

Okay, so it could be a bug, but it is possible that iCloud is secretly storing more than one version of the file in some cases? (After all, Apple does similar things with other media files.) The example given at the end is interesting: > So iCloud says the video is 128MB, I download it and the video is actually 48MB, and my free storage increases by ~170MB when I deleted it. Interesting! This suggests that iCloud isn…

On iPhone, the edits to pictures and videos are just metadata and the original file is kept. I just tested recording a video, cutting it in half and downloading the file from iCloud. The cut file it's smaller than the iCloud reported size however if I choose to download the unmodified original the size matches the iCloud reported size.

Re: Cleaning up my 200GB iCloud with some JavaScript

#36
post #8

Earlier quoted context omitted.

Funny, this was may take on the article too. I suppose one could download x amount of files from one cloud storage and upload it to another to see if there is any obvious discrepancy. Perhaps Apple are still using their old file system format for icloud? It's been around for a good few years now and perhaps they simply haven't bothered to ever change the type of storage format they use. Maybe those with older account…

I don't believe iCloud is a filesystem, it's not block-level. It's object-level, like S3, with a bunch of OS-side jank to make it look like a conventional directory and filesystem (which often fails miserably and dangerously). It's similar levels of reliability to an FTP account mounted with curlftpfs[1] - except the latter at least fails in understandable ways and can be debugged. [1]: https://news.ycombinator.com/i…

'Failing miserably and dangerously' is the new 'Move fast and break things'

Re: Cleaning up my 200GB iCloud with some JavaScript

#38

Surprisingly, I've received a similar storage notice from Apple before the holidays and I decided to download all photos/videos into my own media server instead of hosting it on iCloud. There is not an easy, straight-forward way to download your archive from iCloud. I am slowly getting there using multiple machines and devices. The issue with the recent changes with Apple is that they increase the prices for no good…

What about the Photos app on MacOS if you have one? I keep a local copy of my iCloud Photo Library and sync it through the MacOS Photos app.

> What about the Photos app on MacOS if you have one?

If you ever try a large-scale import/export into macOS Photos be prepared for 100% CPU, endless spinner cursors and the process ending up killed because it ran out of memory.

Re: Cleaning up my 200GB iCloud with some JavaScript

#39

Surprisingly, I've received a similar storage notice from Apple before the holidays and I decided to download all photos/videos into my own media server instead of hosting it on iCloud. There is not an easy, straight-forward way to download your archive from iCloud. I am slowly getting there using multiple machines and devices. The issue with the recent changes with Apple is that they increase the prices for no good…

There is an easy way to get your Data. It's just kind of hidden.

It's works the same way as Google Takeout. To get to it do this:

Sign in to your Apple ID account page at appleid.apple.com on a Mac, iPhone, iPad or PC. Go to “Data & Privacy” and select “Manage Your Data and Privacy.” On the following page, go to “Get a copy of your data” and select “Get started.”

Re: Cleaning up my 200GB iCloud with some JavaScript

#40
That's one of the reasons I self-host. I just don't trust the cloud providers regarding clarity and transparency... even if my self-hosted solution was far less reliable, less secure and less performant (I imagine it's not ;), I probably wouldn't change.

I personally use immich[1], a very complete solution with iOS / Android App, Server-Component and Sync / Backup option.

[1]: https://immich.app/

Post reply on HN