Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Hyperspace

hypercritical.co

Post reply on HN
Print view View original

241–250 of 503 posts

Re: Hyperspace

#241

Post by bhouston »

borland wrote: post #177
horsawlarway wrote: post #116

Earlier quoted context omitted.

He picked node_modules because it's highly likely to encounter redundant files there. If you read the rest of the comment he only saved another 30% running his entire user home directory through it. So this is not a linear trend based on space used.

He "only" saved 30%? That's amazing. I really doubt most people are going to get anywhere near that. When I run it on my home folder (Roughly 500GB of data) I find 124 MB of duplicated files. At this stage I'd like it to tell me what those files are - The dupes are probably dumb ones that I can simply go delete by hand, but I can understand why he'd want people to pay up first, as by simply telling me what the dupes…

> He "only" saved 30%? That's amazing. I really doubt most people are going to get anywhere near that.

You misunderstood my comment. I ran it on my home folder which contains 165GB of data and it found 1.3GB is savings. That isn't significant for me to care about because I currently have 225GB free of my 512GB drive.

BTW I highly recommend the free "disk-inventory-x" utility for MacOS space management.

Re: Hyperspace

#242

Post by pmarreck »

DontBreakAlex wrote: post #181

Nice, but I'm not getting a subscription for a filesystem utility. Had it been a one-time $5 license, I would have bought it. At the current price, it's literally cheaper to put files in a S3 bucket or outright buy an SSD.

Claude 3.7 just rewrote the whole thing (just based on reading the webpage description) as a commandline app for me, so there's that.

And because it has no Internet access yet (and because I prompted it to use a workaround like this in that circumstance), the first thing it asked me to do (after hallucinating the functionality first, and then catching itself) was run `curl https://hypercritical.co/hyperspace/ | sed 's/]*>//g' | grep -v "^$" | clip`

("clip" is a bash function I wrote to pipe things onto the clipboard or spit them back out in a cross-platform linux/mac way)

    clip() {
      if command -v pbcopy > /dev/null; then
        [ -t 0 ] && pbpaste || pbcopy;
      else
        if command -v xclip > /dev/null; then
          [ -t 0 ] && xclip -o -selection clipboard || xclip -selection clipboard;
        else
          echo "clip function error: Neither pbcopy/pbpaste nor xclip are available." >&2;
          return 1;
        fi;
      fi
    }

Re: Hyperspace

#244

Post by ForOldHack »

augusto-moura wrote: post #206
benced wrote: post #200

Earlier quoted context omitted.

The developer is popular and APFS cloning is genuinely technically interesting. (no, it's not a symlink)

COW filesystems are older than MacOS, no surprises for me. Maybe people aren't that aware of it?

CoW - Copy on Write. Most probably on older mainframes. ( Actually newer mainframes ).

"CoW is used as the underlying mechanism in file systems like ZFS, Btrfs, ReFS, and Bcachefs"

Obligatory: https://en.wikipedia.org/wiki/Copy-on-write

Re: Hyperspace

#245

Post by UltraSane »

amzin wrote: post #146
taneliv wrote: post #88

Earlier quoted context omitted.

On ZFS it consumes a lot of RAM. In part I think this is because ZFS does it on the block level, and has to keep track of a lot of blocks to compare against when a new one is written out. It might be easier on resources if implemented on the file level. Not sure if the implementation would be simpler or more complex. It might also be a little unintuitive that modifying one byte of a large file would result in a lot d…

Is there a FS that keeps only diffs in clone files? It would be neat

VAST storage does something like this. Unlike how most storage arrays identify the same block by hash and only store it once VAST uses a content aware hash so hashes of similar blocks are also similar. They store a reference block for each unique hash and then when new data comes in and is hashed the most similar block is used to create byte level deltas against. In practice this works extremely well.

https://www.vastdata.com/blog/breaking-data-reduction-trade-...

Re: Hyperspace

#246

Post by pmarreck »

furyofantares wrote: post #174
radlad wrote: post #162

Earlier quoted context omitted.

I'm a bit confused as the Mac App Store says it's over 4 years old.

The 4+ Age rating is like, who can use the app. Not for 3 year olds, apparently.

The way they specify this has always confused me, because I actually care more about how old the app is than what age range it's aimed for

Re: Hyperspace

#247

Post by MadnessASAP »

dewey wrote: post #232
the_clarence wrote: post #188

Its interesting how Linux tools are all free when even trivial mac tools are being sold. Nothing against someone trying to monetize but the linux culture sure is nice!

It's not that nice to call someone's work they spent months on "trivial" without knowing anything about the internals and what they ran into.

I don't think they meant it in a disparaging way, except maybe against Apple. Moreso that typically filesystems that can support deduplication include a deduplication tool in it's standard suite of FS tools. I too find it odd that Apple does not do this.

Re: Hyperspace

#248

Post by ForOldHack »

ryandrake wrote: post #240
wpm wrote: post #167

Earlier quoted context omitted.

The developer deliberately chose to write it in Swift 6. Apple is the one who deliberately excluded Swift 6 from your device.

Yea, too bad :( Everyone involved with macOS and iOS development seems to be (intentionally or unintentionally) keeping us on the hardware treadmill.

Expensive. Keeping us on the expensive hardware treadmill. My guess is that it cannot be listed in the Apple store unless its only for Macs released in the last 11 months.

Re: Hyperspace

#249

Post by archagon »

I have to confess: it miffs me that a utility that would normally fly completely under the radar is likely to make the creator thousands of dollars just because he runs a popular podcast. (Am I jealous? Oh yes. But only because I tried to sell similar apps in the past and could barely get any downloads no matter how much I marketed them. Selling software without an existing network seems nigh-on impossible these days.)

Anyway, congrats to Siracusa on the release, great idea, etc. etc.

Re: Hyperspace

#250

Post by timerol »

bhouston wrote: post #238
lou1306 wrote: post #44

Earlier quoted context omitted.

> it only found 1GB of savings on a 8.1GB folder. You "only" found that 12% of the space you are using is wasted? Am I reading this right?

I have a 512GB drive in my MacBook Air M3 with 225GB free. Saving 1GB is 0.5% of my total free space, and it is definitely "below my line." It is a neat tool still in concept. When I ran it on my home folder with 165GB of data it only found 1.3GB of savings. This isn't that significant to me and it isn't really worth paying for. BTW I highly recommend the free "disk-inventory-x" utility for MacOS space management.

Your original comment did not mention that your home folder was 165 GB, which is extremely relevant here
Post reply on HN