Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

uv: Deduplicate all files in the wheel cache

github.com

Post reply on HN
Print view View original

21–30 of 126 posts

Re: uv: Deduplicate all files in the wheel cache

#21

Post by NoboruWataya »

colechristensen wrote: post #17
CivBase wrote: post #16

A 10% reduction in cache size in exchange for a 4% slowdown doesn't seem obviously worthwhile to me, especially when it comes at an increase in complexity.

Whereas I made a mistake and bought an underspeced MacBook and my 512GB disk is constantly on the brink of full as I reclaim the last 40 GB over and over from different caches, downloads, and wherever else and had to simply give up on several projects because of their disk usage. Disk isn't free, especially now.

Exactly my experience, even worse because for me it's 2x256GB drives. Eventually I bit the bullet and upgraded one of them to 1TB, but not the one my root partition is mounted on (too lazy for that), so now I find myself moving various large directories across to my "extra" drive and symlinking them. Funnily enough I don't remember this ever being a problem back when 50GB was considered a lot.

Re: uv: Deduplicate all files in the wheel cache

#23

Post by nchammas »

dboreham wrote: post #2

People say uv is good because it's fast, but honestly I don't care about that. We switched to using it for distribution of our Python-based tools because it makes it very convenient to install directly from a git repository and then to subsequently update from same repository. No need to build a package.

Maybe I've misunderstood you, but that's not a special advantage of uv. pip has been able to do this for many years.

    pip install git+https://github.com/some-org/repo

Re: uv: Deduplicate all files in the wheel cache

#25

Post by stephenlf »

dboreham wrote: post #2

People say uv is good because it's fast, but honestly I don't care about that. We switched to using it for distribution of our Python-based tools because it makes it very convenient to install directly from a git repository and then to subsequently update from same repository. No need to build a package.

uv is the backbone of any modern Python library.

https://stephenlf.dev/blog/python-library-in-2026/

Re: uv: Deduplicate all files in the wheel cache

#26

Post by colechristensen »

CivBase wrote: post #20
colechristensen wrote: post #17

Earlier quoted context omitted.

Whereas I made a mistake and bought an underspeced MacBook and my 512GB disk is constantly on the brink of full as I reclaim the last 40 GB over and over from different caches, downloads, and wherever else and had to simply give up on several projects because of their disk usage. Disk isn't free, especially now.

I don't disagree. But if you're in that position, surely you'd be better off emptying the cache and disabling it?

The things which use my disk are things like package caches in several languages, build artifacts in both release and debug, multiplied by worktrees, things like iOS device support and release files + simulators, docker containers and related.

I had to give up on things like Lean theorem prover projects and VM projects because the disk space wasn't there.

The causes of disk waste are manifold and usually can't just be disabled and even when they can the result is constant rebuilding, redownloading, etc.

Too many developer products act like disk and memory is free to waste and the consequences have gotten ridiculous.

Re: uv: Deduplicate all files in the wheel cache

#28

Post by gchamonlive »

TacticalCoder wrote: post #3

> deduplication at the file level: every file is now stored under its BLAKE3 hash Blake3 is really a wonderfully fast cryptographic hash. I use it for my own "deduplication / integrity / berzerker" utility (which I made before LLMs were a thing). If I've got a file named: DSC98731-b3-7b39197a22.JPG then: - if that file doesn't checksum back to 7b39197a22 there's a file integrity problem (amazing and it already helped…

> I use it for my own "deduplication / integrity / berzerker" utility

Do you have it in a public repo you could share?

Re: uv: Deduplicate all files in the wheel cache

#29

Post by ashg1-qwzudg »

embedding-shape wrote: post #11
as1297kj wrote: post #10

[flagged]

> By using uv, you are literally supporting the people who want to make you unemployed for stock options. By using any FOSS or software produced by software developers and programmers, you are supporting the idea that computation can and should be automated, instead of having humans doing it. This is the origin of computing, and what we've been doing so far, and it continues to "eat the world" via automation, just li…

That is a false equivalency. FOSS started as a counter movement against Microsoft in order to escape from surveillance and corporate control.

The AI cartel is the new Microsoft.

It is amazing how software developers have been brainwashed. Ted Ts'o, Google employee and pro-AI shill at Debian and LWN, recently argued that supporting AI is similar to supporting the Internet in 2000.

That is another fallacy. The Internet is a common carrier and was supposed to lead to freedom in 2000. It has nothing to do with outsourcing your thinking to a bunch of wannabe trillionaires.

Re: uv: Deduplicate all files in the wheel cache

#30

Post by ashg1-qwzudg »

maeln wrote: post #13
embedding-shape wrote: post #11

Earlier quoted context omitted.

> By using uv, you are literally supporting the people who want to make you unemployed for stock options. By using any FOSS or software produced by software developers and programmers, you are supporting the idea that computation can and should be automated, instead of having humans doing it. This is the origin of computing, and what we've been doing so far, and it continues to "eat the world" via automation, just li…

It's so human that many software engineers started to worry about automation and being replaced when it started to be something that might affect them.

And it is machine like that many software engineers still cheer on being replaced once it is happening.

Software engineers are the socially dumbest creatures on the planet and deserve every bit of scorn that was heaped on them at high school. The industry used them for multi level marketing since about 2010 and now has instructed them to direct the MLM against themselves.

And they comply!

Post reply on HN