Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Pirate Library Mirror: Preserving 7TB of books (that are not in Libgen)

pilimi.org

Post reply on HN
Print view View original

41–50 of 438 posts

Re: Pirate Library Mirror: Preserving 7TB of books (that are not in Libgen)

#41

Post by cookiengineer »

SquareWheel wrote: post #10
quazar wrote: post #7

Earlier quoted context omitted.

It's a read only blog with 2 pages. What do you gain for putting this over HTTPS?

Do you really want your ISP to know which piracy sites you frequent? This is all being sent in plain text. Or they could change the content, insert a redirect, or inject ads without your knowledge. TLS is needed on all websites - not just those with interaction.

I hate to break it to you, but why do you think ISPs override the DNS responses with TTL set to 0?

TLS itself is only useful if you also rely on DNS over HTTPS/TLS. Well, setting the issues with TLS 1.2 and earlier aside.

Re: Pirate Library Mirror: Preserving 7TB of books (that are not in Libgen)

#42

Post by emj »

ars wrote: post #15
uniqueuid wrote: post #4

It's really funny to think about how the advances of technology keeps changing how we perceive books. 7TB is even a commodity disk these days. And it's a lot less than the torrent of scientific papers that floated around some time ago (that was ~18TB IIRC).

It's 7TB compressed. If it's text you'd need about 70TB to decompress it. It's probably mostly images though, so probably not quite that bad.

I've tried to do lossy compression of epubs with some lines of bash scripts; i.e. removing the images and fonts that were not needed. Many epubs could be downsized to a third of their size, but then I found a book that needed the supplied fonts and gave up. When doing lossy compressions can not have those kind of bugs.

What I also found was that many of the images in the epubs were already unuseable and nothing like their counter parts in phsyical books.

Re: Pirate Library Mirror: Preserving 7TB of books (that are not in Libgen)

#43

Post by enriquto »

robonerd wrote: post #19
generalizations wrote: post #17

Earlier quoted context omitted.

https won't keep your ISP from knowing you visited the site. And the rest of those? For a text-only blog, they seem kinda trivial.

> For a text-only blog If somebody MITMs it, they can serve you anything they want.

> they can serve you anything they want.

Great. More books!

No really, I don't understand this argument. A static site served by plain http is perfectly appropriate. It's like a poster hanging on the wall for all to see. Of course people can paint over it, but it doesn't really matter.

Re: Pirate Library Mirror: Preserving 7TB of books (that are not in Libgen)

#44

Post by cookiengineer »

simlevesque wrote: post #25
generalizations wrote: post #17

Earlier quoted context omitted.

https won't keep your ISP from knowing you visited the site. And the rest of those? For a text-only blog, they seem kinda trivial.

> https won't keep your ISP from knowing you visited the site If you use DoH, yes it does. Unless I'm mistaken. They only know the IP address of the remote server.

> They only know the IP address of the remote server.

It's the internet. Everyone can scrape links and measure/correlate which assets were on them to correlate likely visited websites.

Especially if every web page these days is pretty unique in terms of what kind of assets (network streams) with what kind of byte size were loaded at which point in the document loading timeline.

Now include the TLS fingerprint of your web browser and well, privacy went to shit.

HTTP needs an upgrade with scattering and rerouting on the fly, otherwise these deanonymization techniques can never be fixed.

Re: Pirate Library Mirror: Preserving 7TB of books (that are not in Libgen)

#45

Post by brewdad »

InCityDreams wrote: post #40
mkl wrote: post #30

Earlier quoted context omitted.

*wary For some reason I'm seeing this mistake more and more lately. https://en.wiktionary.org/wiki/weary vs https://en.wiktionary.org/wiki/wary

No room for auto-correct?

Even so, there are enough ESL readers on here, along with native speakers who may not understand the difference, that it makes sense to point it out once in a while.

Otherwise we end up in lose/loose situation where I see more people use it wrongly than correctly.

Re: Pirate Library Mirror: Preserving 7TB of books (that are not in Libgen)

#46

Post by solarmist »

emj wrote: post #42
ars wrote: post #15

Earlier quoted context omitted.

It's 7TB compressed. If it's text you'd need about 70TB to decompress it. It's probably mostly images though, so probably not quite that bad.

I've tried to do lossy compression of epubs with some lines of bash scripts; i.e. removing the images and fonts that were not needed. Many epubs could be downsized to a third of their size, but then I found a book that needed the supplied fonts and gave up. When doing lossy compressions can not have those kind of bugs. What I also found was that many of the images in the epubs were already unuseable and nothing like…

I don’t understand this. Are they epubs of comics or something? Epubs are already compressed (zip).

Re: Pirate Library Mirror: Preserving 7TB of books (that are not in Libgen)

#47

Post by robonerd »

enriquto wrote: post #43
robonerd wrote: post #19

Earlier quoted context omitted.

> For a text-only blog If somebody MITMs it, they can serve you anything they want.

> they can serve you anything they want. Great. More books! No really, I don't understand this argument. A static site served by plain http is perfectly appropriate. It's like a poster hanging on the wall for all to see. Of course people can paint over it, but it doesn't really matter.

They could serve you javascript that exploits your browser. At the very least, they could replace that bitcoin donation address with their own. That's a tempting target if nothing else.

Re: Pirate Library Mirror: Preserving 7TB of books (that are not in Libgen)

#48

Post by PostOnce »

dkjaudyeqooe wrote: post #21

To be fair, Z-Library doesn't charge unless you want to download more than 10 books per 24 hour period. That's per account and although they ask you not to open multiple accounts they don't seem to do anything to stop you.

What kind of fairness can there be in charging for stolen books?

I believe in free access to education, but charging for these books they have no rights to is a whole other thing.

Re: Pirate Library Mirror: Preserving 7TB of books (that are not in Libgen)

#49

Post by mkl »

InCityDreams wrote: post #40
mkl wrote: post #30

Earlier quoted context omitted.

*wary For some reason I'm seeing this mistake more and more lately. https://en.wiktionary.org/wiki/weary vs https://en.wiktionary.org/wiki/wary

No room for auto-correct?

Seems unlikely, as "wary" appears to be the more common word (71M Google results vs 55M). Maybe some keyboard mistakenly does it though.

Re: Pirate Library Mirror: Preserving 7TB of books (that are not in Libgen)

#50

Post by robonerd »

solarmist wrote: post #46
emj wrote: post #42

Earlier quoted context omitted.

I've tried to do lossy compression of epubs with some lines of bash scripts; i.e. removing the images and fonts that were not needed. Many epubs could be downsized to a third of their size, but then I found a book that needed the supplied fonts and gave up. When doing lossy compressions can not have those kind of bugs. What I also found was that many of the images in the epubs were already unuseable and nothing like…

I don’t understand this. Are they epubs of comics or something? Epubs are already compressed (zip).

It's not terribly uncommon to find an epub with several megabytes of cover art and a few hundred kilobytes of text.
Post reply on HN