Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

A search engine for searching books in the Z-Library index on the IPFS network

zlib.zu1k.com

Post reply on HN
Print view View original

11–20 of 215 posts

Re: A search engine for searching books in the Z-Library index on the IPFS network

#11

Post by Nican »

ComputerGuru wrote: post #7
Nican wrote: post #4

I like reading about IPFS, but I do not really have the time to learn about it and get involved. Last I remember, Z-Library was having an issue scaling the DHS to handle the number of files [1]. Did those issues get resolved? How is it going now? Also, is there anything being done to ensure every file has seeders? [1] https://news.ycombinator.com/item?id=33716560

ZFS (Zettabyte File System) is very much separate from Z-Library (and its alternative frontends like libgen).

Thanks. My brain crossed wires between Z-Library and IPFS. I updated my post.

Re: A search engine for searching books in the Z-Library index on the IPFS network

#12

Post by ComputerGuru »

Nican wrote: post #11
ComputerGuru wrote: post #7

Earlier quoted context omitted.

ZFS (Zettabyte File System) is very much separate from Z-Library (and its alternative frontends like libgen).

Thanks. My brain crossed wires between Z-Library and IPFS. I updated my post.

Completely understandable!

Re: A search engine for searching books in the Z-Library index on the IPFS network

#14

Post by survirtual »

Nican wrote: post #4

I like reading about IPFS, but I do not really have the time to learn about it and get involved. Last I remember, Z-Library was having an issue scaling the DHS to handle the number of files [1]. Did those issues get resolved? How is it going now? Also, is there anything being done to ensure every file has seeders? [1] https://news.ycombinator.com/item?id=33716560

I’ve dived deep into IPFS and built several prototypes on top of it. It ended up not being performant enough for me, and that was after heavily modifying the codebase so that it was true p2p browser & server (their webrtc transport had a lot of issues and they didn’t seem too interested in it, but my needs required it as a backbone).

The security was also a concern, and the scaling had issues. Pinning millions of small items got so slow it would not function. Then I ended up having concerns over hashed based addressing being easy to censor with the architecture IPFS was using (more hub & spoke than anything, given signaling and relay servers were centralized).

I could go on but I ran into so many issues I ended up implementing my own solution that did everything I wanted. Wanted to squeeze even more performance, I’ve been converting that solution to Rust.

This was a couple years ago so maybe things have changed since I used it. Last I checked, they seemed busy on Filecoin.

The idea of IPFS is great and I want to see it succeed, but I think that they got so caught up in their jargon and modularity, the project lost track of some fundamentals.

Re: A search engine for searching books in the Z-Library index on the IPFS network

#16

Post by password4321 »

survirtual wrote: post #14
Nican wrote: post #4

I like reading about IPFS, but I do not really have the time to learn about it and get involved. Last I remember, Z-Library was having an issue scaling the DHS to handle the number of files [1]. Did those issues get resolved? How is it going now? Also, is there anything being done to ensure every file has seeders? [1] https://news.ycombinator.com/item?id=33716560

I’ve dived deep into IPFS and built several prototypes on top of it. It ended up not being performant enough for me, and that was after heavily modifying the codebase so that it was true p2p browser & server (their webrtc transport had a lot of issues and they didn’t seem too interested in it, but my needs required it as a backbone). The security was also a concern, and the scaling had issues. Pinning millions of sma…

> my own solution that did everything I wanted

Your ideas are intriguing to me and I wish to subscribe to your newsletter!

(I really would appreciate any pointers to additional info on something that actually works...)

Re: A search engine for searching books in the Z-Library index on the IPFS network

#17

Post by layer8 »

ComputerGuru wrote: post #9

FWIW https://libgen.rs already has good search for basically the same books. I like the denser layout that makes better use of whitespace than this HN submission does.

Has LibGen already caught up to Z-Library? I thought that was still very much a work in progress.

Re: A search engine for searching books in the Z-Library index on the IPFS network

#19

Post by mdaniel »

hosh wrote: post #5
jesusofnazarath wrote: post #2

looks great. Is there an api for something like this so i can make it an extension of my terminal?

You can self-host it: https://github.com/zlib-searcher/zlib-searcher

Wow, I had no idea GitHub releases would tolerate such a huge release asset: https://github.com/zlib-searcher/zlib-searcher/releases (index_0.6.zip is 1.48GB and index_0.5.zip is 1.75GB) It seems their API docs do talk about 502s during upload, but don't otherwise specify a limit: https://docs.github.com/en/rest/releases/assets?apiVersion=2...

The irony of not hosting them on IPFS does not escape me :-/

Re: A search engine for searching books in the Z-Library index on the IPFS network

#20

Post by rockemsockem »

staunch wrote: post #18

I'm looking forward to some new AI system making it possible to generate high quality audiobooks from epub files. This "AI book reader" doesn't exist yet, right?

Working on this now, cherry-picked audio from such AI systems abound, but submitting arbitrary text for audio synthesis requires a much higher quality bar to be listenable. Planning to have something out early 2023.
Post reply on HN