Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Show HN: Rarbg on IPFS

ipfs.io

Post reply on HN
Print view View original

31–40 of 138 posts

Re: Show HN: Rarbg on IPFS

#32

Post by ikesau »

willsoon wrote: post #18
hirako2000 wrote: post #4

How does it get updates?

Now IPNS is a thing. Months ago it just didn't work, at least for me, now something is happening in the way IPNS works.

Do you have any advice on how to work out if an IPFS project is using IPNS? I can't see anything on this page that suggests it is, but maybe there's a better, more intentional technique over searching "ipns" in the inspect source and network tab : )

Re: Show HN: Rarbg on IPFS

#36

Post by Zopieux »

The sqlite db contains a imdb column but it seems like the author forgot to include it in the fts4 index, meaning one cannot search for "tt9916362" even though it's right there in the database. It's a shame because this curated mapping is the most useful aspect of RARBG.

FYI, this dump has 826'201 magnets (torrents) with an associated imdb ID and 2'017'490 without, including lots of porn but also random music and software.

Category breakdown (careful though, most items aren't categorized or use a category code I couldn't interpret):

      XXX ( 1):     2,255
      XXX ( 4):       607
   Movies (14):     3,206
   Movies (17):   117,440
       TV (18):   198,314
    Music (23):    11,621
    Music (24):   471,161
    Music (25): 1,339,739

Re: Show HN: Rarbg on IPFS

#38

Post by phiresky »

qersist3nce wrote: post #12
mmastrac wrote: post #2

I was curious how this works and then I saw the sqlite requests in the network tab. It's amazing to see what we have access to these days -- SQLite over HTTP over IPFS to provide a giant, censorship-resistant database!

Can you explain bit more? Isn't the dump of last RARBG magnet links on the order of MBs? We can just download it and grep in plain text. I don't get what is the role of SQLite or IPFS here.

This blog post explains how it works: https://phiresky.github.io/blog/2021/hosting-sqlite-database...

Disclaimer: I wrote that article and was somewhat involved in the other sqlite over ipfs project this is forked from.

Yes, for MB size files just downloading the whole thing will be faster and much easier - even if running in the browser. I'd say the boundary is somewhere around 10MB compressed (~20-200MB uncompressed). Looks like the sqlite dump used here is ~400MB in size, ~180MB compressed. Loading that in the browser would probably work but it wouldn't be too great.

Re: Show HN: Rarbg on IPFS

#39

Post by SergeAx »

> SQLite compiled into WebAssembly fetches pages of the database hosted on IPFS through HTTP range requests using sql.js-httpvfs layer, and then evaluates your query in your browser.

Please don't do that with the non-static data. This is okay only for archived project, except the moment when my PC downloads SQLite indexes from some blockchain based paifully slow storage for the first time. BTW, how about a user-governed local data cache, is there any recent quirks in browsers for that? LocalStorage is still inconsistent and unreliable, right?

Re: Show HN: Rarbg on IPFS

#40

Post by magikstm »

justinclift wrote: post #34
magikstm wrote: post #33

Earlier quoted context omitted.

Yes. I know two persons that did.

Evidence?

I can't share personal messages or such here. I don't feel it would be ok to share either of their obituary.

One of them was a very close friend. I knew the other one and there were articles on her published online.

Piracy could hurt someone several ways...

Post reply on HN