Live data from Hacker News

Show HN: Rarbg on IPFS

ipfs.io

101–110 of 138 posts

Re: Show HN: Rarbg on IPFS

#101
post #39

> SQLite compiled into WebAssembly fetches pages of the database hosted on IPFS through HTTP range requests using sql.js-httpvfs layer, and then evaluates your query in your browser. Please don't do that with the non-static data. This is okay only for archived project, except the moment when my PC downloads SQLite indexes from some blockchain based paifully slow storage for the first time. BTW, how about a user-gover…

IPFS isn't blockchain based. It's slowness is mostly because it is badly implemented.

Re: Show HN: Rarbg on IPFS

#102
post #52
post #2

I was curious how this works and then I saw the sqlite requests in the network tab. It's amazing to see what we have access to these days -- SQLite over HTTP over IPFS to provide a giant, censorship-resistant database!

IPFS is distributed but not anonymized, so you can send abuse requests to people's ISPs to take content down (like with torrents). The HTTP part is also not censorship-resistant. ipfs.io has a DMCA process, and they could also be asked to reveal the IP of users.

> you can send abuse requests to people's ISPs

In practice it's very rare for me to see a direct ipfs protocol link, almost all the traffic goes through HTTP gateways (which frequently cache the content as well). Hard to imagine that they don't become a target for "hosting" pirated content if / when IPFS becomes more than a negligible platform for piracy. (A significant amount of Library Genesis traffic is already using IPFS via these same gateways.)

As you mention, there's a DMCA process for some of the gateways, but that might not be enough to ward off attention.

Re: Show HN: Rarbg on IPFS

#103

Earlier quoted context omitted.

Evidence?

I can't share personal messages or such here. I don't feel it would be ok to share either of their obituary. One of them was a very close friend. I knew the other one and there were articles on her published online. Piracy could hurt someone several ways...

So "trust me bro" then.

Sure...

Re: Show HN: Rarbg on IPFS

#104

Earlier quoted context omitted.

it's content addressed, if an ISP was so keen it would be simple to blackhole requests for a particular file (of course, one need only to change 1 bit to get a new content hash, but you have to redistribute the new file from scratch

I don't know about how IPFS is implemented, but you could use content-addressed blocks underneath every file too. This way flipping a bit means that only one underlying block changes, and that the new file would share N-1 blocks with the previous one, making redistribution only require sharing a single block.

Well, wouldn't they just blackhole all the relevant blocks then?

Re: Show HN: Rarbg on IPFS

#105
post #96
post #36

The sqlite db contains a imdb column but it seems like the author forgot to include it in the fts4 index, meaning one cannot search for "tt9916362" even though it's right there in the database. It's a shame because this curated mapping is the most useful aspect of RARBG. FYI, this dump has 826'201 magnets (torrents) with an associated imdb ID and 2'017'490 without, including lots of porn but also random music and sof…

> including lots of porn but not all

that's right, it's missing all of the vr180 stuff, and seems like it might have been the only place to find it.

Re: Show HN: Rarbg on IPFS

#106

Earlier quoted context omitted.

I can't share personal messages or such here. I don't feel it would be ok to share either of their obituary. One of them was a very close friend. I knew the other one and there were articles on her published online. Piracy could hurt someone several ways...

So "trust me bro" then. Sure...

What's your email? I'll send you one.

Re: Show HN: Rarbg on IPFS

#107

Earlier quoted context omitted.

I don't know about how IPFS is implemented, but you could use content-addressed blocks underneath every file too. This way flipping a bit means that only one underlying block changes, and that the new file would share N-1 blocks with the previous one, making redistribution only require sharing a single block.

Well, wouldn't they just blackhole all the relevant blocks then?

Yes. Probably there's no replacement for privacy and anonymity being baked in into the system.

Re: Show HN: Rarbg on IPFS

#108

Here's a fun way to spend the next 15 minutes on the site. Find search terms that satisfy both the above constraints: 1. Has at least 20 results 2. None of the first 20 results is porn content I even tried with Math and Chess. No dice.

Got it on the first try with Star Wars

Re: Show HN: Rarbg on IPFS

#109
post #8

Earlier quoted context omitted.

It's censorship resistant if enough nodes mirror the sqlite file I guess. Is there any incentive for nodes to do so? Is it possible to see a statistic about how many nodes mirror it?

torrents work fine without having a monetary incentive, this misconception of the blockchain crowd really has to die its killing real decentral solutions

They dont. Do a search of something older than 5 years in btdigg and you will most likely get only dead magnets.

Re: Show HN: Rarbg on IPFS

#110

Earlier quoted context omitted.

AIUI Lassie uses indexers to locate content instead of using a distributed hash table (DHT). So a content identifier (CID) might be present on IPFS (and downloadable by a regular IPFS client), yet 'invisible' to Lassie. If my understanding is correct, it can't be considered a complete IPFS client. https://docs.filecoin.io/storage-provider/architecture/netwo... https://en.wikipedia.org/wiki/Kademlia

I think it uses indexer and saturn (which ought to fall back to the DHT if it hasn’t cached the content of a CID already). That said they have a GitHub issue tracking CIDs that are retrievable via Kubo (fka go-ipfs) that aren’t yet retrievable via Lassie - it suggests to your point that there must be some difference; it also suggests they intend for retrievability parity though, so fingers crossed!!

This issue, right?

https://github.com/filecoin-project/lassie/issues/136

Post reply on HN