> SQLite compiled into WebAssembly fetches pages of the database hosted on IPFS through HTTP range requests using sql.js-httpvfs layer, and then evaluates your query in your browser. Please don't do that with the non-static data. This is okay only for archived project, except the moment when my PC downloads SQLite indexes from some blockchain based paifully slow storage for the first time. BTW, how about a user-gover…
Show HN: Rarbg on IPFS
101–110 of 138 posts
Re: Show HN: Rarbg on IPFS
#102I was curious how this works and then I saw the sqlite requests in the network tab. It's amazing to see what we have access to these days -- SQLite over HTTP over IPFS to provide a giant, censorship-resistant database!
IPFS is distributed but not anonymized, so you can send abuse requests to people's ISPs to take content down (like with torrents). The HTTP part is also not censorship-resistant. ipfs.io has a DMCA process, and they could also be asked to reveal the IP of users.
In practice it's very rare for me to see a direct ipfs protocol link, almost all the traffic goes through HTTP gateways (which frequently cache the content as well). Hard to imagine that they don't become a target for "hosting" pirated content if / when IPFS becomes more than a negligible platform for piracy. (A significant amount of Library Genesis traffic is already using IPFS via these same gateways.)
As you mention, there's a DMCA process for some of the gateways, but that might not be enough to ward off attention.
Re: Show HN: Rarbg on IPFS
#103Earlier quoted context omitted.
Evidence?
I can't share personal messages or such here. I don't feel it would be ok to share either of their obituary. One of them was a very close friend. I knew the other one and there were articles on her published online. Piracy could hurt someone several ways...
Sure...
Re: Show HN: Rarbg on IPFS
#104Earlier quoted context omitted.
it's content addressed, if an ISP was so keen it would be simple to blackhole requests for a particular file (of course, one need only to change 1 bit to get a new content hash, but you have to redistribute the new file from scratch
I don't know about how IPFS is implemented, but you could use content-addressed blocks underneath every file too. This way flipping a bit means that only one underlying block changes, and that the new file would share N-1 blocks with the previous one, making redistribution only require sharing a single block.
Re: Show HN: Rarbg on IPFS
#105The sqlite db contains a imdb column but it seems like the author forgot to include it in the fts4 index, meaning one cannot search for "tt9916362" even though it's right there in the database. It's a shame because this curated mapping is the most useful aspect of RARBG. FYI, this dump has 826'201 magnets (torrents) with an associated imdb ID and 2'017'490 without, including lots of porn but also random music and sof…
> including lots of porn but not all
Re: Show HN: Rarbg on IPFS
#106Earlier quoted context omitted.
I can't share personal messages or such here. I don't feel it would be ok to share either of their obituary. One of them was a very close friend. I knew the other one and there were articles on her published online. Piracy could hurt someone several ways...
So "trust me bro" then. Sure...
Re: Show HN: Rarbg on IPFS
#107Earlier quoted context omitted.
I don't know about how IPFS is implemented, but you could use content-addressed blocks underneath every file too. This way flipping a bit means that only one underlying block changes, and that the new file would share N-1 blocks with the previous one, making redistribution only require sharing a single block.
Well, wouldn't they just blackhole all the relevant blocks then?
Re: Show HN: Rarbg on IPFS
#108Here's a fun way to spend the next 15 minutes on the site. Find search terms that satisfy both the above constraints: 1. Has at least 20 results 2. None of the first 20 results is porn content I even tried with Math and Chess. No dice.
Re: Show HN: Rarbg on IPFS
#109Earlier quoted context omitted.
It's censorship resistant if enough nodes mirror the sqlite file I guess. Is there any incentive for nodes to do so? Is it possible to see a statistic about how many nodes mirror it?
torrents work fine without having a monetary incentive, this misconception of the blockchain crowd really has to die its killing real decentral solutions
Re: Show HN: Rarbg on IPFS
#110Earlier quoted context omitted.
AIUI Lassie uses indexers to locate content instead of using a distributed hash table (DHT). So a content identifier (CID) might be present on IPFS (and downloadable by a regular IPFS client), yet 'invisible' to Lassie. If my understanding is correct, it can't be considered a complete IPFS client. https://docs.filecoin.io/storage-provider/architecture/netwo... https://en.wikipedia.org/wiki/Kademlia
I think it uses indexer and saturn (which ought to fall back to the DHT if it hasn’t cached the content of a CID already). That said they have a GitHub issue tracking CIDs that are retrievable via Kubo (fka go-ipfs) that aren’t yet retrievable via Lassie - it suggests to your point that there must be some difference; it also suggests they intend for retrievability parity though, so fingers crossed!!