Related: I just dropped a mega DB archive dump for everything I have with regard to RARBG. My hope is others will find this useful.
Show HN: Rarbg on IPFS
61–70 of 138 posts
Re: Show HN: Rarbg on IPFS
#62Earlier quoted context omitted.
I think your post needs to clarify this is true only if you use the ipfs client to access things hosted on ipfs. Accessing ipfs.io/ipfs/ doesn’t do anything you mentioned. Its just a gateway. You could take the link on the main submission. And replace ipfs.io with any (most, because some are offline) of the links here https://ipfs.github.io/public-gateway-checker/ And it will still work.
That's true, and I should have clarified that. However, is using a proxy like ipfs.io really using ipfs? If everyone did that, there's no point to using this protocol. The strength of the network comes from the fact that the content gets replicated/distributed when accessed. That doesn't happen when accessed through a proxy.
The benefit is ease of access, if content gets blocked on one mirror (ipfs.io), it may be available on another (cloudflare-ipfs.com/ipfs/, etc)
Re: Show HN: Rarbg on IPFS
#63A note of caution for those unfamiliar with how IPFS works. It's very similar to BitTorrent with how content distribution happens. Your local node will broadcast which content it has available (downloaded). If you access a piece of content you automatically become a host for it so you still need to use a VPN if you live in a country where you can get sued.
Using Brave it makes this very clear, the above link won't open by default without the user choosing to run a local node or use a public gateway instead. It explains the implications of both options. Screenshot: https://i.imgur.com/ZP6AgPp.png
Most browsers don't support the ipfs protocol and instead only use the gateway.
Re: Show HN: Rarbg on IPFS
#64The sqlite db contains a imdb column but it seems like the author forgot to include it in the fts4 index, meaning one cannot search for "tt9916362" even though it's right there in the database. It's a shame because this curated mapping is the most useful aspect of RARBG. FYI, this dump has 826'201 magnets (torrents) with an associated imdb ID and 2'017'490 without, including lots of porn but also random music and sof…
so what's to change in index file?
Re: Show HN: Rarbg on IPFS
#65A note of caution for those unfamiliar with how IPFS works. It's very similar to BitTorrent with how content distribution happens. Your local node will broadcast which content it has available (downloaded). If you access a piece of content you automatically become a host for it so you still need to use a VPN if you live in a country where you can get sued.
Using Brave it makes this very clear, the above link won't open by default without the user choosing to run a local node or use a public gateway instead. It explains the implications of both options. Screenshot: https://i.imgur.com/ZP6AgPp.png
I love Brave, so useful.
Re: Show HN: Rarbg on IPFS
#66Re: Show HN: Rarbg on IPFS
#67On a side note: The Eye is back up!
Fuck yeah <3
Re: Show HN: Rarbg on IPFS
#68Is there an IPFS dedicated to training data? A mirror of input datasets and fully open models resident on HuggingFace could endeavor to cut out onerous license agreements when possible.
Re: Show HN: Rarbg on IPFS
#69Earlier quoted context omitted.
By default, what the GP says is true. If you can point to specific popular clients that do not have that behavior by default then I think that would be more convincing than saying "Well technically there's no requirement " when it's impossible to avoid in practice without writing your own custom implementation from scratch
Afaiu, [Lassie]( https://github.com/filecoin-project/lassie/ ) is the latest and greatest of IPFS clients and it does not store/provide any data that you access
AIUI Lassie uses indexers to locate content instead of using a distributed hash table (DHT). So a content identifier (CID) might be present on IPFS (and downloadable by a regular IPFS client), yet 'invisible' to Lassie.
If my understanding is correct, it can't be considered a complete IPFS client.
https://docs.filecoin.io/storage-provider/architecture/netwo...
Re: Show HN: Rarbg on IPFS
#70This works by doing range requests on an sqlite DB.
Very cool, but does ipfs support verification of partial reads like this? (or would I need to download the whole DB and check the hash?)
I can think of some ways it could work using merkle trees or similar, but I have no idea what ipfs does under the hood, if anything.