Live data from Hacker News

Show HN: Rarbg on IPFS

ipfs.io

111–120 of 138 posts

Re: Show HN: Rarbg on IPFS

#111

Earlier quoted context omitted.

torrents work fine without having a monetary incentive, this misconception of the blockchain crowd really has to die its killing real decentral solutions

They dont. Do a search of something older than 5 years in btdigg and you will most likely get only dead magnets.

They do on private trackers where there is an incentive usually tied to ratio or seed time. It's not a monetary incentive and it works.

Re: Show HN: Rarbg on IPFS

#113
post #76

Earlier quoted context omitted.

No, most BitTorrent clients support a Kad based DHT for discovering peers.

Pure DHT peer-discovery alone isn't that great but keep in mind that the magnet points to a .torrent file, which usually does contain a list of traditional trackers for the file.

The magnet doesn't point to a torrent file, but it can contain links to trackers (and other metadata as well).

Re: Show HN: Rarbg on IPFS

#114
post #76

Earlier quoted context omitted.

Pure DHT peer-discovery alone isn't that great but keep in mind that the magnet points to a .torrent file, which usually does contain a list of traditional trackers for the file.

Why isn’t it great? You’re the first person I’ve met that has made this assertion.

Discovery via DHT is much slower than a tracker.

Re: Show HN: Rarbg on IPFS

#115
post #76

Earlier quoted context omitted.

No, most BitTorrent clients support a Kad based DHT for discovering peers.

Pure DHT peer-discovery alone isn't that great but keep in mind that the magnet points to a .torrent file, which usually does contain a list of traditional trackers for the file.

fun, trivial trick, the magnet link is not necessary. all you need is the infohash. it is however very slow without the tracker hints.

    echo "magnet:?xt=urn:btih:${info_hash}"
ipfs basically feels like "this is it guys, our entire access pattern is going to be this"

Re: Show HN: Rarbg on IPFS

#116
post #2

I was curious how this works and then I saw the sqlite requests in the network tab. It's amazing to see what we have access to these days -- SQLite over HTTP over IPFS to provide a giant, censorship-resistant database!

Can you explain bit more? Isn't the dump of last RARBG magnet links on the order of MBs? We can just download it and grep in plain text. I don't get what is the role of SQLite or IPFS here.

> Isn't the dump of last RARBG magnet links on the order of MBs?

As I understand it, the purpose of using SQLite is indexing and querying, ie. being able to efficiently search through the data via a website.

Re: Show HN: Rarbg on IPFS

#117

Earlier quoted context omitted.

>Everything ever written to the Bitcoin blockchain is still available This isn't useful for 99% of stuff and pushing every video and music file on earth through a global state machine with the performance characteristics of an Atari from the 80s would render the thing inoperable. The entire Bitcoin network has a bandwidth of like 1mb every 10 minutes, the total size of the blockchain is half a TB in total, people tor…

IPFS is not a blockchain in the traditional sense. You might be conflating it with Filecoin.

ok.

but nobody said otherwise

Re: Show HN: Rarbg on IPFS

#118
post #61

Related: I just dropped a mega DB archive dump for everything I have with regard to RARBG. My hope is others will find this useful. https://github.com/sleaze/rarbg-db-dumps https://news.ycombinator.com/item?id=36187767

How does this compare to the ipfs dump that someone claimed has over 2 million entries? Your DB dump has only around 1.6 million... so does ipfs have duplicates? or is there something substantial missing in your dump?

Re: Show HN: Rarbg on IPFS

#119
post #76

Earlier quoted context omitted.

No, most BitTorrent clients support a Kad based DHT for discovering peers.

Pure DHT peer-discovery alone isn't that great but keep in mind that the magnet points to a .torrent file, which usually does contain a list of traditional trackers for the file.

Actually, a minimal magnet link only contains the infohash which "points" at just the info section of the torrent file. The info section contains the name, list of files and SHA1 hashes for all pieces, and the private flag.

The trackers are outside of info section, I assume so the list of trackers can be modified without effecting the info hash.

Though, some magnet links include an optional xs parameter which points at an http url containing the .torrent file, which would include the trackers.

In my experience, you don't receive the trackers from other peers (though maybe other bittorrent clients can?). However, if at least one peer you discover via DHT supports the peer exchange protocol, and has the trackers, your client can quickly query all the relevant peers.

Post reply on HN