Live data from Hacker News

Show HN: Rarbg on IPFS

ipfs.io

81–90 of 138 posts

Re: Show HN: Rarbg on IPFS

#81

https://rarbg.tw still works for me. I don't get it, isn't Rarbg supposed to be down?

Because that's not rarbg, rarbg is "rarbg.to", not rarbg.tw, rargb.to, rarbggo.to, rarbgproxy.to, rarbgmirror.org, rarbgaccessed.org, rarbgget.org

Re: Show HN: Rarbg on IPFS

#82
post #61

Related: I just dropped a mega DB archive dump for everything I have with regard to RARBG. My hope is others will find this useful. https://github.com/sleaze/rarbg-db-dumps https://news.ycombinator.com/item?id=36187767

This is just amazing work!

I have a question for you as even playing with this or creating oss project using this sounds like inviting trouble. So if any programmer wants to create an open source project using this data (just for kicks) then apart from using a VPN and throwaway email do you need to be careful about anything else? Any tips?

Re: Show HN: Rarbg on IPFS

#83
Here's a fun way to spend the next 15 minutes on the site. Find search terms that satisfy both the above constraints:

1. Has at least 20 results

2. None of the first 20 results is porn content

I even tried with Math and Chess. No dice.

Re: Show HN: Rarbg on IPFS

#84

Here's a fun way to spend the next 15 minutes on the site. Find search terms that satisfy both the above constraints: 1. Has at least 20 results 2. None of the first 20 results is porn content I even tried with Math and Chess. No dice.

"Quantum" works.

That was my second attempt, I tried "physics" first but oh boy was I naive.

Re: Show HN: Rarbg on IPFS

#86
post #2

I was curious how this works and then I saw the sqlite requests in the network tab. It's amazing to see what we have access to these days -- SQLite over HTTP over IPFS to provide a giant, censorship-resistant database!

it's content addressed, if an ISP was so keen it would be simple to blackhole requests for a particular file (of course, one need only to change 1 bit to get a new content hash, but you have to redistribute the new file from scratch

I don't know about how IPFS is implemented, but you could use content-addressed blocks underneath every file too. This way flipping a bit means that only one underlying block changes, and that the new file would share N-1 blocks with the previous one, making redistribution only require sharing a single block.

Re: Show HN: Rarbg on IPFS

#87
post #70

This works by doing range requests on an sqlite DB. Very cool, but does ipfs support verification of partial reads like this? (or would I need to download the whole DB and check the hash?) I can think of some ways it could work using merkle trees or similar, but I have no idea what ipfs does under the hood, if anything.

IPFS doesn't currently. But there are some in the community working on exactly this using Blake3 and BAO.

Re: Show HN: Rarbg on IPFS

#88
post #58

Earlier quoted context omitted.

I said "incentive". You made it "monetary incentive". What do you mean with "torrents work fine"? Do you have any statistics on the lifetime of torrents? Everything ever written to the Bitcoin blockchain is still available and massively distributed. It seems very unlikely anything will ever get lost during our lifetime. So I would say that is an example that monetary incentives do work?

>Everything ever written to the Bitcoin blockchain is still available This isn't useful for 99% of stuff and pushing every video and music file on earth through a global state machine with the performance characteristics of an Atari from the 80s would render the thing inoperable. The entire Bitcoin network has a bandwidth of like 1mb every 10 minutes, the total size of the blockchain is half a TB in total, people tor…

IPFS is not a blockchain in the traditional sense. You might be conflating it with Filecoin.

Re: Show HN: Rarbg on IPFS

#89
post #82
post #61

Related: I just dropped a mega DB archive dump for everything I have with regard to RARBG. My hope is others will find this useful. https://github.com/sleaze/rarbg-db-dumps https://news.ycombinator.com/item?id=36187767

This is just amazing work! I have a question for you as even playing with this or creating oss project using this sounds like inviting trouble. So if any programmer wants to create an open source project using this data (just for kicks) then apart from using a VPN and throwaway email do you need to be careful about anything else? Any tips?

Never link discussion of it with your other alts. ;)

Re: Show HN: Rarbg on IPFS

#90
post #70

This works by doing range requests on an sqlite DB. Very cool, but does ipfs support verification of partial reads like this? (or would I need to download the whole DB and check the hash?) I can think of some ways it could work using merkle trees or similar, but I have no idea what ipfs does under the hood, if anything.

IPFS doesn't currently. But there are some in the community working on exactly this using Blake3 and BAO.

The incremental requests are verified if running through your own node as a side effect of loading the data
Post reply on HN