Live data from Hacker News

WikipediaP2P

wikipediap2p.org

41–50 of 117 posts

Re: WikipediaP2P

#41

I remember thinking about a similar concept a few years back. It would be good to have a p2p archive of human knowledge for end of the world scenarios. The problem is Bittorrent isn't the protocol for it, it doesn't allow incremental changes. You also don't want the complete history like git, you want something that passes a diff around. It would be great to have a p2p network with Wikipedia, a load of academic paper…

I agree with your last statement, and think this is a great proof-of-concept for distributed networking.

I worry, though, that this space is fracturing in a way that's hampering adoption. Between Freenet, Zeronet, IFPS, I2P, not to mention things like Retroshare, Matrix, and so forth, there's a lot of redundancy but with important differences between any given two solutions. I'm not sure what can be done about it, but it seems like something in this area needs a network effect to accelerate adoption, but to do that, it needs to be comprehensive in what it offers while also being sufficiently differentiable from other projects. It's great to see so much going on in this area, but it's getting difficult to know what does what, and where one might put some resources.

Re: WikipediaP2P

#42
post #30

Is it just me that gets put off by typos and other errors on a homepage? I feel like putting a little effort in to checking for obvious errors isn't too much to ask, but I may well be being overly snobby about such things, I'm curious. The two examples here are: > This color means it's rearching for that article. I assume that's meant to be 'searching' And: > This is an unofficial extension and not entitled by Wikipe…

I agree. By the way, you typo'd "things" as "thinks".

Oh the irony. Corrected.

Re: WikipediaP2P

#44
post #32

We'd be better off by putting wikipedia on IPFS and IPFS into p2p cache.

If it's execution is similar to this project where hosting a page on your system is effortless (or at most a one-click affair), then it's definitely something I can get behind.

You'll get the benefit of insuring off-line availability as well as only hosting pages you care about. Win-win.

Re: WikipediaP2P

#45
post #36
post #31

Earlier quoted context omitted.

I'm assuming non-native writer rather than sloppiness per se.

I'd considered that. That would explain the second, but the first has to be sloppiness. If nothing else, if you want to produce english content, set your spellchecker to english.

I think the first one is meant to be "reaching"?

Re: WikipediaP2P

#47
post #32

We'd be better off by putting wikipedia on IPFS and IPFS into p2p cache.

I agree, but sadly IPFS still needs some optimization for that to be feasible.

I published the whole Wikidata dataset as separately accessible entities to IPFS and the initial publishing took ~2 weeks. Theoretically updating the dataset with weekly changes should be pretty fast after that, but if there is a change that impacts the JSON structure of every entity you have to start all over (which recently happened).

Right now Wikipedia/Wikidata is only really useful as a stress test for IPFS, but I'm optimistic for the future.

For anyone interested in this there is some (slow) progress on this at https://github.com/ipfs-wikidata , though it's admittedly a low priority for me right now, as I wait for the technical state of IPFS to improve.

Re: WikipediaP2P

#48
I understand that this is an early implementation.

Nevertheless, I have a question: how does it make sure the site you receive is actually the

a) correct one (someone could distribute incorrect pages e.g. about controversial topics like North Korea or Climate Change; or inject some malicious code that e.g. uses your account to submit changes to wikipedia)

b) most recent one (or at least a reasonably new one).

I imagine the first one could maybe be somehow guaranteed through the protocol. Maybe you can just solve the second by invalidating your local copy after it is more than one day old.

The github link on the homepage does sadly not work for me (firefox on linux), so I can't check.

Re: WikipediaP2P

#50
post #49

Stop using my internet connection without my consent!

How is a browser extension you explicitly have to install, from a page that explains what it does, "using your internet connection without consent"?
Post reply on HN