Live data from Hacker News

Decentralized Web Primer

gitbook.com

61–70 of 97 posts

Re: Decentralized Web Primer

#61
post #47
post #18

"The Decentralized Web" is the WWW system Tim Berners-Lee invented and that we're all using right now. It relies on the DNS and HTTP protocols. This new IPFS-based decentralized web is interesting but it's not even a measurable percentage of web traffic today. Far from being "The". What we need more than anything is to actually realize the beautiful dream TBL had for the WWW. HN is one great example but there should…

Agreed. As cool as IPFS is, I only clicked on it because I thought it was going to explain how to scale my Tim Berners-Lee WWW server in a decentralized way (without relying on some big monolithic company). Has anyone seen a primer like that? As for IPFS, I’d love to see them succeed, but as long as you have to know about merkle trees, hashing, etc for it, it’s not going to be any more mainstream than things like PGP…

> As for IPFS, I’d love to see them succeed, but as long as you have to know about merkle trees, hashing, etc for it

You have to know about this stuff to use ipfs like you have to know about low level packet routing to use the internet.

Re: Decentralized Web Primer

#62
post #50

Earlier quoted context omitted.

>""The Decentralized Web" is the WWW system Tim Berners-Lee invented and that we're all using right now." I believe the context of "The Decentralized Web" here is meant to contrast the increasing centralization of content from FB, Google, Medium, login walls pay-walls etc.

Those sites are all part of the decentralized web. Port 80 on my laser printer, router and flower pot are too. Using old well-defined terms to describe new concepts just leads to confusion. It would be like writing a story called “the history of the industrial revolution” that’s really about 3d printers.

The term "decentralized" is used, because TBL's Web evolved into an effectively very centralized system, at the levels of both logical architecture and data ownership.

Sure your laser printer can serve a webpage. But nobody cares! They don't care to the extent that your printer-page will most likely not even be accessible, given the default settings on your or your ISP's routers.

In practice, most of your - and everyone else's - web traffic goes through the same few services. It doesn't matter that each of those services is made from a thousand servers each - logically, they form a single unit, and the web has mostly a star topology. This leads to ridiculously stupid amounts of waste at the endpoints - if you and me are sitting in the same room and both want to watch the same funny cat video, we both download gigabytes off youtube, even though after you downloaded the video I should be perfectly able to stream it off your machine via LAN. We use CDNs these days, which are literally top-down dictatorship style attempt at forcing some minimum distribution into this centralized system.

The web is centralized. Your comparison with writing a story would be more accurate like this: it's like someone writing a story about "modern slavery" that's really about wage slavery. Yes, the social phenomenon of actual slavery has pretty much disappeared, but we've replaced it with something similar with similar issues, only one level of abstraction higher.

Re: Decentralized Web Primer

#63

Unless your project needs censorship resistance, you can probably ignore this.

You can still consider learning about it and supporting it if you dislike the wastefulness/inefficiency of present-day web, or hate how fragile and ephemeral it is.

Re: Decentralized Web Primer

#64
post #55

Earlier quoted context omitted.

P2P is not like the cloud. It's someone else's computer, but you don't know nor care what the exact machine you are connecting to because they are mostly untrusted.

I just made an analogy, didn't say it was the same thing as the cloud. My point was that in a P2P architecture you must be a server, everyone else must be a server. And being a server is costly. There must be incentives for someone to be a server, and that's not easy. I actually don't remember a single P2P protocol or framework that has solved that problem yet. Perhaps Bitcoin -- for miners only, not for normal nodes…

It appears BitTorrent solved the problem well enough. There's already an incentive to share, because nodes who don't are eventually ignored by the others (if I recall correctly). As for the operating costs… they don't seem very high unless you're operating a tracker. I mean, it's just a matter of running a BitTorrent client, and not even all the time (unless you want to reliably seed something).

The real problem there is the asymmetry of the bandwidth. If we had as much upload as we had download, we wouldn't have any reason not to shoot for a 1:1 ratio.

Re: Decentralized Web Primer

#65
post #56

Earlier quoted context omitted.

P2P is everyone else's server. Each peer pulls its own weight. This is different from relying on a single entity.

Relying on others is fine, the problem is when someone relies on you. Please see my answer to the other comment.

> the problem is when someone relies on you

I'm not sure what you're getting at. The problem is only magnified with the web: there's only one seed. If a site is down, it's down, and you can only hope Google cache or the web archive got a copy.

That problem is never worse with P2P protocols.

Re: Decentralized Web Primer

#66

Earlier quoted context omitted.

No. The web as it works right now is naturally centralised, for a simple reason: the bandwidth costs on a server is proportional to the size of its audience. This is why we need YouTube to begin with, instead of millions of people posting their videos on their personal page. There are other factors of course: firewalls, asymmetric bandwidth, security issues, technical ignorance… But the client-server model does play…

> This is why we need YouTube to begin with, instead of millions of people posting their videos on their personal page. People can post videos to their own hosted pages already. We "need" YouTube because 1) people generally don't want to host anything, and 2) it provides connectedness (search, related videos, subscribers, etc). P2P makes the first issue worse. The second issue is a problem of data federation, not cli…

> People can post videos to their own hosted pages already.

No they cannot. Here's an example: what if make a nice tutorial, put it on my web site and submit it here and r/programming? If the thing is well done, people will download the video, and the sheer amount of requests may be enough to render my site unresponsive, simply because I don't have the bandwidth.

So If I ever make a video, there's a good chance I host it to YouTube. Despite my reluctance to feed Alphabet. Even though I already operate a server.

> 1) people generally don't want to host anything

People want to publish stuff —that much is obvious. They want to avoid hassles if possible. And they rarely think about what centralised hosting entails.

That doesn't amount to "don't want to host anything". Granted, hosting stuff yourself is a major hassle these days. It doesn't have to be, though.

Re: Decentralized Web Primer

#68
Decentralization is frequently sold as a means against censorship: if we use a decentralized system such as IPFS, we don't need to have a DNS hierarchy to serve content, so it is no longer viable to block a particular domain.

But as long as we have ISPs and a common communications architecture, if we start using a content-addressable system, doesn't that help censorship? As a censor, I jump from having to censor all domains that may serve one particular document (which is difficult, as we can see with pirate bay), to just having to force ISPs to block urls with the hash of the document that I want to censor.

So we go from having to jump among domains, to having to jump among content hashes, which seems much less practical, isn't it?

In my mind, until we have some sort of mesh network with efficient cache systems, the decentralization topic seems (to me) that is providing answers to the wrong questions.

Re: Decentralized Web Primer

#69
post #9
post #2

Could be that I'm just really out of touch, but I need at least one paragraph saying "What is this?" (and ideally also, "Who is the target audience?" - or "Why would I be interested in reading this?")

I'm with you on this one. I had to Google all of this for a few minutes. This is my best interpretation below. I hope others will come in and correct my silly mistakes. (Disclaimer: I'm not a programmer and English is my 2nd language): "So you know how people use BitTorrent to distribute big-budget Hollywood movies with occasional mediocre storylines? What if you could distribute your own data on a similar P2P networ…

While you've done well to filter the language, I still don't get the benefits to the consumer

Re: Decentralized Web Primer

#70
post #18

"The Decentralized Web" is the WWW system Tim Berners-Lee invented and that we're all using right now. It relies on the DNS and HTTP protocols. This new IPFS-based decentralized web is interesting but it's not even a measurable percentage of web traffic today. Far from being "The". What we need more than anything is to actually realize the beautiful dream TBL had for the WWW. HN is one great example but there should…

No. The web as it works right now is naturally centralised, for a simple reason: the bandwidth costs on a server is proportional to the size of its audience. This is why we need YouTube to begin with, instead of millions of people posting their videos on their personal page. There are other factors of course: firewalls, asymmetric bandwidth, security issues, technical ignorance… But the client-server model does play…

>Make secure software that is simple to implement, simple to use, and hard to misuse (it's not that hard dammit, just look at qmail).

I made a previous comment about this being a hard problem[1]. If competent ultra techno geeks can get hacked, the problem looks to be unsolvable for the general homeowner to safely run a p2p server.

Many recurring security+usability problems that nobody has solved in the general case. Examples... Heartbleed SSL bug that's undetected for 2 years before being fixed, social engineering, homeowner misconfiguration, p2p server data not being backed up, software updates as an attack vector for decreasing security instead of hardening security, etc.

If my grandmother asked me, "A friend said I can share cooking recipes if I install a p2p food wiki server, what do you think?" I would immediately say "No! Don't install it. I will find you a _centralized_ web recipes forum for you to log in to!"

I ran qmail on my home server in the 1990s to personally control my SMTP needs which should theoretically make me the biggest cheerleader for a "p2p food wiki server". Instead, it informs my position to stop my family members from installing p2p software. Think about why I would do that.

The "symmetric bandwidth" isn't the only underlying problem.

>That problem is never worse with P2P protocols.

Everything has tradeoffs -- including p2p. Otherwise, you have an incomplete picture that doesn't consider pros and cons. P2p is worse for latency, worse for analyzing a unified network landscape to identify and filter out hostile actors, worse for non-techie usability, worse for instantaneous propagation of software updates to fix zero-day exploits, worse for homeowner costs, etc. There isn't a "set & forget" p2p appliance you can build that solves all of that. BitTorrent gets around the negatives of p2p because the value of the data users transfer (pirated Star Wars movies or Adobe software etc) overrides the hassles.

[1] https://news.ycombinator.com/item?id=11861683

Post reply on HN