Live data from Hacker News

Database-less torrent website

boredcaveman.xyz

61–70 of 72 posts

Re: Database-less torrent website

#61

Earlier quoted context omitted.

They have another system called IPNS but unless it’s improved since I checked, it wasn’t very practical.

What's wrong with IPNS? I'm using it for my decentralized website (via fleek), and it seems to work well.

It has a reputation for being slow if you're not using the DNS-based version of the protocol (DNSLink). Though the experimental IPNS-over-PubSub interface helps if both sites are using it.

Re: Database-less torrent website

#62

Earlier quoted context omitted.

>That's interesting. Are you aware of the absurd-sql project? No, thanks for pointing that out, will take a look into it. > Also, how do peers find each other? The idea is to use the torrents as a common shareable resource where given the peers have the same interest in that torrent, lets say the torrents works as a "meta-database" with just enough immutable metadata info, giving the developers of that application a…

Good luck with this, I've been reading all the various HN posts on this topic and you seem to be the closest to the holy grail. Counter to Moxie's argument[0], I think a lot more people would be willing to host a server, if all they had to do to host a server is to seed a torrent. We already know many people are willing to do that. I think this would be interesting if the application itself was just a Docker containe…

> Good luck with this, I've been reading all the various HN posts on this topic and you seem to be the closest to the holy grail.

Thanks, its nice to hear that after all those years working on it and keep going by understanding how important is for all of us to get out of this rigged game where the cloud computer(+ web clients rulers) FAANG's are controlling where we are heading and a future where we(hackers) have less options technologically, not having enough freedom to program services that can ignore the mothership and create the same sort of services only relying on peers, is a goal being pursuit by them.

> I think this would be interesting if the application itself was just a Docker container that could output to a browser, similar to many other local-hosted approaches[1].

What my solution do is that the application have a "service" process that works like daemon to the application, being able to resolve route requests both locally (when over IPC) and remotely (when over RPC).

The routes are meant to serve html or any other content to the UI application (which is also another process akin to the Chrome renderer).

But the fact that every application might have a ever-running process, means that in some cases it can create other kind of services. For instance:

You can create a PostgreSQL wrapper application where you present the the database SQL api over RPC as a service, and manage the PostgreSQL instance with your service process.

The same works for Docker or QEMU for instance. Your application can be docker-based and can be deployed only on Linux.

Your applications (the service and the UI process) are natives by the way, and even the UI application controls the Web layer (rendering, layout, etc) nativelly talking directly to it (as a first SDK enabled over Swift for now).

This architecture will allow you to do those things, and present a way for the users to interact with your solution in a UX that is packed and develop together with the "backend".

With this hole thing you program the frontend and the backend as a whole, in the same programming language.

Re: Database-less torrent website

#63

Earlier quoted context omitted.

>That's interesting. Are you aware of the absurd-sql project? No, thanks for pointing that out, will take a look into it. > Also, how do peers find each other? The idea is to use the torrents as a common shareable resource where given the peers have the same interest in that torrent, lets say the torrents works as a "meta-database" with just enough immutable metadata info, giving the developers of that application a…

Thanks, super interesting. When I get time to work on my side project again I'll try it out. I have a server-less frontend app and have been thinking about a way to allow sync of data between users. I had been looking at webrtc, but the need for a stun server makes the UX ugly. Having a torrent (and/or IPFS) to either be the direct data layer and/or to at least serve as a common point to sync webrtc info seems like a…

Yes, it can even serve to expose the others WebRTC api's that are meant for media, where you can have a initial RPC booststrap interface, that will call your application service, that in turns its programmed by you to use the WebRTC api to stream audio and video from that peer. (or use the datastream if you want)

Re: Database-less torrent website

#65

Earlier quoted context omitted.

No one is going to pin encrypted data they do not understand. And IPFS doesn’t get users to seed random files, you only seed stuff you downloaded. So really it’s not much different to hosting it on a personal http server except any downloaders can also host.

> No one is going to pin encrypted data they do not understand. Select users who have the decryption key (communicated out-of-band) might be willing to pin the encrypted data for the benefit of others who also have the key. There are also for-pay pinning services who probably wouldn't care whether the data was encrypted. And whether it's pinned it or not, as long as it's downloaded the data remains available to be sh…

Ok but you could do that on literally any platform. I could encrypt data and stick it on google drive or aws and the hosts wouldn’t have any clue what it was.

Re: Database-less torrent website

#66

Earlier quoted context omitted.

> No one is going to pin encrypted data they do not understand. Select users who have the decryption key (communicated out-of-band) might be willing to pin the encrypted data for the benefit of others who also have the key. There are also for-pay pinning services who probably wouldn't care whether the data was encrypted. And whether it's pinned it or not, as long as it's downloaded the data remains available to be sh…

Ok but you could do that on literally any platform. I could encrypt data and stick it on google drive or aws and the hosts wouldn’t have any clue what it was.

Sure, but doing it through IPFS means that you aren't dependent on a particular centralized service. If you put the encrypted file on Google Drive or AWS and then later take it down, the link breaks. Or someone might edit the file so that the link no longer gives the same content. On IPFS the original link continues to work as long as anyone has the file, and the content is immutable, so there are some advantages compared to plain HTTP.

Re: Database-less torrent website

#67

Since it has used IPFS, why not host the content of those torrents with IPFS?

You can do that. And I like the idea. But for now, torrents are the go to method of sharing large pieces of data, and utilizing IPFS to move the centralized aspect of torrents to a decentralized space is a good idea.

Re: Database-less torrent website

#68

One unmentioned con: no updates, no new torrents can be added (or, updates require re-deployment of full new .sqlite db, together with a new website). I think there's a space for decentralized database format. Something that would have immutable rows (not the whole db), ranges and search, indexes, etc. Maybe there's something like this already?

There should be a separation of data and the actual website that does the reading. I once thought about something similar (not for torrents), but having to download the whole database (300MB and more) was a bad idea for UX.

So what I propose is this: There is a central source of truth hosted on IPFS via IPNS or mutable torrents. The data format can be whatever is more efficient to update and store, not easiest to read and query. (An event log is fine) Then, there is a reader application, like an RSS reader. The reader application can be a desktop application or it can be a centrally hosted web app that keeps a conventional SQL database behind the scenes. The idea is that there will be multiple reader providers like there are competing email providers.

Re: Database-less torrent website

#69

That's not going to stop takedowns, they don't care about if it's technically on your site or not.

Do they also not care whether they technically have the authority of law or not?

They can change the law to whatever is more profitable...
Post reply on HN