Live data from Hacker News

Bitmagnet: A self-hosted BitTorrent indexer, DHT crawler, and torrent search

bitmagnet.io

101–110 of 111 posts

Re: Bitmagnet: A self-hosted BitTorrent indexer, DHT crawler, and torrent search

#101

Why isn't this built into thick desktop BT clients? Is it just a little too early for it, and next year it will be? Or is there some reason I'm missing?

What the other person said, but also: you have to have your crawler up for several days, ideally near 100% uptime for this to be effective. Thick clients can have high uptime but they also can not.

Re: Bitmagnet: A self-hosted BitTorrent indexer, DHT crawler, and torrent search

#102
For those of you interested in the intersection of "make vs buy" decisions, self hosting torrent servers and working at a hedge fund, you might get a kick out of this Twitter thread:

https://twitter.com/alexpotato/status/1661334108180566016

Re: Bitmagnet: A self-hosted BitTorrent indexer, DHT crawler, and torrent search

#103

Earlier quoted context omitted.

If you're downloading "normal" stuff, then you aren't likely to run into an issue. Stick to reputable sites; reddit can help you figure out what those are.

What sites? Isn't the purpose of the software discussed here to make tracker sites unnecessary?

It's not the same thing.

Re: Bitmagnet: A self-hosted BitTorrent indexer, DHT crawler, and torrent search

#104
post #25

It seems like every single of these things always cut corners and don't implement proper, spec-compliant nodes that provide the same services as they use. You know, the "peer" in p2p. BEP51 was designed to make it easier to not trample on the commons, and yet...

Author here. FWIW I wasn't intending this to make it onto HN, having posted about this on Lemmy looking for beta testers. The current version of the app is very much a preview. There's much further work to be done and this will include as far as possible ensuring Bitmagnet is a "good citizen". The suggestions made on the GH issue look largely feasible and I'll get round to looking at them as soon as I can. The issue…

Hey! Don't know if the Github repo or here is the best way to ask since the Discussions on the repo are not active.

I have started the docker-compose.yml file in WSL and it has been running for an hour slowly accumulating a few megabytes of redis data running at about 5% CPU usage. Inspecting it shows magnet links. It appears to be working.

But visiting the the web interface at localhost:3333 just yields "Firefox can’t establish a connection to the server at localhost:3333." after a 30 second timeout.

Would you have a guess why?

Re: Bitmagnet: A self-hosted BitTorrent indexer, DHT crawler, and torrent search

#105
post #75

Earlier quoted context omitted.

Unless you're also afraid of clicking links on the web, you should be fine with torrents. Maybe you could not seed by default and turn it on only after verifying the data is authentic, that way you're actually only downloading and the analogy is complete.

Not the same. A link on a site has implied authority because of the domain. For example a link on Microsoft.com vs some shady looking site. There is some point of reference at least to judge.

I download plenty of files from sites I don't know and wouldn't consider trustworthy, visiting only the Microsoft.coms of the web is really restrictive. Domain-based reputation is useful, especially if I'm actively interacting with the site and giving it data, but visiting a shady domain shouldn't make someone terrified. It's not like the site will cough and give you a virus nowadays.

Re: Bitmagnet: A self-hosted BitTorrent indexer, DHT crawler, and torrent search

#106

Earlier quoted context omitted.

(btw my comment was/is about the DHT crawler) You are describing a pay-to-play model. The validator is if the seeder/leech count is high. Well does DHT provide aggregate bandwidth of each torrent? If not, you can easily spin up 1000+ nodes and connect to your torrent. Tada fake popularity. If bandwidth is known, then you simply raise your costs a bit by running fake clients. There are anti-piracy groups who's entire…

> If not, you can easily spin up 1000+ nodes and connect to your torrent. Tada fake popularity. If bandwidth is known, then you simply raise your costs a bit by running fake clients. Sure, but like the other commenter said, this has been possible for years, and yet public trackers aren't swamped with fake torrents. I think in all my years of using BitTorrent I've only ever found a single fake torrent, where the conte…

You are making my point. A decentralized system will be abused with spam and fraud. A centralized system allows you to moderate the results.

Re: Bitmagnet: A self-hosted BitTorrent indexer, DHT crawler, and torrent search

#107

Earlier quoted context omitted.

Chicken/egg problem... as mentioned by someone else above... https://news.ycombinator.com/item?id=37779341 > New releases of something that just came out tend to suffer from this, though. Sometimes the counterfeits reach escape velocity - the rate of people joining in downloading the counterfeit exceed the rate of people realizing and stopping, thus giving the illusion of a legit torrent.

It's possible. I never follow new releases. But back in the ed2k days, I'd say about half of just about any file you cared you search for was fake, regardless of age.

You are what’s called, an edge case. A statistical anomaly. While that is great, you are far from the norm and not the target of this product (or even this particular thread :)

Re: Bitmagnet: A self-hosted BitTorrent indexer, DHT crawler, and torrent search

#109
post #103

Earlier quoted context omitted.

What sites? Isn't the purpose of the software discussed here to make tracker sites unnecessary?

It's not the same thing.

What's not the same thing as what?

Re: Bitmagnet: A self-hosted BitTorrent indexer, DHT crawler, and torrent search

#110

> Something that looks like a decentralized private tracker; by this I probably mean something that’s based partly on personal trust and manually weeding out any bad actors; I’d be wary of creating something that looks a bit like Tribler, which while an interesting project seems to have demonstrated that implementing trust, reputation and privacy at the protocol level carries too much overhead to be a compelling alte…

Tribler developer here.

The "Trust framework" that everybody is after: lightness of tit-for-tat with little overhead. With trust that actually can make The Internet a nice place again! Curation is indeed the problem discovered by HN practitioners such yourself. However, nobody in academia is working on this. As one old scientific article is titled: "Curation, Curation, Curation"

Post reply on HN