Live data from Hacker News

Bitmagnet: A self-hosted BitTorrent indexer, DHT crawler, and torrent search

bitmagnet.io

61–70 of 111 posts

Re: Bitmagnet: A self-hosted BitTorrent indexer, DHT crawler, and torrent search

#61
post #56

Please remove copyrighted movies from the screenshot on your website. It provides evidence that this program is designed for violating copyright, which makes DCMA takedown trivial.

Please determine if these images fall under fair-use provisions and, if so, leave them in place. Bad actors - whoever they may be - need to see your rights constantly reasserted.

The MPAA and other organizations use screenshots that show copyrighted material as "proof" that the tools are used for copyright violation, and then DMCA them.

If you want to help pay for lawyers to fight those DMCA notices with counterclaims and lawsuits, put up or shut up; the FSF, EFF and ACLU have been noticeably disinterested in doing so.

Re: Bitmagnet: A self-hosted BitTorrent indexer, DHT crawler, and torrent search

#62

Guys, please educate me: I want to use torrents, but the thought of downloading something inappropriate by clicking on a deceptive link terrifies me (e.g., a download with the title of an action movie, but it turns out to be something else). How do you guys handle that risk?

If you're downloading "normal" stuff, then you aren't likely to run into an issue. Stick to reputable sites; reddit can help you figure out what those are.

Re: Bitmagnet: A self-hosted BitTorrent indexer, DHT crawler, and torrent search

#63

> Pipe dream features > In-place seeding: identify files on your computer that are part of an indexed torrent, and allow them to be seeded in place after having moved, renamed or deleted parts of the torrent Does anything do this already? It would be amazing to point a client at a folder of unstructured junk and have it magically find the right parts.

I've thought about writing a fuse system that tracks rename / move / delete and updates the torrent client. Never had the time, though.

Re: Bitmagnet: A self-hosted BitTorrent indexer, DHT crawler, and torrent search

#64

Earlier quoted context omitted.

>It works well in practice. Hi, I worked on gnutella and lots of P2P systems in the early 00s. This will devolve into noise and spam as the number of users who adopt this feature pass a critical mass. With a fully decentralized system, there are no gatekeepers, and as such, there is no way to filter counterfiet items. While your client will present with you the data you are searching for, you will find out (usually h…

Gatekeeping is just a bad moderation method in the first place. What you need is sorting and categorization . If you really want to involve authoritative opinions on metadata, then use a web of trust.

I've yet to see a moderation method that works better than gatekeeping.

Re: Bitmagnet: A self-hosted BitTorrent indexer, DHT crawler, and torrent search

#65
post #56

Please remove copyrighted movies from the screenshot on your website. It provides evidence that this program is designed for violating copyright, which makes DCMA takedown trivial.

Please determine if these images fall under fair-use provisions and, if so, leave them in place. Bad actors - whoever they may be - need to see your rights constantly reasserted.

This has nothing whatsoever to do with fair use.

It's about arguments in court about the intention of the software if sued. Images of copyrighted content indicate intent to infringe copyright. Without those, you can argue it's only meant to find and index Linux image torrents or whatever.

Fair use doesn't enter the picture at all.

Re: Bitmagnet: A self-hosted BitTorrent indexer, DHT crawler, and torrent search

#66
I've been unable to get this running; I gave it a postgres user and database, granted it ownership and all permissions on said DB, and there's nothing in the database.

Edit: found the init schema and things seem to be working now: https://github.com/bitmagnet-io/bitmagnet/blob/main/migratio...

It would be really nice to be able to sort by header (size, seeders) and/or some filters for seed/downloaders (for example, filtering out anything with less than X seeds.)

Re: Bitmagnet: A self-hosted BitTorrent indexer, DHT crawler, and torrent search

#67

Please remove copyrighted movies from the screenshot on your website. It provides evidence that this program is designed for violating copyright, which makes DCMA takedown trivial.

And they probably want to remove text like

"It then further enriches this metadata by attempting to classify it and associate it with known pieces of content, such as movies and TV shows. It then allows you to search everything it has indexed."

Re: Bitmagnet: A self-hosted BitTorrent indexer, DHT crawler, and torrent search

#68
post #27
post #18

See also: Magnetissimo [1], Torrentinim [2], and Spotweb [3]. [1] https://github.com/sergiotapia/magnetissimo [2] https://github.com/sergiotapia/torrentinim [3] https://github.com/spotweb/spotweb

Any comments on how these compare? Especially in relation to sibling comment about BEP51?

You want Torznab support. That is basically metadata you want to export, to import it into your application which holds the database of what you are after. If it is a match, it should attempt to download it via your download client (BitTorrent client).

Torrentinim is the successor of Magnetissimo but it lacks Radarr/Sonarr integration (there is a pull request for Torznab support for both). Spotweb has Newznab support [1] but at Black Friday (soon) there's usually tons of deals available for Newznab indexes.

I don't care about BEP51 as I don't have huge upload. That is also why I prefer Usenet over torrents. But torrents are a useful and sometimes required backup mode. Just not my preferred one.

[1] https://github.com/Spotweb/Spotweb/wiki/Spotweb-als-Newznab-...

Re: Bitmagnet: A self-hosted BitTorrent indexer, DHT crawler, and torrent search

#69
post #37

What kind of bandwidth usage should be expected from a DHT crawler like this?

After ~30-60 minutes of running, still less than 100kB/sec combined in and out. However, as others have noted, nodes don't communicate much with nodes that haven't been up for a while (days.)

It's using roughly 6% CPU time for the crawler and another 1-2% for postgres, on a second-gen i7.

As a datapoint to set expectations: 4000 torrents have been captured so far, and somewhat surprisingly, they're not very current results, necessarily.

For example, a certain wildly popular TV series about samurai in space swinging very hot swords around which just had its season ending episode last night (I think)...that ep isn't in my list so far, but the episode prior to it, and the first two episodes, are.

There's a ton of random, low-seed torrents, so it's actually kind of interesting to search by type, year, etc and see what comes up.

Re: Bitmagnet: A self-hosted BitTorrent indexer, DHT crawler, and torrent search

#70

Please remove copyrighted movies from the screenshot on your website. It provides evidence that this program is designed for violating copyright, which makes DCMA takedown trivial.

Thanks - I only condone accessing the legal content available on BitTorrent, and my screenshots now embody this moral stance.
Post reply on HN