This is really neat. I'll need to check it out. A couple years ago I ran my own instance of Magnetico (https://github.com/boramalper/magnetico), but this project looks a lot more polished.
Bitmagnet: A self-hosted BitTorrent indexer, DHT crawler, and torrent search
71–80 of 111 posts
Re: Bitmagnet: A self-hosted BitTorrent indexer, DHT crawler, and torrent search
#72Guys, please educate me: I want to use torrents, but the thought of downloading something inappropriate by clicking on a deceptive link terrifies me (e.g., a download with the title of an action movie, but it turns out to be something else). How do you guys handle that risk?
Just use reputable sites and run a good adblocker, like Unlock Origin.
Re: Bitmagnet: A self-hosted BitTorrent indexer, DHT crawler, and torrent search
#73Earlier quoted context omitted.
It works well in practice. The DHT protocol includes announce messages that broadcast when new files are shared on BitTorrent. It then includes a "geometric" way to find people who are sharing those files. It doesn't include the files themselves, just the torrents which include a file list and location hashes. If you listen to BitTorrent's DHT network, you'll build an index of everything shared on BitTorrent (over ti…
>If you listen to BitTorrent's DHT network, you'll build an index of everything shared on BitTorrent (over time), Correct me if I'm wrong but as far as I understand, passively listening on DHT would only mean you build up a list of infohashes of everything shared on BitTorrent. You'd actually have to reach out to your DHT peers to know what files the infohashes actually represents. Wrapping back to grandparent's ques…
Would this get hashes of items shared on private trackers too?
Re: Bitmagnet: A self-hosted BitTorrent indexer, DHT crawler, and torrent search
#74Please remove copyrighted movies from the screenshot on your website. It provides evidence that this program is designed for violating copyright, which makes DCMA takedown trivial.
And they probably want to remove text like "It then further enriches this metadata by attempting to classify it and associate it with known pieces of content, such as movies and TV shows. It then allows you to search everything it has indexed."
I don't see anything wrong with that if the example titles are under the correct licenses like the often used: https://en.wikipedia.org/wiki/Big_Buck_Bunny which can then be mapped to open databases like https://www.themoviedb.org/movie/10378-big-buck-bunny.
Re: Bitmagnet: A self-hosted BitTorrent indexer, DHT crawler, and torrent search
#75Guys, please educate me: I want to use torrents, but the thought of downloading something inappropriate by clicking on a deceptive link terrifies me (e.g., a download with the title of an action movie, but it turns out to be something else). How do you guys handle that risk?
Unless you're also afraid of clicking links on the web, you should be fine with torrents. Maybe you could not seed by default and turn it on only after verifying the data is authentic, that way you're actually only downloading and the analogy is complete.
Re: Bitmagnet: A self-hosted BitTorrent indexer, DHT crawler, and torrent search
#76Isn't this much the same as btdig.com which is based on: https://github.com/btdig/dhtcrawler2
I use this service to do security research a fair bit. It'd be nice if there was a higher quality self-hosted version I could use so I'll be watching this project with interest!
Re: Bitmagnet: A self-hosted BitTorrent indexer, DHT crawler, and torrent search
#77Why isn't this built into thick desktop BT clients? Is it just a little too early for it, and next year it will be? Or is there some reason I'm missing?
Re: Bitmagnet: A self-hosted BitTorrent indexer, DHT crawler, and torrent search
#78> The DHT crawler is not quite unique to bitmagnet; another open-source project, magnetico was first (as far as I know) to implement a usable DHT crawler, and was a crucial reference point for implementing this feature. Heh. That was one of my first projects when I was still learning to code back in 2012: https://github.com/laino/shiny-adventure The DHT crawler/worker lived seperately, and I eventually put it here to…
Nothing substantial, I chuckled when I saw the commit history on your linked projects. I do not mean to belittle you (or the purpose/goal of the projects), genuinely enjoyed the distraction and 'results' from it: Today was the first commit after 11 (9 oct 2012) and 5 years (24 nov 2018), respectively, on the projects. I think your repo might be part of some sort of oldest 'active'- or 'not ported to another repo'-rep…
I recently committed to an old repo of mine after a 9 year gap.
It holds several one file python script experiments and toys that I lumped into one place to get them off my hdd and make them available from wherever. Recently remembered it existed and added another one. And while I was in there I also ran 2to3 on the ones that needed it and polished the results up.
Re: Bitmagnet: A self-hosted BitTorrent indexer, DHT crawler, and torrent search
#79Please remove copyrighted movies from the screenshot on your website. It provides evidence that this program is designed for violating copyright, which makes DCMA takedown trivial.
Indexing what is available for download is useful for research into piracy even if you don’t engage in piracy yourself.
Re: Bitmagnet: A self-hosted BitTorrent indexer, DHT crawler, and torrent search
#80How’s this different from piratebay