&quot;BitTorrent Roulette&quot; sounds like a wonderful way to end up with child porn on your computer.

DHT work is fun - you can scrape a lot of interesting content. BitTorrent and Tor both use DHTs for content discovery.If you’re interested in building a minimum viable scrapper, this is a good reference: <a href="https:&#x2F;&#x2F;github.com&#x2F;retrohacker&#x2F;Taboo&#x2F;blob&#x2F;main&#x2F;lib&#x2F;index.js" rel="nofollow">https:&#x2F;&#x2F;github.com&#x2F;retrohacker&#x2F;Taboo&#x2F;blob&#x2F;main&#x2F;lib&#x2F;index.js</a>The trick to content discovery on the DHT is to parrot any incoming request you receive. So if someone asks for a hash or announces a hash, you turn around and ask for that hash too. You can spin up multiple DHT nodes to increase your coverage of the table.Some cool user experiences can be built off of this. I’ve discovered a tonne of interesting content using “BitTorrent Roulette” applications that download random hashes from the DHT - often times finding fascinating content from languages I don’t speak.

well, you could run your own instance: <a href="https:&#x2F;&#x2F;github.com&#x2F;btdigg-org&#x2F;dhtcrawler2" rel="nofollow">https:&#x2F;&#x2F;github.com&#x2F;btdigg-org&#x2F;dhtcrawler2</a>

Well, one can write a bot that defeats recaptcha. Trivial, once you know what to do.

Wow, thank you for that. That&#x27;s very clever and very useful.It&#x27;s a shame they use recaptcha, it&#x27;s means it&#x27;s impossible to script searches with something like Jackett.

&gt; sir, madame, or theyNeither, I think it&#x27;s a cylon.

Badass. Thank you sir, madame, or they.

Anyone who has spent more than 5 minutes in torrent-land has seen NSFW

&gt; <a href="https:&#x2F;&#x2F;btdig.com" rel="nofollow">https:&#x2F;&#x2F;btdig.com</a>First hint suggested: &quot;interracial gangbang&quot;They might want to put those hints behind a NSFW warning; just my .2c.

Let&#x27;s not forget one of the best approaches for indexing magnet hashes: <a href="https:&#x2F;&#x2F;btdig.com" rel="nofollow">https:&#x2F;&#x2F;btdig.com</a> . It basically connects to the DHT and listens to queries. When a new one is found, it downloads the torrent data and indexes it.

I love what the Internet Archive does and I assume it pisses off many big fish. How do they get away with so much content? What guarantees are there that they&#x27;re going to be able to preserve digital history in the long term?

Thanks, the one in the link is from 2016

Here is one of thepiratebay up to 2019: <a href="https:&#x2F;&#x2F;archive.org&#x2F;details&#x2F;ThePirateBayMarch2019" rel="nofollow">https:&#x2F;&#x2F;archive.org&#x2F;details&#x2F;ThePirateBayMarch2019</a>

A different torrent metadata archive (.torrent files) that&#x27;s somewhat more up to date:<a href="https:&#x2F;&#x2F;archive.org&#x2F;details&#x2F;torrent_metadata_archive_sample" rel="nofollow">https:&#x2F;&#x2F;archive.org&#x2F;details&#x2F;torrent_metadata_archive_sample</a>(Though, in practice not as easy to download, you need to download a tar ball for each month, the naming is predictable, so you can at least script the download)

This is one of the biggest DHT search engines I know of.. though it&#x27;ll just tell you if something exists or not, you have to find the magnet data somewhere else:<a href="https:&#x2F;&#x2F;torrenthistory.org&#x2F;" rel="nofollow">https:&#x2F;&#x2F;torrenthistory.org&#x2F;</a>

I have fiber so a VPN just nukes my download speeds enough that I hated using it for torrenting.Is this normal in your experience? I am&#x2F;was a VPN noob.

Pay $40 a year for a vpn. Use a docker container that has iptables set up to only use the vpn and put a torrent client. $40 a year and nobody will bother you. The person that a vpn provider will expose to lose their company base will be a terrorist not a torrentor

&gt; Any way to know which ones might be under surveillance?Yes, the answer is that all of them &quot;might&quot; be under surveillance. There&#x27;s no way to guarantee that any of them aren&#x27;t.

Content piracy is one of the very few valid uses of a public VPN provider service.

Not universally true though, and in some countries (like e.g. Germany) it&#x27;s a really bad idea to torrent without a seedbox or vpn in another country.

If you&#x27;re in the US I advise caution as ISPs are going to be increasingly aggressive about shutting off accounts. The media industry has demanded that repeated, unproven, accusations alone should be enough to force your ISP to close your account and never allowing you to open a new one. ISPs don&#x27;t want to do that, but courts so far have been agreeing with the media industry on that. ISPs who don&#x27;t do it, risk literal billions in fines.IF you don&#x27;t have multiple ISP options each offering reliable high speed connections in your area, you should be especially careful or you could find yourself with very limited access to the internet or even no internet access at all.

13 years ago, last I used them, Comcast would send an email with a list of the titles of the torrents it thought you downloaded.Good enough to scare ~everyone by itself, though iirc they did threaten to halt your service, something I never decided to test out.

I receive complaints all the time by my ISP for torrenting... they do nothing except frightening older people

How does that help? YourISP is not looking at your HTTPS traffic, but your torrent traffic, right?

Private torrent trackers. Check out r&#x2F;trackers.It requires time and effort though.

You can hire a 3rd party to do the torrenting and then stream from them (put.io, etc.), but there&#x27;s no guarantee they can&#x27;t be compelled to hand over their logs.

Any way to know which ones might be under surveillance?Right now I have to choose between darkweb piracy (Slow downloads, hard to find things, search services are slow) and clearnet piracy (Lots of popular shows are monitored by copyright bots), so I&#x27;ve been pirating less and less

2016 database, someone needs to update it. And how does one even get all the magnet links like this?

It&#x27;s part of BEP-47 [1], an extension meant to make it easier to handle single file downloads and multiple torrents serving the same file. BEP-47 aware clients, which is most of them these days, I think, hide these files from the user.[1] <a href="https:&#x2F;&#x2F;www.bittorrent.org&#x2F;beps&#x2F;bep_0047.html" rel="nofollow">https:&#x2F;&#x2F;www.bittorrent.org&#x2F;beps&#x2F;bep_0047.html</a>

&gt; Funny, most of those torrent got a __padding_fileThose are supposed to be hidden by clients. They represent &quot;free space&quot; between files, allowing clients to download individual small files without having to also download the files adjacent to them.

yeah bitcomet had a similar, but incompatible scheme

Funny, most of those torrent got a __padding_file, which comes from bitcomet, a bad torrent client... I think?Other thing, I realized that there are less and less torrent indexes those last 5 years, they all end up offline or full of ads.

The one posted here is a dump from 2016 and <a href="https:&#x2F;&#x2F;torrents-csv.ml&#x2F;" rel="nofollow">https:&#x2F;&#x2F;torrents-csv.ml&#x2F;</a> has imported piratebay dumps from then (probably from the same source). The difference is that <a href="https:&#x2F;&#x2F;torrents-csv.ml&#x2F;" rel="nofollow">https:&#x2F;&#x2F;torrents-csv.ml&#x2F;</a> does health checks on the torrents and will remove dead ones which means that a lot of the torrents in this dump will be removed since they have probably died either before 2016 or during the last 7 years.

seems to have a whole lot more results, for one

How is this different from <a href="https:&#x2F;&#x2F;torrents-csv.ml&#x2F;" rel="nofollow">https:&#x2F;&#x2F;torrents-csv.ml&#x2F;</a>?