Discord Unveiled: A Comprehensive Dataset of Public Communication (2015-2024)

Post by aehgwdyw » Sat, May 24, 2025, 10:23 AM UTC

diggan wrote: post #183

hampus wrote: post #158

Earlier quoted context omitted.

I downloaded it and decompressed it — it's approximately 2.1 terabytes in size.

I managed to download the file, but since they restricted the downloads, it seems they hid the checksums too. Could you possibly share the md5/sha256 of the .zst file?

Post by iforgoraboutit » Sat, May 24, 2025, 1:42 PM UTC

philipkglass wrote: post #170

polarix wrote: post #169

Earlier quoted context omitted.

It is not just a login wall, they have restricted access even for logged in users, presumably to only the uploaders. A magnet would be nice.

About the decompressed data: zstdcat dataset.zst | sha384sum 0812f3876a7e319081f596a5545321e5c8e8def501add3a4f5ff039568fe59aa5d4ac5d2c3e549532f529bd09b887596 zstdcat dataset.zst | wc 2059116741 22128178392 2099550453760 If you can post your email and you have a sftp server or other accessible means to receive this large file, I'll contact you and then maybe you can help distribute it more widely. (Offer also applies…