Live data from Hacker News

Discord Unveiled: A Comprehensive Dataset of Public Communication (2015-2024)

arxiv.org

181–190 of 204 posts

Re: Discord Unveiled: A Comprehensive Dataset of Public Communication (2015-2024)

#181
post #158
post #36

Earlier quoted context omitted.

> It's 118 gigabytes of JSON. 118.0 GB of ZST compressed JSON ( https://zenodo.org/records/15170676 ). The actual uncompressed JSON would most likely be much, much larger.

I downloaded it and decompressed it — it's approximately 2.1 terabytes in size.

hey there, would you mind sharing the file please?

Re: Discord Unveiled: A Comprehensive Dataset of Public Communication (2015-2024)

#182
post #173

Earlier quoted context omitted.

> There is only a limited number of mods you can play with My Minecraft server has 300+ mods. I've subscribed to nearly that many Rimworld mods. 50 is the lowest number of mods for a game of mine I can quickly find.

The number is not unbounded, the more mods you have the more difficulty you will have upgrading, the more they conflict with each other, and consumer hardware cannot handle the load. Also, paid mods usually have a free version. You pay for early access for latest and greatest version, which only makes sense for specific important mods. You wouldn’t do it for all of the mods.

> the more mods you have the more difficulty you will have upgrading, the more they conflict with each other,

The point is you don't quickly reach this point these days.

> consumer hardware cannot handle the load.

My GPU is 10 years old, my CPU is 6 years old, and I only have 16GB of RAM. I'm not even sure I can name a game that is easily moddable that might overload even a middle-of-the-road system.

> Also, paid mods usually have a free version. You pay for early access for latest and greatest version, which only makes sense for specific important mods. You wouldn’t do it for all of the mods.

Interestingly, the vast, vast majority of mods I know of that offer a Patreon or similar don't offer much in the way of perks - it's mostly just a way of letting users support them if they choose. Sometimes there's early access, but that's actually fairly rare in my experience.

Re: Discord Unveiled: A Comprehensive Dataset of Public Communication (2015-2024)

#183
post #158
post #36

Earlier quoted context omitted.

> It's 118 gigabytes of JSON. 118.0 GB of ZST compressed JSON ( https://zenodo.org/records/15170676 ). The actual uncompressed JSON would most likely be much, much larger.

I downloaded it and decompressed it — it's approximately 2.1 terabytes in size.

I managed to download the file, but since they restricted the downloads, it seems they hid the checksums too. Could you possibly share the md5/sha256 of the .zst file?

Re: Discord Unveiled: A Comprehensive Dataset of Public Communication (2015-2024)

#184
post #182

Earlier quoted context omitted.

The number is not unbounded, the more mods you have the more difficulty you will have upgrading, the more they conflict with each other, and consumer hardware cannot handle the load. Also, paid mods usually have a free version. You pay for early access for latest and greatest version, which only makes sense for specific important mods. You wouldn’t do it for all of the mods.

> the more mods you have the more difficulty you will have upgrading, the more they conflict with each other, The point is you don't quickly reach this point these days. > consumer hardware cannot handle the load. My GPU is 10 years old, my CPU is 6 years old, and I only have 16GB of RAM. I'm not even sure I can name a game that is easily moddable that might overload even a middle-of-the-road system. > Also, paid mod…

> My GPU is 10 years old, my CPU is 6 years old, and I only have 16GB of RAM

And a Minecraft server with 300+ mods? I doubt it.

> I'm not even sure I can name a game that is easily moddable that might overload even a middle-of-the-road system.

X-Plane, Cities: Skylines, Minecraft… Most big games will overload a machine of an average person, at least once you add a decent shader, high-poly models and high-res textures, and play on anything other than potato resolution.

Re: Discord Unveiled: A Comprehensive Dataset of Public Communication (2015-2024)

#185
post #182

Earlier quoted context omitted.

> the more mods you have the more difficulty you will have upgrading, the more they conflict with each other, The point is you don't quickly reach this point these days. > consumer hardware cannot handle the load. My GPU is 10 years old, my CPU is 6 years old, and I only have 16GB of RAM. I'm not even sure I can name a game that is easily moddable that might overload even a middle-of-the-road system. > Also, paid mod…

> My GPU is 10 years old, my CPU is 6 years old, and I only have 16GB of RAM And a Minecraft server with 300+ mods? I doubt it. > I'm not even sure I can name a game that is easily moddable that might overload even a middle-of-the-road system. X-Plane, Cities: Skylines, Minecraft… Most big games will overload a machine of an average person, at least once you add a decent shader, high-poly models and high-res textures…

The server isn't hosted on my computer silly.

Re: Discord Unveiled: A Comprehensive Dataset of Public Communication (2015-2024)

#186
post #185

Earlier quoted context omitted.

> My GPU is 10 years old, my CPU is 6 years old, and I only have 16GB of RAM And a Minecraft server with 300+ mods? I doubt it. > I'm not even sure I can name a game that is easily moddable that might overload even a middle-of-the-road system. X-Plane, Cities: Skylines, Minecraft… Most big games will overload a machine of an average person, at least once you add a decent shader, high-poly models and high-res textures…

The server isn't hosted on my computer silly.

Which tracks the experience of an average person how? If you think everybody these days runs a million mods and admins a rented server, you should really go out more.

Re: Discord Unveiled: A Comprehensive Dataset of Public Communication (2015-2024)

#187
post #185

Earlier quoted context omitted.

The server isn't hosted on my computer silly.

Which tracks the experience of an average person how? If you think everybody these days runs a million mods and admins a rented server, you should really go out more.

Do you think the average person is hosting the Minecraft server(s) they play on on their home computer?

Re: Discord Unveiled: A Comprehensive Dataset of Public Communication (2015-2024)

#189
post #31

The biggest problem that sucks about discord is that it isn't normally publicly searchable. And it seems to be a modern replacement for internet forums which historically were publicly searchable and often had a lot of great information about various hobbies and things.

> The biggest problem that sucks about discord is that it isn't normally publicly searchable. This is a feature of the platform, not a bug. Because of the lack of discoverability people act more genuine, for better or for worse, than public places like Twitter, Bsky, Facebook, Instagram, etc where you have to maintain your public image and/or act like HR is watching over your shoulder. That being said, this feature a…

I am comparing Discord to things like gaming forums or reddit where people use usernames and you would rarely be able to know who they were in real life unless they wanted you to know.

Re: Discord Unveiled: A Comprehensive Dataset of Public Communication (2015-2024)

#190
post #26

Earlier quoted context omitted.

If they didn't salt it, you might not even need to identify the chat - just hash the username you want to look up. I'd check, but it's a >100GB download.

I'd check, but it's a >100GB download. The page given by pavel_lishin above includes a sample data set that's only 6.2 GB: https://zenodo.org/records/15170676/files/dataset_sample.zst...

[deleted]
Post reply on HN