Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Full Reddit Submission Corpus now available for 2006 thru August 2015

reddit.com

Post reply on HN
Print view View original

71–80 of 100 posts

Re: Full Reddit Submission Corpus now available for 2006 thru August 2015

#71

Post by archagon »

Karunamon wrote: post #69
ebbv wrote: post #51

Earlier quoted context omitted.

> Reddit 2006 would not reflect mainstream US values and opinions, Reddit 2015 would be much closer. While I agree Reddit 2015 does reflect more of the US mainstream, it is still far from being an actual reflection of popular US opinion. Reddit is far more atheist/libertarian than the US mainstream. And I would argue it is right now far more reactionary/right wing as well. It has become very popular among young white…

generally retrograde attitudes towards women of Reddit in general That's a pretty awful accusation to level at ~20 million people. I wonder if you can substantiate that?

I think anyone who reads the default subs can corroborate the rampant sexism and racism.

When I'm on women-centric subs like /r/askwomen, I frequently see comments that would absolutely get torn apart in most other parts of the site. Not offensive or provocative ones, either. Just normal conversation that would get a slew of "shut up, SJW" anywhere else.

Re: Full Reddit Submission Corpus now available for 2006 thru August 2015

#72

Post by archagon »

creshal wrote: post #16
TorKlingberg wrote: post #13

I wonder if an analysis of this and the comment corpus could quantifiably show shifts in the opinions of the Reddit "hivemind" since the start. Has the Reddit userbase turned more conservative over the years, or is that just my impression?

There sure as hell is lot more fear-mongering since the refugee "crisis" started.

I find that /r/news and /r/worldnews are just utter cesspits of terrible, racist comments. Some people say they're brigaded by Stormfront... dunno if that's true or not, but I wouldn't be surprised.

Re: Full Reddit Submission Corpus now available for 2006 thru August 2015

#73

Post by comboy »

CardenB wrote: post #17
ljk wrote: post #8

Earlier quoted context omitted.

> No more comment deletion Isn't that how hackernews is? not being able to delete comments

Yeah but I'm sure a lot of people post on here knowing that they won't delete a comment. It's a different story with Reddit, where people have a lot more expectations and it's bigger.

If somebody believes that he can post something on the internet and then just remove it from existence, then he's probably a politician in EU.

Re: Full Reddit Submission Corpus now available for 2006 thru August 2015

#74

Post by elbear »

ebbv wrote: post #64
mason240 wrote: post #55

Earlier quoted context omitted.

> young white males who have unhealthy attitudes towards women due to the abundance of porn You sound just like the fundamentalist Evangelicals I grew up with.

It appears you didn't understand the sentence you are partially quoting. Reddit itself is full of porn. Much like attitudes towards women are likely to be generally more misogynistic among the patrons of a strip club than they are, say, inside of a planned parenthood, not just the presence but the omnipresence of porn on Reddit, and the role the porn plays in Reddit's popularity has an effect on the site and its user…

I think your post would have gained more without the personal attack. I understand that his personal triggered your response, but the first part of your comment does a good job of supporting your argument.

Re: Full Reddit Submission Corpus now available for 2006 thru August 2015

#75

Post by imgabe »

archagon wrote: post #71
Karunamon wrote: post #69

Earlier quoted context omitted.

generally retrograde attitudes towards women of Reddit in general That's a pretty awful accusation to level at ~20 million people. I wonder if you can substantiate that?

I think anyone who reads the default subs can corroborate the rampant sexism and racism. When I'm on women-centric subs like /r/askwomen, I frequently see comments that would absolutely get torn apart in most other parts of the site. Not offensive or provocative ones, either. Just normal conversation that would get a slew of "shut up, SJW" anywhere else.

Considering not all of the user base comments and that of those who do, not all of them are misogynistic, imputing the opinions of a vocal minority to the whole community isn't really fair.

Re: Full Reddit Submission Corpus now available for 2006 thru August 2015

#76

Post by archagon »

imgabe wrote: post #75
archagon wrote: post #71

Earlier quoted context omitted.

I think anyone who reads the default subs can corroborate the rampant sexism and racism. When I'm on women-centric subs like /r/askwomen, I frequently see comments that would absolutely get torn apart in most other parts of the site. Not offensive or provocative ones, either. Just normal conversation that would get a slew of "shut up, SJW" anywhere else.

Considering not all of the user base comments and that of those who do, not all of them are misogynistic, imputing the opinions of a vocal minority to the whole community isn't really fair.

Sure, but every community has a set of norms. You get a sense of what's not OK to say if you've been around for a while. On Reddit, I can immediately tell when going from a default sub to a nicer, more inclusive sub, because I see comments that would get absolutely eviscerated in the defaults used in regular conversation with no apparent controversy, pile-ons, or swearing. Sure, most people on Reddit probably aren't racist or misogynistic, but the community can still feel that way.

Re: Full Reddit Submission Corpus now available for 2006 thru August 2015

#77

Post by nbadg »

Houshalter wrote: post #11

This is not as cool as the comment dataset, but it's still pretty cool. I think in the future AIs will make extensive use of these kinds of datasets. It's amazing how much useful information is in there. Last year I made a simple IRC question answering bot that just searched reddit for your question and returned the top comment of the top result. It worked surprisingly well. It's amazing how many questions someone el…

Do you have any of the source on Github? I'd be very interested in taking a look and potentially using it as an excuse to get playing with a natural language toolkit (in all my spare time haha)

Re: Full Reddit Submission Corpus now available for 2006 thru August 2015

#78

Post by theorique »

creshal wrote: post #39
scintill76 wrote: post #21

Earlier quoted context omitted.

Why quotes on crisis? I'm not challenging it, because I also find it weird that overnight the phrase started popping up in the news daily. And what is the fear-mongering going on at Reddit?

> And what is the fear-mongering going on at Reddit? The usual: • The Arabs will outbreed us! (Before or after the Turks will outbreed us? Or was it the Somalis? I lost track.) • The refugees will cripple our economy! (153 million EU citizens are on tax-funded pensions or unemployment benefits. Please tell me how a million refugees is going to make a dent in that.)

They don't need to outbreed us - they are just sending us their displaced population, costing €700K per head in social services for "integration". And of those refugees "integrated" at vast expense, how many are already ISIS operatives? How many will be radicalized and return with full bellies and full bank accounts to fight for jihad in Syria and Iraq?

Europe is doing the wrong thing.

Re: Full Reddit Submission Corpus now available for 2006 thru August 2015

#80

Post by doyoulikeworms »

archagon wrote: post #76
imgabe wrote: post #75

Earlier quoted context omitted.

Considering not all of the user base comments and that of those who do, not all of them are misogynistic, imputing the opinions of a vocal minority to the whole community isn't really fair.

Sure, but every community has a set of norms. You get a sense of what's not OK to say if you've been around for a while. On Reddit, I can immediately tell when going from a default sub to a nicer, more inclusive sub, because I see comments that would get absolutely eviscerated in the defaults used in regular conversation with no apparent controversy, pile-ons, or swearing. Sure, most people on Reddit probably aren't…

I think that the best way to describe Reddit with regard to misogyny, racism, and other forms of bigotry is that Reddit is not a safe place for everybody. If you don't curate your subreddits well, you'll probably end up trudging through a lot of awful comments and/or submissions.

I view this to be more of a reflection of society as a whole rather than the Reddit community specifically. Subreddits show a marked decrease in quality once they become large. Becoming a default subreddit is, in some ways, a death knell for the community.

Post reply on HN