Full Reddit Submission Corpus now available for 2006 thru August 2015

#1

Post by voltagex_ » Mon, Sep 28, 2015, 7:00 AM UTC

Full Reddit Submission Corpus now available for 2006 thru August 2015
reddit.com

Re: Full Reddit Submission Corpus now available for 2006 thru August 2015

#2

Post by lysium » Mon, Sep 28, 2015, 7:36 AM UTC

I'm not quite sure how I feel about it. Yes, that data was publicly available, but it 'feels' different that there is now an unalterable snapshot available to the public. No more comment deletion.

Re: Full Reddit Submission Corpus now available for 2006 thru August 2015

#3

Post by Implicated » Mon, Sep 28, 2015, 7:43 AM UTC

lysium wrote: post #2

I'm not quite sure how I feel about it. Yes, that data was publicly available, but it 'feels' different that there is now an unalterable snapshot available to the public. No more comment deletion.

I believe this is just the submissions, not comments (though, it appears that's already been released), based on the post authors comment...

> This dataset will go nicely with the full Reddit Comment Corpus that I released a couple months ago. The link_id from each comment corresponds to the id key in each of the submission objects in this dataset.

Re: Full Reddit Submission Corpus now available for 2006 thru August 2015

#4

Post by Jake232 » Mon, Sep 28, 2015, 7:46 AM UTC

lysium wrote: post #2

I'm not quite sure how I feel about it. Yes, that data was publicly available, but it 'feels' different that there is now an unalterable snapshot available to the public. No more comment deletion.

A comment dataset was actually already released a while back.

Re: Full Reddit Submission Corpus now available for 2006 thru August 2015

#5

Post by Houshalter » Mon, Sep 28, 2015, 7:49 AM UTC

lysium wrote: post #2

I'm not quite sure how I feel about it. Yes, that data was publicly available, but it 'feels' different that there is now an unalterable snapshot available to the public. No more comment deletion.

That's already true due to a service called: uneddit reddit: http://uneddit.com/ and https://www.unedditreddit.com/

There's also the web archive and search engine indexing.

Re: Full Reddit Submission Corpus now available for 2006 thru August 2015

#6

Post by dssddsds » Mon, Sep 28, 2015, 7:50 AM UTC

Now we wait for someone to train a RNN and produce a fake but believable reddit parody with generated titles :)

Re: Full Reddit Submission Corpus now available for 2006 thru August 2015

#7

Post by cmdli » Mon, Sep 28, 2015, 7:54 AM UTC

dssddsds wrote: post #6

Now we wait for someone to train a RNN and produce a fake but believable reddit parody with generated titles :)

Have you seen this?

https://www.reddit.com/r/subredditsimulator

Re: Full Reddit Submission Corpus now available for 2006 thru August 2015

#8

Post by ljk » Mon, Sep 28, 2015, 7:55 AM UTC

lysium wrote: post #2

I'm not quite sure how I feel about it. Yes, that data was publicly available, but it 'feels' different that there is now an unalterable snapshot available to the public. No more comment deletion.

> No more comment deletion

Isn't that how hackernews is? not being able to delete comments

Re: Full Reddit Submission Corpus now available for 2006 thru August 2015

#9

Post by dssddsds » Mon, Sep 28, 2015, 7:58 AM UTC

cmdli wrote: post #7

dssddsds wrote: post #6

Now we wait for someone to train a RNN and produce a fake but believable reddit parody with generated titles :)

Have you seen this? https://www.reddit.com/r/subredditsimulator

Some of them are amazing - "TIL Robin Williams died a year ago yesterday, Donald Trump and Bernie Sanders Will Consider Legalizing Dank Maymays if Jet Fueled"

Re: Full Reddit Submission Corpus now available for 2006 thru August 2015

#10

Post by kzhahou » Mon, Sep 28, 2015, 8:01 AM UTC

Correlate the comment corpus against LinkedIn DB and other public data sources, and one could create an auto-dox system.