41–50 of 96 posts
This could be amazing as input to a question answering engine.
I think Reddit was one of the places they had to wall off Watson from data-mining, because it devolved into foul-mouthed memes. I wish they hadn't, nothing would be better than a billion dollar piece of technology deciding to reenact Sean Connery Jeopardy skits, on Jeopardy. [2001 HAL voice]: I have a question about the penis mightier. Does it work?
This could be amazing as input to a question answering engine.
I actually built an IRC bot that did this once. It searched reddit for your question, took the first result, and posted the top comment. It worked very well for certain kinds of questions. Especially if it came from the better subreddits like askscience, but even just reddit in general. I improved on it a lot with a whitelist of subreddits and some machine learning to select the best thread. But I was only touching o…
As linked below, I've played around a bit with this dataset: https://www.reddit.com/r/dataisbeautiful/comments/3cjyvb/rel... BigQuery is the best interface for it. Can resolve queries on the entire dataset in less than a few seconds (however, you only get 1TB processing free per month. Since the full dataset is ~285GB, you only get 4 queries per month. Plan ahead on the May 2015 dataset, which is only 8GB.) I can ans…
Is this data in a format that allows to recover threads? I.e., comment X was a response to comment Y ?
Earlier quoted context omitted.
I think Reddit was one of the places they had to wall off Watson from data-mining, because it devolved into foul-mouthed memes. I wish they hadn't, nothing would be better than a billion dollar piece of technology deciding to reenact Sean Connery Jeopardy skits, on Jeopardy. [2001 HAL voice]: I have a question about the penis mightier. Does it work?
It's not the hard to filter put the foul-mouthed content
Children make nutritious snacks
As linked below, I've played around a bit with this dataset: https://www.reddit.com/r/dataisbeautiful/comments/3cjyvb/rel... BigQuery is the best interface for it. Can resolve queries on the entire dataset in less than a few seconds (however, you only get 1TB processing free per month. Since the full dataset is ~285GB, you only get 4 queries per month. Plan ahead on the May 2015 dataset, which is only 8GB.) I can ans…
Someone should try make a sentient twitter bot that learns from the Reddit data
How does one go about doing that? I know how to program, but I have written anything which do 'intelligent' stuff.
[1] https://www.edx.org/course/analytics-edge-mitx-15-071x-0 [2] https://www.youtube.com/watch?v=JzaoJZNCVWA
Not trying to throw cold water on this...but are the Reddit execs OK with this? I mean, Twitter and Facebook would most likely issue takedowns for similar kinds of data dumps...but is there something in the Reddit API TOS that says this is OK?...I wouldn't be surprised if there a fairly liberal license, as that would be aligned with the early spirit of the site. And an onerous TOS would have likely curbed the active…
I believe reddit comments are made under a CC license
"You retain the rights to your copyrighted content or information that you submit to reddit ('user content') except as described below."
And the exceptions just state that Reddit has a perpetual irrevocable worldwide license.
So it seems like there's no default license and others don't have any automatic rights to use the content. Does this assessment seem correct? In practice, it may not be a big problem, particularly for academic research and such, but I'm guessing there are some uses that might cause problems.
The most downvoted comment[2] is ironically in iAMA, by a mod of iAMA (ironic because of the recent drama).
I'd find the top ten most upvoted, but I ran out of free bandwidth on BigQuery :(.
[0] https://gist.github.com/alexggordon/7b56353dcf8044a7a5f9
[1] https://drive.google.com/file/d/0Bzxo-UKxFmN-eWticy1BR2tCRDQ...
[2] https://www.reddit.com/r/IAmA/comments/s5guk/iam_bad_luck_br...
I really want to get my full commenting history from this, but the download is enormous. Anyone know how I could go about this with cloud services?
I really want to get my full commenting history from this, but the download is enormous. Anyone know how I could go about this with cloud services?
Hey there! I'm the one that uploaded the original dataset. I'm creating API endpoints that will easily allow you to do this. It should be completed in 1-2 weeks.