Live data from Hacker News

Show HN: Subreddit Finder - Trained on 4M Reddit Posts from 4K Subreddits

valohai.com

61–70 of 82 posts

Re: Show HN: Subreddit Finder - Trained on 4M Reddit Posts from 4K Subreddits

#63
post #62

I wish reddit would allow me to download all my comments. Apparently it's not possible since they're all archived, because reddit constantly regenerate its webpages.

You can download them from google:

https://bigquery.cloud.google.com/table/fh-bigquery:reddit_c...

Run an SQL over all comments of everyone

edit: so only comments till october. 6 months old, that is when they become archived. Guess google has only the archived comments.

Re: Show HN: Subreddit Finder - Trained on 4M Reddit Posts from 4K Subreddits

#64
post #39

Earlier quoted context omitted.

I'm not really sure your query is what it was built for. That's more of a google search than a community idea.

Not sure if you're familiar with reddit but question posts like that are incredibly common, especially in regards to technology questions and the like. It's still a forum when you get down to it so lots of people like myself post questions on niche topics because you can find small communities of experts on everything from dogs to obscure vintage computers. Just saying, as a huge user of reddit - I'd expect the same…

I'm a long time redditor, and that's why I said what I did. I felt the took was more for finding your niche community than finding an answer to a question. Different interpretations I guess.

Re: Show HN: Subreddit Finder - Trained on 4M Reddit Posts from 4K Subreddits

#65
post #62

I wish reddit would allow me to download all my comments. Apparently it's not possible since they're all archived, because reddit constantly regenerate its webpages.

You can download them from google: https://bigquery.cloud.google.com/table/fh-bigquery:reddit_c... Run an SQL over all comments of everyone edit: so only comments till october. 6 months old, that is when they become archived. Guess google has only the archived comments.

You can also download them from their original mirror at pushshift[1]

PS: that BQ you linked is maintained by fhoffa[2]

1: https://files.pushshift.io/reddit/

2: https://news.ycombinator.com/user?id=fhoffa

Re: Show HN: Subreddit Finder - Trained on 4M Reddit Posts from 4K Subreddits

#66
A very cool demo and I congratulate the author, but I am always a little sad for more data science type demos that try to answer the question (that is proving toxic) "given what I know about you, how can I find a community of people just like you?"

I would love to see a subreddit finder that answers questions like "what community would complement your interests?" or "what community needs to hear what you have to say?" or "what community would be made better by your presence?". Similarity is at best a proxy for it.

Those are harder but, I think, more useful.

Re: Show HN: Subreddit Finder - Trained on 4M Reddit Posts from 4K Subreddits

#68
"What is the penalty for living" -> http://reddit.com/r/Poland, 28%

"When should I kill my chicken" -> http://reddit.com/r/csgo, 19%

"Am I conscious" -> http://reddit.com/r/INTP, 25%

"How to not think" -> http://www.reddit.com/r/howtonotgiveafuck/, 49%

"Is the government evil" -> http://www.reddit.com/r/ENLIGHTENEDCENTRISM/, 19%

"Is the government good" -> http://www.reddit.com/r/CoronavirusUK, 10%

"Is the government useful" -> http://www.reddit.com/r/iran, 31%

Re: Show HN: Subreddit Finder - Trained on 4M Reddit Posts from 4K Subreddits

#70

Earlier quoted context omitted.

You can download them from google: https://bigquery.cloud.google.com/table/fh-bigquery:reddit_c... Run an SQL over all comments of everyone edit: so only comments till october. 6 months old, that is when they become archived. Guess google has only the archived comments.

You can also download them from their original mirror at pushshift[1] PS: that BQ you linked is maintained by fhoffa[2] 1: https://files.pushshift.io/reddit/ 2: https://news.ycombinator.com/user?id=fhoffa

Original mirror? But the BQ has 2019_10 while the pushshift has only up 2019-09
Post reply on HN