Live data from Hacker News

New on Reddit: Comment search, improved search results relevance, search design

redditinc.com

21–30 of 266 posts

Re: New on Reddit: Comment search, improved search results relevance, search design

#21
post #4

Interesting, I wonder what they used for the search database, since that enormous amount of text can't fit in RAM, it would have to be partitioned & sharded in something like Scylla DB

I doubt that a succinct full text index (like an FM-index) of this data would require more than a modest server to keep in memory. Why aren't these used in this context?

Re: New on Reddit: Comment search, improved search results relevance, search design

#22

I use this: https://camas.github.io/reddit-search/ Search Reddit comments and posts by keyword, user, sub, or all three. Includes deleted comments and posts.

If you want to delete your Reddit account from the pushshift Reddit dataset, you have a Google form: https://teddit.net/r/pushshift/comments/pat409/online_remova...

> Right now, we internally blacklist the account so that the data is not exposed via any public API. For full disclosure, we currently do not permanently delete any data unless there is a major issue involving PII, etc. While you have the right to request that people cannot search your comments and submissions via the public API, we reserve the right to keep data in our private archive so long as we never allow any data that you requested be removed get exposed through any public API endpoints.

Your deleted comments even after requesting to be removed from pushshift can still be found in the archives e.g. what https://camas.github.io/reddit-search/ uses

Re: New on Reddit: Comment search, improved search results relevance, search design

#23

One of the most annoying things is to open a thread and be forced to click all over the place to see comments rolled up under each other. You can't even search comments inside a single post until you have somehow unwound everything. Thats why I use Sync for Reddit and will logout proper if they dump 3rd party clients.

old.reddit.com fixes that, no?

Re: New on Reddit: Comment search, improved search results relevance, search design

#24
post #23

One of the most annoying things is to open a thread and be forced to click all over the place to see comments rolled up under each other. You can't even search comments inside a single post until you have somehow unwound everything. Thats why I use Sync for Reddit and will logout proper if they dump 3rd party clients.

old.reddit.com fixes that, no?

No, they've changed something recently where sufficiently nested comments with replies now seem to show 'click to see more' thing as well

Re: New on Reddit: Comment search, improved search results relevance, search design

#25
post #6

Off topic: If Anyone reading this thinking of joining reddit you can navigate it two ways without getting engaged(also enraged) with the the scum and filth and rage-baits that is r/all or r/popular. 1). Use old.reddit.com, create an account ( it will bait you to enter your email, but its not necessary to proceed. ). Go to subreddits that you want to follow, there are hundreds of niche subreddits which are frankly qui…

The default subs are great if you have low blood pressure but there are good niche communities on reddit.

Re: New on Reddit: Comment search, improved search results relevance, search design

#26
post #23

Earlier quoted context omitted.

old.reddit.com fixes that, no?

No, they've changed something recently where sufficiently nested comments with replies now seem to show 'click to see more' thing as well

That's always been the case, it should not be as bad as new Reddit though

Re: New on Reddit: Comment search, improved search results relevance, search design

#27
post #6

Off topic: If Anyone reading this thinking of joining reddit you can navigate it two ways without getting engaged(also enraged) with the the scum and filth and rage-baits that is r/all or r/popular. 1). Use old.reddit.com, create an account ( it will bait you to enter your email, but its not necessary to proceed. ). Go to subreddits that you want to follow, there are hundreds of niche subreddits which are frankly qui…

I like seeing the popular posts, so I browse r/all but use the 'filter subreddits' option in the right-hand sidebar to remove all the dross.

Re: New on Reddit: Comment search, improved search results relevance, search design

#28

Earlier quoted context omitted.

If you want to delete your Reddit account from the pushshift Reddit dataset, you have a Google form: https://teddit.net/r/pushshift/comments/pat409/online_remova...

> Right now, we internally blacklist the account so that the data is not exposed via any public API. For full disclosure, we currently do not permanently delete any data unless there is a major issue involving PII, etc. While you have the right to request that people cannot search your comments and submissions via the public API, we reserve the right to keep data in our private archive so long as we never allow any d…

It says it's using the pushshift api on the page.

Re: New on Reddit: Comment search, improved search results relevance, search design

#29
post #6

Off topic: If Anyone reading this thinking of joining reddit you can navigate it two ways without getting engaged(also enraged) with the the scum and filth and rage-baits that is r/all or r/popular. 1). Use old.reddit.com, create an account ( it will bait you to enter your email, but its not necessary to proceed. ). Go to subreddits that you want to follow, there are hundreds of niche subreddits which are frankly qui…

An important thing is also that reddit still doesn't require a mail address. Just click continue on the signup form without filling in the mail and bypass the dark pattern.
Post reply on HN