New on Reddit: Comment search, improved search results relevance, search design
1–10 of 266 posts
Re: New on Reddit: Comment search, improved search results relevance, search design
#2Still staying away.
Re: New on Reddit: Comment search, improved search results relevance, search design
#3I'm still going to use google to search to be honest.
Re: New on Reddit: Comment search, improved search results relevance, search design
#4Interesting, I wonder what they used for the search database, since that enormous amount of text can't fit in RAM, it would have to be partitioned & sharded in something like Scylla DB
Re: New on Reddit: Comment search, improved search results relevance, search design
#5I use this:
https://camas.github.io/reddit-search/
Search Reddit comments and posts by keyword, user, sub, or all three.
Includes deleted comments and posts.
Re: New on Reddit: Comment search, improved search results relevance, search design
#6Off topic: If Anyone reading this thinking of joining reddit you can navigate it two ways without getting engaged(also enraged) with the the scum and filth and rage-baits that is r/all or r/popular.
1). Use old.reddit.com, create an account ( it will bait you to enter your email, but its not necessary to proceed. ). Go to subreddits that you want to follow, there are hundreds of niche subreddits which are frankly quite awesome. Subscribe to them. click on r/Home to get the feeds of the subscribed subreddits.
2). Read-only subreddits, privacy focused. Use libredd.it go to niche hobby subreddits and subscribe. Come back to homepage.
There you go the correct ways to navigate through the piles of garbage. Thank me later for your saved time, sanity.
Re: New on Reddit: Comment search, improved search results relevance, search design
#7I use this: https://camas.github.io/reddit-search/ Search Reddit comments and posts by keyword, user, sub, or all three. Includes deleted comments and posts.
If you want to delete your Reddit account from the pushshift Reddit dataset, you have a Google form: https://teddit.net/r/pushshift/comments/pat409/online_remova...
Re: New on Reddit: Comment search, improved search results relevance, search design
#8Interesting, I wonder what they used for the search database, since that enormous amount of text can't fit in RAM, it would have to be partitioned & sharded in something like Scylla DB
You can rent from various cloud providers many VMs with 2TB of ram each.
AWS also offers some high memory machines with up to 24TB of ram in some locations.
Re: New on Reddit: Comment search, improved search results relevance, search design
#9Interesting, I wonder what they used for the search database, since that enormous amount of text can't fit in RAM, it would have to be partitioned & sharded in something like Scylla DB
IIRC they have a pretty standard PostGres setup. I'd bet they just setup another PostGres shard replicated just for search, using an extension for the index. Doesn't require the index or working set to be in RAM.
Re: New on Reddit: Comment search, improved search results relevance, search design
#10Interesting, I wonder what they used for the search database, since that enormous amount of text can't fit in RAM, it would have to be partitioned & sharded in something like Scylla DB
inverted indexes do not require that much overhead