Note: the talk is from May 2010.
I wonder if Steve (or rather, jedberg or someone else at reddit) were to give the talk today, if 'memcache' and 'memcachedb' would both be replaced by Redis?
Steve Huffman on Lessons Learned at Reddit
11–20 of 26 posts
Re: Steve Huffman on Lessons Learned at Reddit
#12Why did they use Python in the first place? Reddit is still kind of unstable.
I dont think reddit's stability is as bad as it looks. Just that Reddit's community is pretty vocal on it. IIRC, they have availability in high 90s (may be jedberg can confirm).
Re: Steve Huffman on Lessons Learned at Reddit
#13Earlier quoted context omitted.
Reddit was stable for a long time. It's really only been the last few months (~6?) that they've been suffering serious service outages.
Actually, our uptime has been better for the last 6 months than the previous few years.
I don't go on reddit often enough to have any idea about the uptime, but out of curiosity, do you think there's anything that could give someone the impression it was worse recently?
Re: Steve Huffman on Lessons Learned at Reddit
#14another lesson could be: "don't make a site that appeals to people who use ad-block. revenue won't keep up with demand."
Re: Steve Huffman on Lessons Learned at Reddit
#15Earlier quoted context omitted.
Actually, our uptime has been better for the last 6 months than the previous few years.
I don't go on reddit often enough to have any idea about the uptime, but out of curiosity, do you think there's anything that could give someone the impression it was worse recently?
There's enough users that each 3 second downtime is long enough to get someone who submits stories like 'WHY WAS REDDIT DOWN' and enough upvotes to stay on the front page long enough for everyone else to see it. And then recency effect kicks in as soon as reddit is down for another 4 seconds later on.
Re: Steve Huffman on Lessons Learned at Reddit
#16I'm always reluctant about going completely schemaless. Reminds me of the blog post by FriendFeed about how they use MySQL, highly recommended: http://bret.appspot.com/entry/how-friendfeed-uses-mysql I feel like like there needs to be a better middleground for having some schema but being able to augment it easily with metadata that you're not querying against (yet). Then later extracting the metadata into queryable…
I think this is exactly right. Have a document store and a (separate?) index store.
Re: Steve Huffman on Lessons Learned at Reddit
#17That's a good basic overview on what it takes to keep a site the size of Reddit (a year ago) afloat. I need to think more about caching, personally.
Reddit has done a great job of serving a massive amount of traffic, given the size of their staff especially.
Re: Steve Huffman on Lessons Learned at Reddit
#18Note: the talk is from May 2010. I wonder if Steve (or rather, jedberg or someone else at reddit) were to give the talk today, if 'memcache' and 'memcachedb' would both be replaced by Redis?
Maybe? There's something to be said for memcache's simplicity, however.
Re: Steve Huffman on Lessons Learned at Reddit
#19Earlier quoted context omitted.
Reddit was stable for a long time. It's really only been the last few months (~6?) that they've been suffering serious service outages.
Actually, our uptime has been better for the last 6 months than the previous few years.
That's a bit of a stretch... That "reddit is under heavy load" page is an abomination.