It looks like the Obama AMA has really caused some serious fires in reddit's backend infrastructure. The site's been down for the last 10 minutes. I would've thought that they'd have brought in some additional computing power for such an event, should've been easy for them considering they have a cloud deployment. Maybe this gives them greater reason to hire more engineers. I found it impressive that they served bill…
Stupid question: is the because reddits backend is in python? I often hear that PHP + varnish is only limited by the size of the pipe. Can this scale on cloud platforms?
Also, if you were to use Varnish as a cache, that wouldn't help you much with write access because every time there is a write (a new post..) you'd have to invalidate the cache. In a high volume scenario such as this (tons of posts coming in..), the page is as good as dynamic, even if you DO cache it for a bit.