Live data from Hacker News

StackOverflow Update: 560M Pageviews a Month, 25 Servers

highscalability.com

61–70 of 278 posts

Re: StackOverflow Update: 560M Pageviews a Month, 25 Servers

#61
post #59

Soooo... a average of 200 pageviews a second - I suppose that doesn't sound as cool. Or, to put it another way; 1 server per 8 pageviews per second Does not seem that efficient when you put it like that. Even a resource hog like a wordpress install can eclipse that level. *made correction- still not impressed

I think you're missing a 0 somewhere : 560000000 / (60 * 60 * 24 * 31) = 209

[deleted]

Re: StackOverflow Update: 560M Pageviews a Month, 25 Servers

#62
"with just 25 servers"

This really needs to stop. Go to stackexchange.com and you'll find that more than half of the HTTP requests are to cdn.sstatic.net.

Looking up the IP addresses for cdn.sstatic.net returned five entries for me, all owned by CloudFlare. None of the CloudFlare servers that they are using seem to be in that 25 count.

Sure, these are all for static assets, that isn't the point. There are way more than 25 servers being used to serve the StackOverflow sites.

Re: StackOverflow Update: 560M Pageviews a Month, 25 Servers

#64
What I'd like to see is how much cache hit they add on each level of cache. I remember some presentation of the facebook images stack where less than 10% (if I remember well) of the requests actually hit the disks; it would be interesting to see the patterns for the whole SE galaxy.

Re: StackOverflow Update: 560M Pageviews a Month, 25 Servers

#65

Soooo... a average of 200 pageviews a second - I suppose that doesn't sound as cool. Or, to put it another way; 1 server per 8 pageviews per second Does not seem that efficient when you put it like that. Even a resource hog like a wordpress install can eclipse that level. *made correction- still not impressed

You're off by a factor of 10. I have it at just over 200 page views per second. Also, that's the average load over a month. The same hardware needs to be able to handle peak load.

and they also mention that they could possibly run on a lot less hardware... 7-8 machines + network gear (7 if the load balancer is an appliance, 8 if its a server).

Re: StackOverflow Update: 560M Pageviews a Month, 25 Servers

#66
post #50

Earlier quoted context omitted.

Dapper is great - I promptly dumped NHibernate and Entity Framework for it. It's the only ORM I've found that makes it trivially easy (as it should be) to use stored procedures and views in queries.

+1 for Dapper - I'm a big fan. It is very fast and we use it to serve our live (mostly read-only) traffic, while using something like Entity Framework for the backend Administrative UI, which has a lot of inserts and updates.

There's a couple of user-contrib projects that do similar things for inserts & updates. Dapper Extensions is the one I'm using.

https://github.com/tmsmith/Dapper-Extensions

Re: StackOverflow Update: 560M Pageviews a Month, 25 Servers

#67
post #41
post #33

> The cost of inefficient code can be higher than you think. Efficient code stretches hardware further, reduces power usage, makes code easier for programmers to understand. I'm curious what the reasoning is for "Efficient code ... makes code easier for programmers to understand". To my mind, efficient code (in this case, I assume coding to the hardware, as they mention elsewhere), has many benefits, but making it ea…

Definitely. Some of the most efficient C code I have seen is incomprehensible to anyone but a C expert and even then it takes several minutes to understand all of the nuances of what might only be a 4-line function.

I experienced exactly this when I cracked open the source to a GNU tool to see if I could figure it out.

Re: StackOverflow Update: 560M Pageviews a Month, 25 Servers

#68

"with just 25 servers" This really needs to stop. Go to stackexchange.com and you'll find that more than half of the HTTP requests are to cdn.sstatic.net. Looking up the IP addresses for cdn.sstatic.net returned five entries for me, all owned by CloudFlare. None of the CloudFlare servers that they are using seem to be in that 25 count. Sure, these are all for static assets, that isn't the point. There are way more th…

Stack Exchange dont own their CDN. If you really start couting external servers, you would be adding DNS, possible client side proxy servers, client side network infrastructure, etc... these are things that OTHER people do, not SO.

Re: StackOverflow Update: 560M Pageviews a Month, 25 Servers

#69
post #29
post #8

Earlier quoted context omitted.

It's not a server, but I've seen machines used in physics simulations have something on the order of 256 GB RAM in them. As far as I know they cost maybe $20k-$30k, so not absurdly expensive. I don't think addressing that memory is a problem on any x64 architecture. Windows Server 2012 has a 4TB upper limit on RAM, apparently [1], and as far as I can tell there's no reason for this other than product differentiation…

$4k is all you need to build a whitebox 256GB machine: dual-socket G34 motherboard with 16 DDR3 slots lke the ASUS KGPE-D16 ($500) + two Opteron 6320 (2 * $300) + sixteen 16GB registered ECC DDR3-1600 (16 * $160) + chassis/PSU ($500) = $4160. Doing this on Amazon r3.8xlarge ($2.8/hr) would cost you $8100+ over 4 months. A DIY server can make sense in some cases. Eg. you are a very early-stage startup with almost no f…

Don't forget to factor in the costs of running, cooling, and maintaining that much hardware (also bandwidth costs). I'm not saying it's $2k/month, I'm just saying don't compare the physical box and AWS without factoring everything in. At the end of the day, if you don't need the support, you're probably right that a dedicated box makes sense there.

Re: StackOverflow Update: 560M Pageviews a Month, 25 Servers

#70

One smart thing they are doing is putting different sites on different databases. It effectively as a kind of partitioning to allow for horizontal scaling if needed. If nothing else, it keeps less data in each table, so queries should be faster due to smaller datasets. Sounds like they know what they are doing.

beware that you can over-optimized this.

for example, do not put every single customer of an saas solution into a separate database.

Post reply on HN