Live data from Hacker News

Why Stack Exchange Isn’t in the Cloud

blog.serverfault.com

41–50 of 85 posts

Re: Why Stack Exchange Isn’t in the Cloud

#41
post #36

The reason I'm still wary of the cloud is that the abstractions are still too leaky (to borrow Joel Spolsky's turn of phrase). When you start abstracting away core system calls (like fsync), things work great 99.99% of the time. But when that .01% bites you, it bites hard . We don't expect core system calls (like fsync) to fail. And when they fail, the fact that our code is two or three levels levels of abstraction h…

In what way does fsync work differently in the cloud?

In the way that you have no idea whether fsync actually writes the data to disk, or whether it puts it in memory somewhere (usually a write cache).

Re: Why Stack Exchange Isn’t in the Cloud

#42
post #35
post #14

Given the introduction, I thought we were going to see a fantastic breakdown of cost estimates; capex and opex expenses, 95% percentile bandwidth pricing vs. Amazon's fixed rate per-byte pricing. A real analysis would have even dug into the question of sysadmins vs engineering staff, and the potential for "the cloud" to allow programmers to actually program infrastructure, eliminating internal sysadmin staff complete…

> eliminating internal sysadmin staff completely (and outsourcing all the remaining sysadmin work to Amazon) Man, this idea is one of the most insane things I hear. Amazon does not install your operating systems, Amazon does not install and configure you applications, Amazon does not troubleshoot anything related to the operation of the servers, Amazon does not do analysis on your traffic patterns and decide when you…

You conveniently left out the first part of the quoted sentence, "allow programmers to actually program infrastructure". Almost everything you wrote can be programmed these days without a "traditional" sysadmin.

Re: Why Stack Exchange Isn’t in the Cloud

#43
post #21

The reason I'm still wary of the cloud is that the abstractions are still too leaky (to borrow Joel Spolsky's turn of phrase). When you start abstracting away core system calls (like fsync), things work great 99.99% of the time. But when that .01% bites you, it bites hard . We don't expect core system calls (like fsync) to fail. And when they fail, the fact that our code is two or three levels levels of abstraction h…

Cloud or not, if you're writing serious software (and by that I mean software that depends on fsync succeeding) you'd better expect system calls to fail and have code to handle that.

The failure with fsync is not that the system call will fail but that it will succeed but be wrong about writing to durable storage.

Re: Why Stack Exchange Isn’t in the Cloud

#44
post #23

Poorly written argument full of red herrings. From what I can tell, their answer to the "why aren't you in the cloud" question is that they "love computers so much that they want to do it all themselves because it's so fun".

If I asked you why you were eating pizza and you responded "because I like pizza" would you still consider that a red herring argument? All they are saying is that they are not in the cloud because they don't want to be in the cloud and because they quite like not being in the cloud. It works for them. Why is that expression at all controversial? If they'd labeled their blog "Why being in the Cloud is a bad idea" or…

You're correct about alternative titles for the blog post. However, the assumption is that on a technical blog, readers would expect technical answers--at least I did. You're not going to tell your boss that the next product should be developed in Java because you like Java. They want concrete reasons.

Re: Why Stack Exchange Isn’t in the Cloud

#45
post #5

I suspect that this is part of the problem with many big manufacturing companies these days. Ford was a leader for so many years was because their leadership was passionate about engineering and manufacturing. Henry Ford was an engineer for the Edison Company before he was a manager and is famous for obsessing about every detail of the manufacturing process. That sort of spirit infected the company up through the 196…

A Ford bought today is less expensive, considerably safer, more efficient, and more reliable than a Ford from the days of Henry Ford. Meanwhile, today's manufacturing companies routinely make objects – like the processor driving the machine that you are reading this on – that are orders of magnitude more complex than the most advanced technology of 1959. And all of this was done by companies that employ lots of accou…

The current CEO of Ford, Alan Mulally is an engineer by trade. I attribute a lot of their current success to him.

Re: Why Stack Exchange Isn’t in the Cloud

#46
post #14

Given the introduction, I thought we were going to see a fantastic breakdown of cost estimates; capex and opex expenses, 95% percentile bandwidth pricing vs. Amazon's fixed rate per-byte pricing. A real analysis would have even dug into the question of sysadmins vs engineering staff, and the potential for "the cloud" to allow programmers to actually program infrastructure, eliminating internal sysadmin staff complete…

It was a real analysis that went beyond just counting the beans. As a privately held company, getting rid of passionate people doesn't make the stock go up, increase anyone's bonus, or benefit their long term goals - and blogging about their values certainly cannot hurt in attracting top notch talent.

" - and blogging about their values certainly cannot hurt in attracting top notch talent."

They're a microsoft shop. They're not going to attract top talent. Who here wants to deal with that stuff?

Re: Why Stack Exchange Isn’t in the Cloud

#47
post #35

Earlier quoted context omitted.

> eliminating internal sysadmin staff completely (and outsourcing all the remaining sysadmin work to Amazon) Man, this idea is one of the most insane things I hear. Amazon does not install your operating systems, Amazon does not install and configure you applications, Amazon does not troubleshoot anything related to the operation of the servers, Amazon does not do analysis on your traffic patterns and decide when you…

You conveniently left out the first part of the quoted sentence, "allow programmers to actually program infrastructure". Almost everything you wrote can be programmed these days without a "traditional" sysadmin.

Between AMIs, Configuration Engines, and things like http://susestudio.com/ make it simpler to create auto-scaling infrastructure.

http://en.wikipedia.org/wiki/Comparison_of_open_source_confi...

Granted that process is still under refinement, but with dedication you can achieve those goals.

Conversely, again with cost analysis, which is cheaper, a developer who can manage all that, or a sysadmin? I am sure there is a curve, small end a sysadmin, large end automation.

Re: Why Stack Exchange Isn’t in the Cloud

#48
post #35

Earlier quoted context omitted.

> eliminating internal sysadmin staff completely (and outsourcing all the remaining sysadmin work to Amazon) Man, this idea is one of the most insane things I hear. Amazon does not install your operating systems, Amazon does not install and configure you applications, Amazon does not troubleshoot anything related to the operation of the servers, Amazon does not do analysis on your traffic patterns and decide when you…

You conveniently left out the first part of the quoted sentence, "allow programmers to actually program infrastructure". Almost everything you wrote can be programmed these days without a "traditional" sysadmin.

That is what good sysadmins do, and rack monkeys are training to do.

Re: Why Stack Exchange Isn’t in the Cloud

#49

What a silly argument. "If you just want to use someone else’s computers, it means you don’t love computers — at least not every aspect to them." Uh, don't they use Dell? If they love them so much, why not build their own? Why stop there? I love software and programming languages, but it doesn't mean I'm going to use my own compiler or run a company on my own libc.

Note that Joel's company Fog Creek software actually did develop their flagship product, FogBugz, on their own compiler: http://www.joelonsoftware.com/items/2006/09/01b.html

Note that the product came first, then the compiler.
Post reply on HN