Live data from Hacker News

Why we switched from Google App Engine to EC2

tophatmonocle.com

11–20 of 48 posts

Re: Why we switched from Google App Engine to EC2

#11

There's an interesting detail in the final paragraph: “We pay about 1000x more for EC2 than we did for App Engine”. One of the rarely-mentioned virtues of App Engine is that it's really, astonishingly, cheap — as well as removing the system administration burden, which is also a cost in either time or money. For a large company, web application hosting is an insignificant cost, but for an unfunded startup it can be p…

Fully agreed. App Engine is insanely cheap.

We loved this fact when we were first starting out, but after we realized how much time the various limitations were costing us I really really wished they would just let us pay them a few $k per month so the damn thing would just work.

Probably the most serious challenge for the App Engine team has been dealing with the 95%+ of their userbase that will never pay them a cent for their services, but will suck all the life out of their platform.

Re: Why we switched from Google App Engine to EC2

#12

Is it getting fashionable these days to blame Google App Engine? I am reading lots of horror stories about GAE!!

I'm a developer at Top Hat Monocle.

There have been a number of posts attacking App Engine recently, and a lot of good discussions have come out of them. The two things issues that seem to get brought up most are app design and reliability.

- Reliability: App Engine reliability used to be horrible, but it's getting better.

GAE was the first service I ever developed for where reliability was an issue. I've hosted apps on Linode, Slicehost, EC2, and my experience with those companies caused me to dismiss claims of downtime and the importance of an SLA.

Nothing sucks more then seeing your system go down for days at a time, and not being able to do anything about it. I'm glad that GAE is addressing this issue, but I'd be wary of running anything commercial on their services without buying a business plan.

- App Design: Pretty much everyone agrees that you have to write applications the way GAE wants you to, or you'll fail.

The built in GAE Python library is great for writing simple, highly scalable websites, but it's too limited to develop complex applications on. Our application has over 20KLOC and uses numerous third party libraries. In practice, we found that it was difficult and time-consuming to write our application without turning to a more established framework like Django. We were also concerned with the vendor lock-in that would be caused by building on library that could only be run on GAE. Projects like TyphoonAE (http://code.google.com/p/typhoonae/) are starting to make this less of an issue, but they aren't mature enough to provide an exit strategy.

We built our application on appenginepatch, a third party port of Django to GAE. Django was not designed to run on a non-relational DB, and GAE was not designed to handle a heavy framework like Django. Our decision to build things our application on Django ultimately lead to most of our problems, but eventually saved our skin when we decided to switch away from GAE.

Re: Why we switched from Google App Engine to EC2

#13

There's an interesting detail in the final paragraph: “We pay about 1000x more for EC2 than we did for App Engine”. One of the rarely-mentioned virtues of App Engine is that it's really, astonishingly, cheap — as well as removing the system administration burden, which is also a cost in either time or money. For a large company, web application hosting is an insignificant cost, but for an unfunded startup it can be p…

  * App Engine's TCO is high because of development time
  * EC2's TCO is high because of operations time
Hosting costs are usually not that important (except outliers like file sharing.)

Re: Why we switched from Google App Engine to EC2

#14

There's an interesting detail in the final paragraph: “We pay about 1000x more for EC2 than we did for App Engine”. One of the rarely-mentioned virtues of App Engine is that it's really, astonishingly, cheap — as well as removing the system administration burden, which is also a cost in either time or money. For a large company, web application hosting is an insignificant cost, but for an unfunded startup it can be p…

The real question IMO is whether the money saved by App Engine is more than the development cost of the premature scaling you have to do.

Re: Why we switched from Google App Engine to EC2

#15
post #10

I think it was a mistake for the GAE team to port Django to App Engine. Django is designed for a SQL based worldview and even the crippled version included with the SDK is non-optimal for App Engine deployment. Since the included version is so bad, people try to get django-app-engine-patch or django-norel working. Those also suck. There's a mindset that if Django runs, I can keep doing things the Django way. Nope. Ab…

"If you're going to use App Engine, you have to embrace its distributed, scalable way of doing things. Use something made for App Engine like webapp or tipfy."

You make a good point. I am not a Python programmer but I have tried a few AppEngine tiny experiments with Django and webapp. webapp was clearly designed for the platform. Similar case for Java: JDO or JPA never seemed like a good fit to the data store, but Objectify seems crafted to add a nice but thin layer on top of the low level APIs.

Re: Why we switched from Google App Engine to EC2

#16
post #7

Anyone have a happy story of GAE availability in particular? I am not so bothered and actually appreciate the programming model. Actually reading the story, seems like some of their architectural patterns may have run contrary to asynchronous intent. 98% availability is a deal breaker for most betting thyeir business and image.

I'll pile on this.

I'm a huge EC2 zealot (and customer) - but I'm also intrigued by the concepts behind App Engine. However, there has been a spate of negative posts such as these around App Engine.

I also would like to hear from someone who is successfully using App Engine for a large scale project, and what their lessons learned, best practices are.

I'm one of those "right tool for the right job" type of person so I'd love to see where App engine might fit in some of my business' architecture.

Re: Why we switched from Google App Engine to EC2

#17

There's an interesting detail in the final paragraph: “We pay about 1000x more for EC2 than we did for App Engine”. One of the rarely-mentioned virtues of App Engine is that it's really, astonishingly, cheap — as well as removing the system administration burden, which is also a cost in either time or money. For a large company, web application hosting is an insignificant cost, but for an unfunded startup it can be p…

re: very low cost: how true!

The web app I run on AppEngine 24/7 is a low volume site so I never appreciated how much the daily free quota gets you until last summer when I took one of the Google Buzz firehose reading demos and modified it to extract what I wanted from the Buzz firehose (large volume of Buzz, Twitter, etc. social messages). I just used the daily free quota and my temporary app would run for 5 or 6 hours a day before hitting the quota. Lots of bandwidth and CPU use.

That said, I never mind my monthly Amazon AWS bill because its a good value (and, for a long time it was free because of two grants they gave me).

I also would like a plan from Google where I gave them some money every month; this may happen when version 1.4 is released because I am trying to decide between AWS and AppEngine for a new project. I am curious what having three instances always spun up will cost.

Re: Why we switched from Google App Engine to EC2

#18
post #6
post #3

The thing people "forget" is that the further up the stack you move, the more support is required because there's less and less the customer can do to diagnose a problem.

By "people", are you referring to Google? If so, I agree -- not having technical support available is a deal breaker for a system of that scale, especially if outages are as prevalent as the author claims.

I think he means both Google and their customers.

Google should get it, in that they need to offer support if they want to run this kind of business. But customers should also know that Google doesn't do support, and they will need support, so GAE is probably not a good fit.

If that's right, I agree as well.

Re: Why we switched from Google App Engine to EC2

#19
Wow, these stories about the horrors of GAE are a little bit scary for me. I was starting to develop a project with a friend in our spare time, and we decided to go with GAE. We've only gotten as far as the end of the tutorial and are reading the documentation for GAE, but I have a question:

As a college student who is looking to build a project on the side as a means for experience and a way to handle an issue we have, should I look into something other than GAE? I really do not intend to make our idea a startup or anything. Any help would be appreciated!

Re: Why we switched from Google App Engine to EC2

#20
post #10

I think it was a mistake for the GAE team to port Django to App Engine. Django is designed for a SQL based worldview and even the crippled version included with the SDK is non-optimal for App Engine deployment. Since the included version is so bad, people try to get django-app-engine-patch or django-norel working. Those also suck. There's a mindset that if Django runs, I can keep doing things the Django way. Nope. Ab…

Personally I very much like django-nonrel. It gives me pretty much the same constraints as webapp, while still maintaining enough of my old worldview that the culture shock isn't too big.

Yes, you still have to adapt to the AppEngine way of doing things. But the adaptation is much simpler ... and I completely dislike the way webapp does a lot of things judging from the examples Google provides. I like my world nice and full of free-floating functions. Wrapping things into nearly meaningless objects hurts my brain.

Post reply on HN