Live data from Hacker News

Amazon DynamoDB – a Fast and Scalable NoSQL Database Service from AWS

allthingsdistributed.com

41–50 of 135 posts

Re: Amazon DynamoDB – a Fast and Scalable NoSQL Database Service from AWS

#41
post #38

This looks like a great service - there are some really interesting ideas here. The provisioned throughput is a great idea. It's interesting to see it runs on SSDs as well, I wonder if its storage is log based like LevelDB. The composite hashed indexes are really interesting as well - I guess they partition the index across nodes, and each node maintains a range of the sorted index. It'll be interesting to see how us…

> I read with interest Steve Yegge's mistakenly-leaked email about the oppressive conditions for engineers at Amazon. It's hard to reconcile with the sort of innovation they consistently show.

My take on Steve's rant (as an engineer at Amazon) is that a lot of the issues he pointed out are legitimate, but at an entirely different scale than he was pitching them at.

Day to day I work on a product with another couple dozen or so engineers. We build what makes sense for our product, and for the most part we build it in a way that makes sense for us. Sometimes we are under pressure to leverage other parts of the platform, and sometimes that does entail a lot more work. Most of the time, though, it ends up reducing our operational load (because the systems we depend on support products much larger than ours :) and giving us someone we can page when things go pear-shaped.

Amazon isn't the perfect place to work, but it's generally not bad (other than the frugality thing; that sucks as an employee no matter which way you slice it).

Re: Amazon DynamoDB – a Fast and Scalable NoSQL Database Service from AWS

#43

I would love the option to add N index (at cost). My guess is they will add options for additional indexes in the future...everyone needs start somewhere. Even at Amazon's size and scale.

> Even at Amazon's size and scale.

At Amazon's size and scale, it's all the more important that you start with something simple with well-understood performance characteristics from day one. AWS doesn't really get a grace period during which they get to fix scalability problems.

Re: Amazon DynamoDB – a Fast and Scalable NoSQL Database Service from AWS

#44
post #6

From the limits page(1) I see you can only have 256 tables per account. (1) http://docs.amazonwebservices.com/amazondynamodb/latest/deve...

As with all the other AWS services you can have your limits lifted upon request.

Can the 10GB per domain limit be raised on SimpleDB? Or do I have to promise to refer to it as DynamoDB to do that? :-)

Re: Amazon DynamoDB – a Fast and Scalable NoSQL Database Service from AWS

#46

I'm too scared of the lock in. Afaik this isn't like EC3 where you can move a VM off the EC3 stack. The data is stored in a proprietary format so once your in, you're in. Game changer? I need to see some evidence first on how well it performs and integrates.

It's a database, so you can always get your data out again.

[deleted]

Re: Amazon DynamoDB – a Fast and Scalable NoSQL Database Service from AWS

#47

I'm too scared of the lock in. Afaik this isn't like EC3 where you can move a VM off the EC3 stack. The data is stored in a proprietary format so once your in, you're in. Game changer? I need to see some evidence first on how well it performs and integrates.

It's a database, so you can always get your data out again.

[deleted]

Re: Amazon DynamoDB – a Fast and Scalable NoSQL Database Service from AWS

#48

I'm too scared of the lock in. Afaik this isn't like EC3 where you can move a VM off the EC3 stack. The data is stored in a proprietary format so once your in, you're in. Game changer? I need to see some evidence first on how well it performs and integrates.

It's a database, so you can always get your data out again.

It's a non-standard (NoSQL) database. Even SQL databases, despite years of standardization and efforts at poaching each other's customers, still have rough edges that make moving between different SQL database products non-trivial. Just because you can get your data out doesn't mean you're not locked in to all of SimpleDB/DynamoDB's quirks, of which there will be a lot more because it's not following a standard approach. Your code will have to go through contortions to work around / adapt to the SimpleDB limitations; effort which might well be wasted or counter-productive on a different system. That's the lock-in with AWS in general: API lock-in, not data format lock-in.

Re: Amazon DynamoDB – a Fast and Scalable NoSQL Database Service from AWS

#49
Trying to read thru all the hype, this looks like Riak hosted on machines with SSDs, with less features, and a nice billing system in front of it.

Of course for people who want a hosted solution, the fact that it is hosted, is what gives it a lot of value. There haven't been a lot of hosted NoSQL databases, at least on this scale and availability, out there.

But technologically, what's new here? Is there anything here that is really innovative? (not a sarcastic question)

Re: Amazon DynamoDB – a Fast and Scalable NoSQL Database Service from AWS

#50
post #27
post #16

What's the concern for lock-in here - how difficult with DynamoDB be to migrate away from? Amazon seems to be increasingly catching the App Engine Syndrome, though to be fair, it's been mostly network traffic-style functionality in the past.

Lock-in? You'll need to get all your data out and transform it into whatever alternative you pick. I'd say as far as AWS lock-in, this is on the low side of things.

The lock-in comes not from the data format, but rather from the quirks of the particular system du jour: API lock-in.
Post reply on HN