Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

DynamoDB - Parallel Scans, 4x Cheaper Reads, Other Good News

aws.typepad.com

Post reply on HN
Print view View original

1–8 of 8 posts

Re: DynamoDB - Parallel Scans, 4x Cheaper Reads, Other Good News

#3

Post by rdegges »

pvnick wrote: post #2

We've been considering deploying a few things on dynamo within the near future. Anybody with some experience have any recommendations or words of caution?

I've been using DynamoDB in production to power a large API company which handles thousands of requests per second -- we absolutely love it.

Our stack is on top of EC2, and the DynamoDB read latency is extremely low (1ms -> 10ms per read) -- using it as a data store means you don't even need a caching layer (memcached, etc.) since it's equally as fast, and all data is persistent (and you have no room limits).

I'd highly recommend it to anyone.

Also: if you're using Python, the dynamodb-mapper library is a great (stable) tool for working with DynamoDB.

Re: DynamoDB - Parallel Scans, 4x Cheaper Reads, Other Good News

#4

Post by RyanZAG »

pvnick wrote: post #2

We've been considering deploying a few things on dynamo within the near future. Anybody with some experience have any recommendations or words of caution?

Make sure you can afford it - DynamoDB can get very expensive fairly quickly as data size grows. Admittedly I last used it over a year ago and for a small company - but eventually we had to pull the plug because of the high costs.

I'd recommend estimating how much you think it will cost you, and then 10X that value. If that value is going to be hard to cover, stick with something else. If you're working for a Fortune 500 however, Dynamo is very nice.

Re: DynamoDB - Parallel Scans, 4x Cheaper Reads, Other Good News

#5

Post by jamroom »

rdegges wrote: post #3
pvnick wrote: post #2

We've been considering deploying a few things on dynamo within the near future. Anybody with some experience have any recommendations or words of caution?

I've been using DynamoDB in production to power a large API company which handles thousands of requests per second -- we absolutely love it. Our stack is on top of EC2, and the DynamoDB read latency is extremely low (1ms -> 10ms per read) -- using it as a data store means you don't even need a caching layer (memcached, etc.) since it's equally as fast, and all data is persistent (and you have no room limits). I'd hig…

My experience with DynamoDB has been the same - very fast access. However I'd recommend checking out ElastiCache - stick that in front of DynamoDB and cache all you can - accessing ElastiCache is much cheaper than accessing DynamoDB.

Re: DynamoDB - Parallel Scans, 4x Cheaper Reads, Other Good News

#6

Post by rkalla »

pvnick wrote: post #2

We've been considering deploying a few things on dynamo within the near future. Anybody with some experience have any recommendations or words of caution?

Understand your data hotspots -- just because it is in Dynamo and you have moved the slider all the way over to "20,000 IOPS" doesn't mean anything if DDB has partitioned all your data into a single shard behind the scenes -- you'll peak at 3,000 IOPS (for example).

Unfortunately you _still_ need to be aware of how you plan on querying your data to maximize the performance.

This is one of the most common questions/comments I see in the forums.

More info: http://docs.aws.amazon.com/amazondynamodb/latest/developergu...

Also be aware that leveraging the Local Secondary Indexes _does_ enforce a 10GB limit on items with the same hashkey, see the last section here: http://docs.aws.amazon.com/amazondynamodb/latest/developergu...

Re: DynamoDB - Parallel Scans, 4x Cheaper Reads, Other Good News

#8

Post by KaoruAoiShiho »

RyanZAG wrote: post #4
pvnick wrote: post #2

We've been considering deploying a few things on dynamo within the near future. Anybody with some experience have any recommendations or words of caution?

Make sure you can afford it - DynamoDB can get very expensive fairly quickly as data size grows. Admittedly I last used it over a year ago and for a small company - but eventually we had to pull the plug because of the high costs. I'd recommend estimating how much you think it will cost you, and then 10X that value. If that value is going to be hard to cover, stick with something else. If you're working for a Fortune…

What is expensive about Dynamo exactly? Read, storage? Something else?
Post reply on HN