Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Amazon DynamoDB – a Fast and Scalable NoSQL Database Service from AWS

allthingsdistributed.com

Post reply on HN
Print view View original

81–90 of 135 posts

Re: Amazon DynamoDB – a Fast and Scalable NoSQL Database Service from AWS

#81

Post by viggity »

icey wrote: post #35
mark_l_watson wrote: post #31

A feature request (I see that Werner is reading this message thread): for development it woud be very nice to have the Java AWS SDK have a local emulation mode for SimpleDB and DynamoDB. This would allow development while flying or otherwise off the Internet. Similar functionality as AppEngine's local dev mode.

Since HN doesn't show vote totals I wanted to chime in and say this would be really useful to me as well.

HN doesn't show vote totals, but it does sort posts based on the number of votes (descending), so the more popular posts rise to the top, just like the front page.

Re: Amazon DynamoDB – a Fast and Scalable NoSQL Database Service from AWS

#82

Post by gfodor »

nosequel wrote: post #40
rojabuck wrote: post #9

Fast, Consistent, Secure & Replicated. Game changed.

Not really if you pay attention to the set of NoSQL DB's available already. They are just hosting their own now.

"They are just hosting their own now."

^^ There's your game changer.

Re: Amazon DynamoDB – a Fast and Scalable NoSQL Database Service from AWS

#83

Post by Yrlec »

peripitea wrote: post #73
Ataraxy wrote: post #59

This still seems a bit expensive to me for an application that would require thousands of writes per second? ie. 5k writes per second is ~$120/day. Using this for performance based analytics for example would seem out of the realm of reason for the moment.

Can you explain your use case a bit more? I'm having a hard time imagining something that does ~430M DB writes/day but can't easily afford to pay $120 for those writes.

Remember that the throughput is per item, not per query. For instance we have an indexed query that returns ~1500 rows each time. Just doing that query a couple of times per second would create that kind of throughput requirement.

Re: Amazon DynamoDB – a Fast and Scalable NoSQL Database Service from AWS

#84

Post by scotth »

viggity wrote: post #81
icey wrote: post #35

Earlier quoted context omitted.

Since HN doesn't show vote totals I wanted to chime in and say this would be really useful to me as well.

HN doesn't show vote totals, but it does sort posts based on the number of votes (descending), so the more popular posts rise to the top, just like the front page.

That isn't how the frontpage works, and if it did, we would rarely have news turnover.

Re: Amazon DynamoDB – a Fast and Scalable NoSQL Database Service from AWS

#85

Post by jondot »

nirvana wrote: post #49

Trying to read thru all the hype, this looks like Riak hosted on machines with SSDs, with less features, and a nice billing system in front of it. Of course for people who want a hosted solution, the fact that it is hosted, is what gives it a lot of value. There haven't been a lot of hosted NoSQL databases, at least on this scale and availability, out there. But technologically, what's new here? Is there anything her…

If anything, from my experience with Riak, Basho guys should be having an emergency meeting.

Not mentioned here - DynamoDB also has built in monitoring and management.

Re: Amazon DynamoDB – a Fast and Scalable NoSQL Database Service from AWS

#86

Post by lemming »

jsolson wrote: post #41
lemming wrote: post #38

This looks like a great service - there are some really interesting ideas here. The provisioned throughput is a great idea. It's interesting to see it runs on SSDs as well, I wonder if its storage is log based like LevelDB. The composite hashed indexes are really interesting as well - I guess they partition the index across nodes, and each node maintains a range of the sorted index. It'll be interesting to see how us…

> I read with interest Steve Yegge's mistakenly-leaked email about the oppressive conditions for engineers at Amazon. It's hard to reconcile with the sort of innovation they consistently show. My take on Steve's rant (as an engineer at Amazon) is that a lot of the issues he pointed out are legitimate, but at an entirely different scale than he was pitching them at. Day to day I work on a product with another couple d…

Interesting, thanks for the perspective - he definitely made it sound like a sweatshop, and that's not the sort of environment normally associated with this kind of innovation.

Re: Amazon DynamoDB – a Fast and Scalable NoSQL Database Service from AWS

#87

Post by nosequel »

PanMan wrote: post #53
nirvana wrote: post #49

Trying to read thru all the hype, this looks like Riak hosted on machines with SSDs, with less features, and a nice billing system in front of it. Of course for people who want a hosted solution, the fact that it is hosted, is what gives it a lot of value. There haven't been a lot of hosted NoSQL databases, at least on this scale and availability, out there. But technologically, what's new here? Is there anything her…

For one, it responds quicker than Riak: Riak has (cold) response times of about 300ms, while this service claims single-digit ms response times. Also setting up Riak is not exactly trivial, and using this service outsources that hassle.

You can use Riak Smartmachines on Joyent's cloud that would get similar performance for an order of magnitude cheaper than what amazon is charging. If you are seeing 300ms response times, you are not using SSD's and you are not using a similar number of nodes that Amazon is charging you for.

I'm not hating on Amazon, it is a good move for them and they are doing some things that Riak cannot do, but cost and response is not one of them.

Re: Amazon DynamoDB – a Fast and Scalable NoSQL Database Service from AWS

#88

Post by [deleted] »

PanMan wrote: post #53
nirvana wrote: post #49

Trying to read thru all the hype, this looks like Riak hosted on machines with SSDs, with less features, and a nice billing system in front of it. Of course for people who want a hosted solution, the fact that it is hosted, is what gives it a lot of value. There haven't been a lot of hosted NoSQL databases, at least on this scale and availability, out there. But technologically, what's new here? Is there anything her…

For one, it responds quicker than Riak: Riak has (cold) response times of about 300ms, while this service claims single-digit ms response times. Also setting up Riak is not exactly trivial, and using this service outsources that hassle.

[deleted]

Re: Amazon DynamoDB – a Fast and Scalable NoSQL Database Service from AWS

#90

Post by nirvana »

snewman wrote: post #62
nirvana wrote: post #49

Trying to read thru all the hype, this looks like Riak hosted on machines with SSDs, with less features, and a nice billing system in front of it. Of course for people who want a hosted solution, the fact that it is hosted, is what gives it a lot of value. There haven't been a lot of hosted NoSQL databases, at least on this scale and availability, out there. But technologically, what's new here? Is there anything her…

As you and others have pointed out, hosting + SSDs + synchronous replication across availability zones counts for a lot. If DynamoDB lives up to the hype, it could be a huge step forward in the world of "don't have to think about it" data storage. DynamoDB does have at least one significant feature not provided by Riak -- range scans. This makes many common access patterns much easier to implement efficiently. Still,…

>DynamoDB does have at least one significant feature not provided by Riak -- range scans.

Riak has the ability to select keys for processing via various queries, including range of the key.

Riak also has secondary indexes and full text search.

If there's something significant about the DynamoDB method of doing range scans I'm interested in hearing it. My purpose here isn't so much to bash DynamoDB (in fact, I don't want to do that at all) but to try and spread a little more awareness of Riak.

Riak really came into its own in 1.0.

Post reply on HN