Live data from Hacker News

Revisiting 1M Writes per second

techblog.netflix.com

11–20 of 40 posts

Re: Revisiting 1M Writes per second

#11
post #8

Earlier quoted context omitted.

It's from here: https://www.google.com/search?q=motorcycle+sidecar&source=ln...

I was hoping for a more precise software concept. Maybe it is loosey goosey.

The definition I use is a piece of software that runs independently to encapsulate infrastructure libraries. In other words it gives you a way to access the libraries without having to import them into your code.

Re: Revisiting 1M Writes per second

#12
post #4

I love using Cassandra; it's been a dream for analytics. Thank you Netflix et al. for not only moving the project forward, but providing research and commentary like this and others available at http://wiki.apache.org/cassandra/ArticlesAndPresentations

Can you talk a little about how you're using it for analytics and why you like it over other similar choices?

Re: Revisiting 1M Writes per second

#13
post #4

I love using Cassandra; it's been a dream for analytics. Thank you Netflix et al. for not only moving the project forward, but providing research and commentary like this and others available at http://wiki.apache.org/cassandra/ArticlesAndPresentations

Can you talk a little about how you're using it for analytics and why you like it over other similar choices?

Re: Revisiting 1M Writes per second

#14
How many companies can possibly afford the cost and management pain of running a 285 node database? Few would have 285 servers of any type? So if this is what it takes to get 1M writes on Cassandra that is some poor ROI. 10K writes/sec is not impressive.

Re: Revisiting 1M Writes per second

#15

How many companies can possibly afford the cost and management pain of running a 285 node database? Few would have 285 servers of any type? So if this is what it takes to get 1M writes on Cassandra that is some poor ROI. 10K writes/sec is not impressive.

How would you build out at a metrics cluster that needs 1M writes/sec?

285 nodes that are easily automated to create/destroy/monitor doesn't seem like a management pain to me, personally. Just depends if you have the write internal tools built.

Re: Revisiting 1M Writes per second

#16

How many companies can possibly afford the cost and management pain of running a 285 node database? Few would have 285 servers of any type? So if this is what it takes to get 1M writes on Cassandra that is some poor ROI. 10K writes/sec is not impressive.

How would you build out at a metrics cluster that needs 1M writes/sec? 285 nodes that are easily automated to create/destroy/monitor doesn't seem like a management pain to me, personally. Just depends if you have the write internal tools built.

Ok, so you're super-admin. And about the ROI aspect? What's the cost for achieving the 1M write/sec metric in that mammoth cluster?

Re: Revisiting 1M Writes per second

#17
post #5
post #2

This is running Cassandra 1.2.x which is over 18 months old. Here's some performance notes on the latest (2.1rc4): http://www.datastax.com/dev/blog/cassandra-2-1-now-over-50-f...

Will 2.1 actually be usable? It seems like 2.0 has missed that mark in every single release.

Are you saying 2.0 isn't usable ?

Because there are many companies (including ours) who would strongly disagree with you about that.

Re: Revisiting 1M Writes per second

#18

Earlier quoted context omitted.

How would you build out at a metrics cluster that needs 1M writes/sec? 285 nodes that are easily automated to create/destroy/monitor doesn't seem like a management pain to me, personally. Just depends if you have the write internal tools built.

Ok, so you're super-admin. And about the ROI aspect? What's the cost for achieving the 1M write/sec metric in that mammoth cluster?

I asked you how you would architect something that needs 1M writes/sec if you weren't using Cassandra. Ignore the fact that netflix is making this into a single cluster.

I'm not saying I'd do it by myself. I'm saying with the write tools its doable and not unreasonable.

Re: Revisiting 1M Writes per second

#19

How many companies can possibly afford the cost and management pain of running a 285 node database? Few would have 285 servers of any type? So if this is what it takes to get 1M writes on Cassandra that is some poor ROI. 10K writes/sec is not impressive.

Well, it's not unreasonable (the maintenance part) with Cassandra.

Re: Revisiting 1M Writes per second

#20

How many companies can possibly afford the cost and management pain of running a 285 node database? Few would have 285 servers of any type? So if this is what it takes to get 1M writes on Cassandra that is some poor ROI. 10K writes/sec is not impressive.

I don't understand your point.

The type of companies who could afford this are the types of companies who need 1M writes/second. Which are few and far between. And yes 10K is not that impressive but 1M is. And with Cassandra you could continue to improve that number just be rolling out more nodes.

Post reply on HN