41–50 of 71 posts
Quasi-related: what are some good hosted alternatives to AWS dynamodb / GCloud Firestore that are a) fast b) affordable at scale c) have a good local dev experience? A hosted disk based redis protocol compliant capable of sub TB size datasets would be a dream for me.
Earlier quoted context omitted.
Typically people use raft for leader election which in turn can coordinate writes. I don't think the writes are being fsync'd in the raft logs here. At least I wouldn't expect that behavior.
Each write should be fsync'd to the WAL, right?
Earlier quoted context omitted.
Each write should be fsync'd to the WAL, right?
Yes but those can happen at the convenience of the particular node, not necessarily as a globally chrckpointed fsync()
Waiting to report success until a majority have committed allows you to make guarantees with a straight face.. "it will probably be committed in the near future" is not the same thing.
See also rqlite, which seems like this, but sqlite instead of Redis. Super interesting. https://github.com/rqlite/rqlite
Earlier quoted context omitted.
We use consul a bit as some "light" service discovery and a KV store for a few things without much issue so far. What demons did you encounter with vault/consul?
We had some massive problems including complete cluster collapse requiring rebuilds from scratch, eternal leadership elections and occasionally nodes would just entirely stop responding to KV requests causing cascading failures outside. Vault is a massive damage multiplier for these issues plus some other nasty ones like buggy barely supported plugins.
Earlier quoted context omitted.
Look higher up the problem domain and solve it without requiring a consensus protocol.
Hmm, how do you have high availability consistent data without a consensus protocol? No matter where in the problem chain you move, you have to eventually solve that problem.
We did this for 30 years fine before someone invented this stack on deployments much larger then the average consul or vault deployment these days.
I had something running 15,000 dynamic rps on Apache about 15 years ago.
People are blinded from simplicity by complexity. Eventually complexity owns you. You can only own simplicity.
At the end of the day this is one way to solve a problem that doesn’t need to be solved that someone has convinced you is a problem.
Earlier quoted context omitted.
We had some massive problems including complete cluster collapse requiring rebuilds from scratch, eternal leadership elections and occasionally nodes would just entirely stop responding to KV requests causing cascading failures outside. Vault is a massive damage multiplier for these issues plus some other nasty ones like buggy barely supported plugins.
Wouldn't mind knowing what versions you were using/how long ago this was. We haven't seen anything like this in > 3 years. Possible a barely supported plugin caused issues?
It’s a good idea in principle but it’s not got a good ROI
Earlier quoted context omitted.
Hmm, how do you have high availability consistent data without a consensus protocol? No matter where in the problem chain you move, you have to eventually solve that problem.
Easy you push the configuration to every target. Then they are logically consistent. We did this for 30 years fine before someone invented this stack on deployments much larger then the average consul or vault deployment these days. I had something running 15,000 dynamic rps on Apache about 15 years ago. People are blinded from simplicity by complexity. Eventually complexity owns you. You can only own simplicity. At…
What does this mean? This doesn't mean anything?
Are you saying to push the DB to the client?
Earlier quoted context omitted.
Hmm, how do you have high availability consistent data without a consensus protocol? No matter where in the problem chain you move, you have to eventually solve that problem.
Easy you push the configuration to every target. Then they are logically consistent. We did this for 30 years fine before someone invented this stack on deployments much larger then the average consul or vault deployment these days. I had something running 15,000 dynamic rps on Apache about 15 years ago. People are blinded from simplicity by complexity. Eventually complexity owns you. You can only own simplicity. At…