Live data from Hacker News

Rules for Data Modeling with DynamoDB

trek10.com

81–84 of 84 posts

Re: Rules for Data Modeling with DynamoDB

#81

Earlier quoted context omitted.

Are there any basic examples you can give around maintaining that integrity? I'm liking DynamoDB for tasks that fit nicely within a single domain, have relatively pain-free access patterns, etc. And I've found good fits, but there are some places where the eventual consistency model makes me nervous. I'm specifically thinking about updating multiple different DynamoDB keys that might need to be aggregated for a data…

> Are there any basic examples you can give around maintaining that integrity? For those types of use cases, the OP’s advice would actually require implementing a fully bespoke concurrency control system in your business logic layer. Without trying to disparage the OP, this is for all intents and purposes, impossible (aside from also being very, very impractical). There’s some things you can do to create additional a…

Yeah, the limited transaction support is a killer for many use cases.

Thankfully, it’s not actually all that hard to implement your own “dynamo layer” on top of an SQL database and get most of the scaling benefits without giving up real transactions.

Re: Rules for Data Modeling with DynamoDB

#82
post #66
post #57

Earlier quoted context omitted.

I'm reminded of being 18, my first year of college, and I had this lovely database professor who was good with crowds. He'd get us all to memorize and repeat, as a group certain phrases. "Why do we normalize?" 150 students, in unison: "To make better relations" "And why do we DE-normalize?" 150 students, in unison: "Performance" "And what is a database?" 150 students, in unison: "A self-describing set of integrated r…

Self-describing? Maybe to someone who could make sense of the DDL and read the language the label col names are written in. And understand all the implicit units, rules around nulls/empties, and presence of magic strings (SSN, SKU) and special numbers (-1) and on and on. For that you need something like RDF and a proper data model.

If you use Oracle, PostgreSQL or MySQL (those are the ones I'm familliar) you can always query the data dictionary and see how your tables relate. For me that is self-describing.

Re: Rules for Data Modeling with DynamoDB

#83
post #66
post #57

Earlier quoted context omitted.

I'm reminded of being 18, my first year of college, and I had this lovely database professor who was good with crowds. He'd get us all to memorize and repeat, as a group certain phrases. "Why do we normalize?" 150 students, in unison: "To make better relations" "And why do we DE-normalize?" 150 students, in unison: "Performance" "And what is a database?" 150 students, in unison: "A self-describing set of integrated r…

Self-describing? Maybe to someone who could make sense of the DDL and read the language the label col names are written in. And understand all the implicit units, rules around nulls/empties, and presence of magic strings (SSN, SKU) and special numbers (-1) and on and on. For that you need something like RDF and a proper data model.

Aren't you conflating the lexicon of data management with specific implementations of a relational database management system (RDBMS)?

Sorry, but your response sounds snarky and reminds me of all the ego hurdles I had to overcome when leaving/loving databases and set theory. Please remember that your comment could be someone's first introduction or step early step in learning.

Re: Rules for Data Modeling with DynamoDB

#84

I love postgresql. Did business with a startup, signed up, started getting service, they play an intermediary biller / payor role. Because of an issue in company name used in signup their billing system fell over and didn't setup billing. But what was crazy is a quickly realized this shop was a noSQL shop. NOTHING connected to anything - so since they hadn't built any reports to cross check any of this they literally…

Operational data stores are not reporting data stores. A healthy system would fire change events to which a reporting system subscribes, placing the data where it belongs in the reporting data model.

Except what happens when change events are dropped.

in SQL, normalized, ref integrity on - you simply never get out of sync.

Post reply on HN