Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Databases in 2021: A Year in Review

ottertune.com

Post reply on HN
Print view View original

51–60 of 136 posts

Re: Databases in 2021: A Year in Review

#51

Post by manigandham »

newlisp wrote: post #31
why-el wrote: post #4

Postgres's dominance is well deserved, of course. My only concerns with it, both are actively worked on, are bloat management (significant for update heavy workloads and programmers used to the MySQL model of rollback segments) and the scaling of concurrency (going over 500 connections). Bloat was taken over by Cybertec[1] after stalling for a bit and is funded (yay), while concurrency was also enhanced out of Micros…

Another concern, no temporal tables, don't businesses demand this feature?

I've never seen a business actually use them, large or small. Any auditing requirements are usually fed from other sources, like Kafka event streams, files on S3, or a OLAP data warehouse.

Re: Databases in 2021: A Year in Review

#54

Post by throw_me_up »

throwDec21 wrote: post #40
carlineng wrote: post #24

Earlier quoted context omitted.

Cloud SQL data warehouses like Snowflake and BigQuery.

I just wish AWS had something as good as BigQuery.

There are companies that use BigQuery for analytics but their infra is in AWS. BigQuery has support for external tables to S3 now. The BigQuery transfer service can also move data from AWS pretty easily. I agree though, BigQuery is astonishingly good and makes both Snowflake and Redshift look like dinosaurs imo.

Re: Databases in 2021: A Year in Review

#55

Post by hu3 »

leetrout wrote: post #35
hu3 wrote: post #6

I expected more mentions of Vitess, which honestly looks like some kind of alien black magic from what I saw while consulting for a client this year. But I guess not much else happened to it other than PlanetScale.

Which part most impressed you and which part seems like magic? Their devs / contributors are active on here...

edit: not sure why the downvotes (-3 so far) since I just stated my experience on the project. There must be something blatantly wrong in what I wrote and I would appreciate criticism.

    --------
An architect demoed the failure of a shard and the automatic promotion of its backup shard to main, in production. They actually test their failure models.

As I see it, sharding is not very hard. HA is not very hard given a reasonable SLA. But sharding with HA on a large setup that actually works is pretty hard.

Another thing that stuck in my mind was their high throughput-per-provisioned-hardware ratio. With not much hardware they were pulling 80k queries per second with room to spare.

Although I have to say, that's not much compared to GitHub which pulls 1.2 million queries/sec on Vitess [0].

[0] https://github.blog/2021-09-27-partitioning-githubs-relation...

Re: Databases in 2021: A Year in Review

#56

Post by slekker »

leetrout wrote: post #36

Excited to see Dgraph on the top 10 mentions and climbing above neo4j

We are experimenting with Neo4j and found that the Cypher QL albeit foreign looking in the beginning feels quite natural to read when you think about graphs. How’s your experience with Dgraph been, any thoughts? I havent really heard about it before reading this post hence the curiosity!

Re: Databases in 2021: A Year in Review

#57

Post by srcreigh »

why-el wrote: post #4

Postgres's dominance is well deserved, of course. My only concerns with it, both are actively worked on, are bloat management (significant for update heavy workloads and programmers used to the MySQL model of rollback segments) and the scaling of concurrency (going over 500 connections). Bloat was taken over by Cybertec[1] after stalling for a bit and is funded (yay), while concurrency was also enhanced out of Micros…

Clustered indexes?

Re: Databases in 2021: A Year in Review

#58

Post by srcreigh »

Sytten wrote: post #11
threeseed wrote: post #7

So a company that sells PostgreSQL services thinks PostgreSQL is dominating. Brilliant. The reality is that nothing is dominating. In 2021 there were more databases than ever each addressing a different use case. Companies don't have just one EDW they will have dozens even hundreds of siloed data stores. Startups will start with one for everything, then split out auth, user analytics, telemetry etc There is no eviden…

Couple of points: 1. Ottertune doesn't sell PostgreSQL services, they sell a database optimization service that happens to support PostgreSQL (and other databases like MySQL) 2. PostgreSQL is definitely gaining market shares and fast, see the db-engine graph [1], you can compare it to the oracle trend if you are not convinced [2] [1] https://db-engines.com/en/ranking_trend/system/PostgreSQL [2] https://db-engines.com…

Is this ranking by # of orgs using Postgres, or relative total company value using Postgres, or some even more ambiguous effectiveness metric?

Answer: https://db-engines.com/en/ranking_definition

Re: Databases in 2021: A Year in Review

#59

Post by tayo42 »

Hamuko wrote: post #52
tayo42 wrote: post #37

Wow I kind of feel like I'm reading about Javascript frameworks. I don't recognize any of the dbs or companies/projects. Didn't realize the db world was so busy

Not even PostgreSQL?

Ok I thought a couple of them were obvious ones that are commonly known.(postgres, redis, mysql, oracle, mongo, cassandra)
Post reply on HN