Databases in 2021: A Year in Review
ottertune.com
Databases in 2021: A Year in Review
1–10 of 136 posts
Re: Databases in 2021: A Year in Review
#2Databases are the best all around scratch every cs geek itch domain there is, with possible exception of operating systems.
The critical importance of extensibility as a primary concern of successful DB products needs to be highlighted. Realities of the domain dictate that product X matures a few years after inception, at which point the application patterns may have shifted. (Remember map-reduce?) If you pay attention, for example, you'll note that the du jour darlings are scrambling to claim fitness for ML (a subset of big-data), and the new comers are claiming to be "designed for ML".
Smart VC money should be on extensible players ..
Re: Databases in 2021: A Year in Review
#3The world moved away from Hadoop and MapReduce… onto what?
Re: Databases in 2021: A Year in Review
#4Postgres's dominance is well deserved, of course. My only concerns with it, both are actively worked on, are bloat management (significant for update heavy workloads and programmers used to the MySQL model of rollback segments) and the scaling of concurrency (going over 500 connections). Bloat was taken over by Cybertec[1] after stalling for a bit and is funded (yay), while concurrency was also enhanced out of Microsoft [2]. All in all, an excellent future for our beloved Postgres.
[1] https://github.com/cybertec-postgresql/zheap [2] https://techcommunity.microsoft.com/t5/azure-database-for-po...
Re: Databases in 2021: A Year in Review
#5I'm really excited by all the database love in the last few years. I moved to PG from MySQL in 2014 and don't regret it since.
Timescaledb looks very exciting, as it's "just" a PG extension, but their compression work looks great. [0]
I'm also really loving clickhouse, but haven't deployed that to production yet (haven't had the need to yet, almost did for an apache arrow reading thing, but didn't end up using arrow). They do some amazing things there, and the work they do is crazy impressive and fast. Reading their changelog they power through things.
[0] https://docs.timescale.com/timescaledb/latest/how-to-guides/...
Re: Databases in 2021: A Year in Review
#6I expected more mentions of Vitess, which honestly looks like some kind of alien black magic from what I saw while consulting for a client this year.
But I guess not much else happened to it other than PlanetScale.
Re: Databases in 2021: A Year in Review
#7So a company that sells PostgreSQL services thinks PostgreSQL is dominating. Brilliant.
The reality is that nothing is dominating. In 2021 there were more databases than ever each addressing a different use case. Companies don't have just one EDW they will have dozens even hundreds of siloed data stores. Startups will start with one for everything, then split out auth, user analytics, telemetry etc
There is no evidence of any consolidation in the market. And definitely not some mass trend towards PostgreSQL.
Re: Databases in 2021: A Year in Review
#8The world moved away from Hadoop and MapReduce… onto what?
Throw a dart at the Apache project list :-)
My god do we need an atlas of database related Apache projects.
It's almost as bad as java web frameworks about ten years ago.
Everyone can do everything and it's hard to know what is better for what.
Re: Databases in 2021: A Year in Review
#9My DB discovery and the game changer of 2021 was EdgeDB.
Re: Databases in 2021: A Year in Review
#10Postgres's dominance is well deserved, of course. My only concerns with it, both are actively worked on, are bloat management (significant for update heavy workloads and programmers used to the MySQL model of rollback segments) and the scaling of concurrency (going over 500 connections). Bloat was taken over by Cybertec[1] after stalling for a bit and is funded (yay), while concurrency was also enhanced out of Micros…
Is zheap definitely still an active project? Last commit seems to be Oct 2020