Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Databases in 2021: A Year in Review

ottertune.com

Post reply on HN
Print view View original

11–20 of 136 posts

Re: Databases in 2021: A Year in Review

#11

Post by Sytten »

threeseed wrote: post #7

So a company that sells PostgreSQL services thinks PostgreSQL is dominating. Brilliant. The reality is that nothing is dominating. In 2021 there were more databases than ever each addressing a different use case. Companies don't have just one EDW they will have dozens even hundreds of siloed data stores. Startups will start with one for everything, then split out auth, user analytics, telemetry etc There is no eviden…

Couple of points:

1. Ottertune doesn't sell PostgreSQL services, they sell a database optimization service that happens to support PostgreSQL (and other databases like MySQL)

2. PostgreSQL is definitely gaining market shares and fast, see the db-engine graph [1], you can compare it to the oracle trend if you are not convinced [2]

[1] https://db-engines.com/en/ranking_trend/system/PostgreSQL

[2] https://db-engines.com/en/ranking_trend/system/Oracle

Re: Databases in 2021: A Year in Review

#12

Post by dreyfan »

All you need is Postgres (OLTP) and if you have large datasets where Postgres falls behind for analytical work, then you reach for Clickhouse (OLAP) for those features (while Postgres remains your primary operational database and source of truth).

Re: Databases in 2021: A Year in Review

#14

Post by uvdn7 »

I agree with Andy that it’s just super fun to work on databases. You get to work on consensus, networking, compute, storage, etc. The workloads are always changing, you can try to optimize across the entire stack. Applications and workloads come and go, but databases will always be around.

Re: Databases in 2021: A Year in Review

#15

Post by phonon »

nicoburns wrote: post #10
why-el wrote: post #4

Postgres's dominance is well deserved, of course. My only concerns with it, both are actively worked on, are bloat management (significant for update heavy workloads and programmers used to the MySQL model of rollback segments) and the scaling of concurrency (going over 500 connections). Bloat was taken over by Cybertec[1] after stalling for a bit and is funded (yay), while concurrency was also enhanced out of Micros…

Is zheap definitely still an active project? Last commit seems to be Oct 2020

Looks like it's still being actively worked on.

https://www.cybertec-postgresql.com/en/zheap-undo-logs-disca...

https://github.com/cybertec-postgresql/postgres/tree/zheap_u...

Re: Databases in 2021: A Year in Review

#16

Post by FridgeSeal »

From the article:

> Rockset joined in, saying its performance is was better for real-time analytics than the other two.

So I went and read the linked Rockset comparison blog post, and while I get that it’s a marketing piece, it’s also so transparently desperate for any advantage over Druid and ClickHouse that their criteria is bizarre at best, and bordering on wildly incorrect at worst.

I’ve been burnt by commercial databases before, and I have a hard time justifying ever using one, especially considering the advent of open source databases that have feature and performance parity (if not outright superiority) and can be self-hosted on K8s, or managed-hosting can be easily purchased.

Re: Databases in 2021: A Year in Review

#17

Post by FridgeSeal »

AtlasBarfed wrote: post #8
closeparen wrote: post #3

The world moved away from Hadoop and MapReduce… onto what?

Throw a dart at the Apache project list :-) My god do we need an atlas of database related Apache projects. It's almost as bad as java web frameworks about ten years ago. Everyone can do everything and it's hard to know what is better for what.

Add to this “Apache Streaming projects”.

I get that projects can be donated to Apache from disparate sources, but my god it’s still a disaster.

Re: Databases in 2021: A Year in Review

#18

Post by mritchie712 »

FridgeSeal wrote: post #16

From the article: > Rockset joined in, saying its performance is was better for real-time analytics than the other two. So I went and read the linked Rockset comparison blog post, and while I get that it’s a marketing piece, it’s also so transparently desperate for any advantage over Druid and ClickHouse that their criteria is bizarre at best, and bordering on wildly incorrect at worst. I’ve been burnt by commercial…

Altinity is doing a good job of this with Clickhouse. They offer some decent open source guides for self hosting[0] and offer a hosted option. The hosted option is as self serve as I'd like (you have to get "approved").

0 - https://github.com/Altinity/clickhouse-operator and

Re: Databases in 2021: A Year in Review

#19

Post by mritchie712 »

dreyfan wrote: post #12

All you need is Postgres (OLTP) and if you have large datasets where Postgres falls behind for analytical work, then you reach for Clickhouse (OLAP) for those features (while Postgres remains your primary operational database and source of truth).

Agreed. I have a good bit of experience in SaaS and analytics and that's exactly what I landed on for building Luabase[0]. Postgres (specifically Supabase) for the app database, Clickhouse to run the analytics (which is the product).

0 - https://luabase.com/

Re: Databases in 2021: A Year in Review

#20

Post by FridgeSeal »

mritchie712 wrote: post #18
FridgeSeal wrote: post #16

From the article: > Rockset joined in, saying its performance is was better for real-time analytics than the other two. So I went and read the linked Rockset comparison blog post, and while I get that it’s a marketing piece, it’s also so transparently desperate for any advantage over Druid and ClickHouse that their criteria is bizarre at best, and bordering on wildly incorrect at worst. I’ve been burnt by commercial…

Altinity is doing a good job of this with Clickhouse. They offer some decent open source guides for self hosting[0] and offer a hosted option. The hosted option is as self serve as I'd like (you have to get "approved"). 0 - https://github.com/Altinity/clickhouse-operator and

Yeah I’ve been paying attention to the Altinity stuff for a while, they’ve got some good stuff.

I think we’ll get even more hosting options now that ClickHouse is it’s own backing company.

Post reply on HN