Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

PgDog is funded and coming to a database near you

pgdog.dev

Post reply on HN
Print view View original

211–220 of 275 posts

Re: PgDog is funded and coming to a database near you

#211

Post by bofaGuy »

r7n wrote: post #133
levkk wrote: post #102

Earlier quoted context omitted.

Good thing we support HA as well: https://docs.pgdog.dev/features/load-balancer/ Load balancer with health checks and failover, works out of the box. :) Battle-tested at this point too, so could be worth a look.

I've extensively used Dynamo (internally at Amazon and externally) and even founded a DB startup with it at it's core. Boiling down scalability of Postgres vs Dynamo as it's written in blog is a bit terse. Dynamo scales writes horizontally with the keyspace, forever. Postgres simply can't, and no number of layers between the machines and the developer changes that. Sharding, pooling, Citus are all layered on top of a…

Dynamo DB isn’t even good at being a KV store. Almost every time we have to also back it with S3 because of size limitations.

Re: PgDog is funded and coming to a database near you

#213

Post by [deleted] »

aeyes wrote: post #169
FinnKuhn wrote: post #144

Earlier quoted context omitted.

Instacard have released a public dataset[1] on their orders, so it should be even easier to verify this claim. From what I could find in some analysis[2] of this dataset around 100k orders per day and not per minute seems accurate. I assume they are referring to how many database requests they have due to customers orders or a similar metric and just worded it poorly. [1] https://www.kaggle.com/datasets/psparks/insta…

This data set was released years before the Covid hypergrowth phase which they are referring to.

[deleted]

Re: PgDog is funded and coming to a database near you

#214

Post by evanelias »

aynyc wrote: post #72
jjice wrote: post #64

Earlier quoted context omitted.

Do other RDBMSs have this? I genuinely have no clue. I've been fortunate enough to be able to get away with one primary and multiple secondaries at my largest usage of Postgres. Multi-master is the kind of thing I am fully out of my depth on, so I'm curious if there's a well defined path for implementation here or what.

MySQL has Galera cluster for that.

More accurately, MariaDB has Galera for that. MySQL Galera is EOL in a few months [1], which is understandable given the change in ownership.

[1] https://mariadb.com/resources/blog/upgrade-now-announcing-my...

Re: PgDog is funded and coming to a database near you

#215

Post by evanelias »

jeltz wrote: post #128
boxed wrote: post #70

Earlier quoted context omitted.

They don't change the on-disk structure all the time though...

Mostly because MySQL development is slower.

Even when MySQL development velocity was more rapid, they maintained binary table format compatibility across major version upgrades the vast majority of the time. Literally the only exception I can think of, which necessitated a table rebuild, was the fractional timestamp storage change when going from MySQL 5.5 (2010) to 5.6 (2013).

Re: PgDog is funded and coming to a database near you

#216

Post by gaucheph »

true_religion wrote: post #131
tomtomtom777 wrote: post #125

Earlier quoted context omitted.

100k(s) orders per minute is several orders of magnitude more than realistic. Amazon does 20k orders per minute. Instacart doesn't need "100,000s of grocery delivery orders per minute". There must be some 0s added for the sake of the story.

According their 2026 Q1 filing they do about 90 million orders per quarter which is about 12 orders per second, 720 orders per minute. It might make 100k row level changes per minute, but that’s a different metric. https://www.sec.gov/Archives/edgar/data/1579091/000157909126...

i think this assumes that those orders are distributed evenly over time

Re: PgDog is funded and coming to a database near you

#217

Post by Ozzie_osman »

dujuku wrote: post #159
Ozzie_osman wrote: post #31

We sharded over 20 TB that we know about. This is probably a typo, right? 20TB isn't that big. I would imagine they've sharded a lot more than that

If you think 20TB "isn't that big" I want to know what size of DBs you're working with 0_0

I mean yes, for a single DB it's large, but if you're thinking about sharding you're probably in the tens of TBs, and if you're a company offering sharding you've prob sharded larger workloads.

Re: PgDog is funded and coming to a database near you

#218

Post by znpy »

nikolatt wrote: post #135
doctorpangloss wrote: post #121

Earlier quoted context omitted.

from their docs: > PgDog does not detect primary failure and will not call pg_promote(). It is expected that the databases are managed externally by another tool, like Patroni or AWS RDS, which handle replica promotion.

Why the snark comment? The PgDog project has been around for a while, it's not vibe coded.

Not gp but I didn’t perceive any snark in the comment you are replying to

Re: PgDog is funded and coming to a database near you

#219

Post by vira28 »

drchaim wrote: post #35

Good stuff, although I’m not quite sure about the fast OLAP use case. If you’re already sharding by tenant for other reasons, OK… But I see CDC to a true OLAP system as more scalable. PostgreSQL still needs real columnar tables in the core, hopefully one day

Tomas Vondra, a major Postgres contributor recently revived a thread on using Bloom filters - https://www.postgresql.org/message-id/flat/5cd8c20c-14b5-4b0...

So there is more core work happening on support OLAP but I do think it will take some time.

In the meantime, I think we have all the pieces (storage, query engine, table format) to set up a true OLAP. For instance, I created https://github.com/viggy28/streambed to pressure test this idea.

Re: PgDog is funded and coming to a database near you

#220

Post by UqWBcuFx6NV4r »

willio58 wrote: post #175
true_religion wrote: post #131

Earlier quoted context omitted.

According their 2026 Q1 filing they do about 90 million orders per quarter which is about 12 orders per second, 720 orders per minute. It might make 100k row level changes per minute, but that’s a different metric. https://www.sec.gov/Archives/edgar/data/1579091/000157909126...

And just like that you’ve done more due diligence than the VCs who just threw money at this.

Nope. Completely flawed logic that assumes equal distribution. Dunning Kruger
Post reply on HN