Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

PgDog is funded and coming to a database near you

pgdog.dev

Post reply on HN
Print view View original

141–150 of 275 posts

Re: PgDog is funded and coming to a database near you

#141

Post by nijave »

globular-toast wrote: post #101
eikenberry wrote: post #99

> The reason DBs like Mongo or Dynamo exist is because Postgres has a scaling problem. I've used Postgres at a few places and the #1 problem was always high availability, not scaling. One Postgres cluster could easily handle 100000 transactions per minute, but when a primary node went down it was a page and manually failing over to the spare then manually replacing the spare. The manual tooling was very finicky but a…

Have you looked into things like CloudnativePG? https://cloudnative-pg.io/

CNPG is quite nice and robust but I'd still be a bit reluctant to stack PG on k8s for really big clusters just because k8s ecosystem moves quite quickly and there's lots of patching/maintenance/churn which means more PG failovers so depends on how well your workload handles that (they're normally only a few seconds)

Re: PgDog is funded and coming to a database near you

#142

Post by nijave »

tomtomtom777 wrote: post #125
aurareturn wrote: post #116

Earlier quoted context omitted.

Is 100k order per minute a lot? Even a single Postgres instance should serve that fine?

100k(s) orders per minute is several orders of magnitude more than realistic. Amazon does 20k orders per minute. Instacart doesn't need "100,000s of grocery delivery orders per minute". There must be some 0s added for the sake of the story.

That doesn't necessarily mean _new_ orders per minute. Their app or website could poll for updates every 15 seconds

Could just be looking at the "orders" endpoint in their app which might also include incremental updates as shoppers get items from the store. It's a fairly ambiguous statement

Re: PgDog is funded and coming to a database near you

#144

Post by FinnKuhn »

true_religion wrote: post #131
tomtomtom777 wrote: post #125

Earlier quoted context omitted.

100k(s) orders per minute is several orders of magnitude more than realistic. Amazon does 20k orders per minute. Instacart doesn't need "100,000s of grocery delivery orders per minute". There must be some 0s added for the sake of the story.

According their 2026 Q1 filing they do about 90 million orders per quarter which is about 12 orders per second, 720 orders per minute. It might make 100k row level changes per minute, but that’s a different metric. https://www.sec.gov/Archives/edgar/data/1579091/000157909126...

Instacard have released a public dataset[1] on their orders, so it should be even easier to verify this claim. From what I could find in some analysis[2] of this dataset around 100k orders per day and not per minute seems accurate.

I assume they are referring to how many database requests they have due to customers orders or a similar metric and just worded it poorly.

[1] https://www.kaggle.com/datasets/psparks/instacart-market-bas... [2] https://rstudio-pubs-static.s3.amazonaws.com/284199_5c498037...

Re: PgDog is funded and coming to a database near you

#145

Post by jsw »

r7n wrote: post #140
jsw wrote: post #138

Earlier quoted context omitted.

Curious how the DB startup with Dynamo at its core went. We use it heavily. The primary tricky thing for us at the moment is aligning pricing with workload value.

We obsessed over optimizations and pushing the apis to the limits of how we could pack it. So much so, we re-wrote the DynamoSDK to squeeze out more optimizations so we could be the same cost even though we were a layer in front of dynamo. We used key encoding and other various technique as well as managed capacity (on demand vs reserved) to transparently optimize workloads for price. In our experience we saw dramati…

Interesting! We interact with the low-level APIs too vs the SDK, also: an IO scheduler for request batching and conn management, request hedging, full MVCC transactions, etc. We store raw bytes in DDB and manage schema/etc elsewhere. Curious if there is other low-hanging fruit, or not so low, you found that we haven't discovered yet.

Re: PgDog is funded and coming to a database near you

#146

Post by andriy_koval »

true_religion wrote: post #131
tomtomtom777 wrote: post #125

Earlier quoted context omitted.

100k(s) orders per minute is several orders of magnitude more than realistic. Amazon does 20k orders per minute. Instacart doesn't need "100,000s of grocery delivery orders per minute". There must be some 0s added for the sake of the story.

According their 2026 Q1 filing they do about 90 million orders per quarter which is about 12 orders per second, 720 orders per minute. It might make 100k row level changes per minute, but that’s a different metric. https://www.sec.gov/Archives/edgar/data/1579091/000157909126...

it could be peak orders per second

Re: PgDog is funded and coming to a database near you

#147

Post by doctorpangloss »

nikolatt wrote: post #135
doctorpangloss wrote: post #121

Earlier quoted context omitted.

from their docs: > PgDog does not detect primary failure and will not call pg_promote(). It is expected that the databases are managed externally by another tool, like Patroni or AWS RDS, which handle replica promotion.

Why the snark comment? The PgDog project has been around for a while, it's not vibe coded.

okay, it does appear that the LLM didn't write any of this. i guess the simple answer is that it is not HA.

Re: PgDog is funded and coming to a database near you

#148

Post by aurareturn »

dotancohen wrote: post #132
tomtomtom777 wrote: post #125

Earlier quoted context omitted.

100k(s) orders per minute is several orders of magnitude more than realistic. Amazon does 20k orders per minute. Instacart doesn't need "100,000s of grocery delivery orders per minute". There must be some 0s added for the sake of the story.

Amazon does 20k peak, or 20k average? Website visitor peaks could easily be two orders of magnitude higher traffic than average for a few minutes.

I worked at a company that had billions of views per year on a single big Postgres instance. Extremely read heavy with many queries needed for a page load. You can cache a lot of things.

Re: PgDog is funded and coming to a database near you

#149

Post by VirusNewbie »

eikenberry wrote: post #99

> The reason DBs like Mongo or Dynamo exist is because Postgres has a scaling problem. I've used Postgres at a few places and the #1 problem was always high availability, not scaling. One Postgres cluster could easily handle 100000 transactions per minute, but when a primary node went down it was a page and manually failing over to the spare then manually replacing the spare. The manual tooling was very finicky but a…

~1600 TPS is not 'high scale'.

Re: PgDog is funded and coming to a database near you

#150

Post by dotancohen »

aurareturn wrote: post #148
dotancohen wrote: post #132

Earlier quoted context omitted.

Amazon does 20k peak, or 20k average? Website visitor peaks could easily be two orders of magnitude higher traffic than average for a few minutes.

I worked at a company that had billions of views per year on a single big Postgres instance. Extremely read heavy with many queries needed for a page load. You can cache a lot of things.

Yes, but that's not a shopping cart, or a checkout workflow, nor a web store with heavy analytics.
Post reply on HN