Live data from Hacker News

River: A fast, robust job queue for Go and Postgres

brandur.org

111–112 of 112 posts

Re: River: A fast, robust job queue for Go and Postgres

#111
post #109

Earlier quoted context omitted.

The "problem" is that a database as a queue doesn't infinitely scale, but nothing infinitely scales. If you're starting to reach the limits of Postgres-as-a-queue then you've either done something very wrong or very right to get to that point. It's probably more correct to say that the engineering effort required to make a Postgres-as-a-queue scale horizontally is a lot more than the engineering effort required to ma…

I thought Kafka could relatively infinitely scale

I wouldn't categorise Kafka as a database.

Re: River: A fast, robust job queue for Go and Postgres

#112

Looks cool and thanks for sharing. Founder of windmill.dev, an open-source, extremely fast workflow engine to run jobs in ts,py,gosh whose most important piece, the queue, is also just rust + postgresql (and mostly the FOR UPDATE SKIP LOCKED). I'd be curious to compare performances once you guys are comfortable with that, we do them openly and everyday on: https://github.com/windmill-labs/windmill/tree/benchmarks I w…

[dead]
Post reply on HN