Live data from Hacker News

Google pub/sub released an ordering feature

cloud.google.com

11–20 of 114 posts

Re: Google pub/sub released an ordering feature

#11
post #3
post #2

Whoa! This is a game changer! I was looking into both Kafka and Google Pub/Sub for a event-oriented system my team was designing. Google Pub/Sub looked very promising, but no guarantee of ordering was a deal breaker for us. I’ll consider this more strongly for the next system we build.

What did you pick? I'm interested in non-G solutions.

Probably Kafka according to his comment.

Re: Google pub/sub released an ordering feature

#12
post #6

"Receiving messages in order might increase latency." It would be good to know what sort of overhead we are looking at here; very interested in this feature

And do messages without an ordering key incur the same overhead?

In the unordered case, there should be no noticeable performance degradation. This was something that we looked into extensively from both the server side as well as with our client libraries.

Disclaimer: I work on Pub/Sub.

Re: Google pub/sub released an ordering feature

#13
post #4
post #2

Whoa! This is a game changer! I was looking into both Kafka and Google Pub/Sub for a event-oriented system my team was designing. Google Pub/Sub looked very promising, but no guarantee of ordering was a deal breaker for us. I’ll consider this more strongly for the next system we build.

We used Pub/Sub very extensively (50B messages a day) but moved to Pulsar [0]. It performs equally well and has some nice features. And also no vendor lock-in. [0] https://kesque.com/billions-of-events-a-day-without-breaking...

Given cloud vendors low respect for their customers, the proper stance is to own your own infrastructure.

Re: Google pub/sub released an ordering feature

#15
post #13
post #4

Earlier quoted context omitted.

We used Pub/Sub very extensively (50B messages a day) but moved to Pulsar [0]. It performs equally well and has some nice features. And also no vendor lock-in. [0] https://kesque.com/billions-of-events-a-day-without-breaking...

Given cloud vendors low respect for their customers, the proper stance is to own your own infrastructure.

The company I work for had the same stance 5 years ago. We regretted it a hundred times and now we stand the gaff. Nothing better than maintaining an EC2 based Cassandra cluster instead of simple using DynamoDB, huh...

Re: Google pub/sub released an ordering feature

#16
post #2

Whoa! This is a game changer! I was looking into both Kafka and Google Pub/Sub for a event-oriented system my team was designing. Google Pub/Sub looked very promising, but no guarantee of ordering was a deal breaker for us. I’ll consider this more strongly for the next system we build.

What's a use case where strict ordering is critically important?

Re: Google pub/sub released an ordering feature

#18
post #2

Whoa! This is a game changer! I was looking into both Kafka and Google Pub/Sub for a event-oriented system my team was designing. Google Pub/Sub looked very promising, but no guarantee of ordering was a deal breaker for us. I’ll consider this more strongly for the next system we build.

What's a use case where strict ordering is critically important?

Consider processing two events without guaranteed ordering:

- Create A

- Delete A

In one ordering, A is created and then deleted as expected, in the other, the delete fails but then A is created and remains.

Re: Google pub/sub released an ordering feature

#20
post #2

Whoa! This is a game changer! I was looking into both Kafka and Google Pub/Sub for a event-oriented system my team was designing. Google Pub/Sub looked very promising, but no guarantee of ordering was a deal breaker for us. I’ll consider this more strongly for the next system we build.

What's a use case where strict ordering is critically important?

I see it a lot when integrating legacy healthcare systems that effectively operate on state-transition queues with an assumption of in-order processing.
Post reply on HN