Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Drasi: Microsoft's open source data processing platform for event-driven systems

github.com

Post reply on HN
Print view View original

81–87 of 87 posts

Re: Drasi: Microsoft's open source data processing platform for event-driven systems

#81

Post by robertpohl »

agentofreality wrote: post #78
emmanueloga_ wrote: post #69

They don't mention "CDC" (Change Data Capture) directly anywhere, but I think that's what Drasi is? (they call it "Data Change Processing platform"). "Debezium", an alternative CDC system, is mentioned in the documentation and sources [1]. I'm not sure if Drasi uses Debezium, or aims to be compatible with it. Maybe someone here can shine more light on the relationship between these two? -- 1: https://github.com/drasi…

Hi, I am the Drasi engineering manager, maybe I can clarify. Drasi is not intended to be another CDC alternative. It doesn't compete with Debezium, in fact we already have some integration with Debezium and hope to do more in the future. People often use CDC to replicate, consolidate, filter, and transform data. And sometimes they use it as a source of change events to build components/services that look for specific…

Put this in your website! I understand now :)

Re: Drasi: Microsoft's open source data processing platform for event-driven systems

#82

Post by CharlieDigital »

refset wrote: post #72
UltraSane wrote: post #21

Earlier quoted context omitted.

The neat thing about Neo4j is that the [r] isn't a join, it is an actual relationship stored on disk.

Like a many-to-many join table?

Like a many-to-many set of join tables because the `[r]` can represent any relationship between any two collections.

Re: Drasi: Microsoft's open source data processing platform for event-driven systems

#83

Post by agentofreality »

unixhero wrote: post #50

I would really enjoy using it. But as a novice data intensive application developer, why would I not query the table 30 seconds and look for changes with a Python program (or another regular programming language)?

Here is a new Drasi blog post that might help you understand why Drasi is preferable to writing code that periodically polls a database: https://opensource.microsoft.com/blog/2024/10/22/detect-and-...

Re: Drasi: Microsoft's open source data processing platform for event-driven systems

#84

Post by ryanwjwaite »

bob1029 wrote: post #36
stackskipton wrote: post #31

Earlier quoted context omitted.

Azure SRE here, it doesn't appear to have any Azure dependencies. CLI rebuild seems to be that "drasi init" assumes Azure Kubernetes Service built in StorageClasses for Kubernetes PVC for Redis and Mongo and thus fails when running against EKS. I assume same thing would be required on GKE. Yes, it should be more modular but MVP. As for other stuff, it's using Gremlin Query Language or Postgres which are both open. In…

> CLI rebuild seems to be that "drasi init" assumes Azure Kubernetes Service built in StorageClasses for Kubernetes PVC for Redis and Mongo and thus fails when running against EKS. I assume same thing would be required on GKE. Yes, it should be more modular but MVP. None of these words are in the Bible.

You're right, it should work better on AWS, GCP, and other clouds. We'll get to that in future builds of Drasi. We've submitted to CNCF and, just like with Radius and Dapr, we'll make sure it works well on more than just Azure.

Re: Drasi: Microsoft's open source data processing platform for event-driven systems

#85

Post by agentofreality »

_f9cu wrote: post #15

What does it process it from and what does it process it to? Is it programmable or you have a concrete concept theorised? What is it useful for? How it helps business in saving cost or increasing profit? Is it a hobby project?

This post may help answer some of your questions: https://opensource.microsoft.com/blog/2024/10/22/detect-and-...

And the project docs may help answer others: https://drasi.io/

Also, the Drasi team are most active over on our discord channel (https://aka.ms/drasidiscord) where we would be happy to answer questions and help you get started using Drasi.

Re: Drasi: Microsoft's open source data processing platform for event-driven systems

#86

Post by gtani »

agentofreality wrote: post #75
otterley wrote: post #22

Looks very Azure-centric. Both installation guides ( https://drasi.io/how-to-guides/install-sample-applications/b... and https://drasi.io/how-to-guides/install-sample-applications/c... ) require Azure to work. And then there's this: > Installing Drasi in an EKS cluster can be significantly more complex than a standard installation on other platforms. Instead of downloading a CLI binary using the provided installation…

I am the Drasi engineering lead and can assure you that any Azure-centricity is purely one of historical convenience and a lag in getting more of our non-Azure-centric doc, samples, and components published. The main current dependency is having a K8s cluster. You can run Drasi for dev/test on k3s( https://drasi.io/how-to-guides/installation/install-on-k3s/ ) or kind( https://drasi.io/how-to-guides/installation/insta…

is there any lineage between this project and ReactiveX family developed at endjin now?
Post reply on HN