Is this what can be done with Apache Kafka Connect (to get data from another source to a Kafka cluster), Kafka (including Kafka Streams)?
This image (https://github.com/drasi-project/community/raw/main/images/d...) is like Kafka Streams with a single topic.
This image (https://github.com/drasi-project/community/raw/main/images/c...) is like joining 2 streams in Kafka Streams.
Drasi: Microsoft's open source data processing platform for event-driven systems
41–50 of 87 posts
Re: Drasi: Microsoft's open source data processing platform for event-driven systems
#42I see more Cypher fans out here - check out https://cyphernet.es if you work with Kubernetes!
Re: Drasi: Microsoft's open source data processing platform for event-driven systems
#43I finished reading Kleppman's Designing Data-Intensive Applications last night and this looks like it's straight out of the last chapter that talk about the future. They don't use the term "dataflow" though.
https://www.oreilly.com/library/view/designing-data-intensiv...
Re: Drasi: Microsoft's open source data processing platform for event-driven systems
#44I finished reading Kleppman's Designing Data-Intensive Applications last night and this looks like it's straight out of the last chapter that talk about the future. They don't use the term "dataflow" though. https://www.oreilly.com/library/view/designing-data-intensiv...
That one’s also on my reading list. Was it worth the read?
Re: Drasi: Microsoft's open source data processing platform for event-driven systems
#45I finished reading Kleppman's Designing Data-Intensive Applications last night and this looks like it's straight out of the last chapter that talk about the future. They don't use the term "dataflow" though. https://www.oreilly.com/library/view/designing-data-intensiv...
That one’s also on my reading list. Was it worth the read?
This book is definitely worth the read. Or maybe worth 10 reads.
Its really that awesome!
Re: Drasi: Microsoft's open source data processing platform for event-driven systems
#46Looks very Azure-centric. Both installation guides ( https://drasi.io/how-to-guides/install-sample-applications/b... and https://drasi.io/how-to-guides/install-sample-applications/c... ) require Azure to work. And then there's this: > Installing Drasi in an EKS cluster can be significantly more complex than a standard installation on other platforms. Instead of downloading a CLI binary using the provided installation…
Azure SRE here, it doesn't appear to have any Azure dependencies. CLI rebuild seems to be that "drasi init" assumes Azure Kubernetes Service built in StorageClasses for Kubernetes PVC for Redis and Mongo and thus fails when running against EKS. I assume same thing would be required on GKE. Yes, it should be more modular but MVP. As for other stuff, it's using Gremlin Query Language or Postgres which are both open. In…
[deleted]
Re: Drasi: Microsoft's open source data processing platform for event-driven systems
#47Looks very Azure-centric. Both installation guides ( https://drasi.io/how-to-guides/install-sample-applications/b... and https://drasi.io/how-to-guides/install-sample-applications/c... ) require Azure to work. And then there's this: > Installing Drasi in an EKS cluster can be significantly more complex than a standard installation on other platforms. Instead of downloading a CLI binary using the provided installation…
Every bit of Microsoft open source is created at least partly as a sales strategy for Azure. They usually start within the Azure infrastructure because, well, why wouldn’t they? Then eventually they tend make it to where you can use them outside of Azure but they never quite leave the part where they are “better” if you’re an Azure customer.
Time will tell if Drasi is going to go the path where it becomes more easily useable outside of Azure (and in this case AWS) or it’ll go more of a Bicep route.
Re: Drasi: Microsoft's open source data processing platform for event-driven systems
#48Weird thing about this project is that neither the website (https://drasi.io) or the repo (https://github.com/drasi-project/drasi-platform) mention that it's a Microsoft project.
Also the only cloud provider it has installation instructions for is AWS's EKS platform. Yet it has integration instructions for Azure CosmosDb Gremlin API.
That one customer out there using EKS and Gremlin on CosmosDb is probably over the moon right now.
Re: Drasi: Microsoft's open source data processing platform for event-driven systems
#49[flagged]
Re: Drasi: Microsoft's open source data processing platform for event-driven systems
#50I would really enjoy using it. But as a novice data intensive application developer, why would I not query the table 30 seconds and look for changes with a Python program (or another regular programming language)?