Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Drasi: Microsoft's open source data processing platform for event-driven systems

github.com

Post reply on HN
Print view View original

51–60 of 87 posts

Re: Drasi: Microsoft's open source data processing platform for event-driven systems

#52

Post by bobnamob »

unixhero wrote: post #50

I would really enjoy using it. But as a novice data intensive application developer, why would I not query the table 30 seconds and look for changes with a Python program (or another regular programming language)?

One of the best resources to understand "why would I not ... ?" in a data intensive context is Kleppmann's Designing Data-Intensive Applications[1] (mentioned elsewhere in the comments). There's a lot of nuance to why event streaming wins out over periodically "polling" a database, mostly about maintaining correctness while being able to scale horizontally.

Taking a look at the Kafka docs [2] is also enlightening.

[1] https://www.amazon.com/Designing-Data-Intensive-Applications...

[2] https://kafka.apache.org/documentation/#gettingStarted

Re: Drasi: Microsoft's open source data processing platform for event-driven systems

#53

Post by xnorswap »

9dev wrote: post #44
mnsc wrote: post #43

I finished reading Kleppman's Designing Data-Intensive Applications last night and this looks like it's straight out of the last chapter that talk about the future. They don't use the term "dataflow" though. https://www.oreilly.com/library/view/designing-data-intensiv...

That one’s also on my reading list. Was it worth the read?

I read it over the summer and I'd say it's essential reading for any developer who deals with data.

Perhaps most importantly, the book empowered me to talk confidently about the trade-offs involved with different choices of handling data, and gave me a language framework to talk accurately about those choices.

Previously even the parts I did understand was from experience, and not an academic background, so my explanations were hand-wavy or sloppy, but now I can state my case for different solutions much more clearly.

Re: Drasi: Microsoft's open source data processing platform for event-driven systems

#55

Post by ourmandave »

mnsc wrote: post #43

I finished reading Kleppman's Designing Data-Intensive Applications last night and this looks like it's straight out of the last chapter that talk about the future. They don't use the term "dataflow" though. https://www.oreilly.com/library/view/designing-data-intensiv...

[flagged]

Re: Drasi: Microsoft's open source data processing platform for event-driven systems

#58

Post by [deleted] »

iamstan23 wrote: post #48

Weird thing about this project is that neither the website ( https://drasi.io ) or the repo ( https://github.com/drasi-project/drasi-platform ) mention that it's a Microsoft project. Also the only cloud provider it has installation instructions for is AWS's EKS platform. Yet it has integration instructions for Azure CosmosDb Gremlin API. That one customer out there using EKS and Gremlin on CosmosDb is probably over t…

[deleted]

Re: Drasi: Microsoft's open source data processing platform for event-driven systems

#60

Post by vladsanchez »

iamstan23 wrote: post #48

Weird thing about this project is that neither the website ( https://drasi.io ) or the repo ( https://github.com/drasi-project/drasi-platform ) mention that it's a Microsoft project. Also the only cloud provider it has installation instructions for is AWS's EKS platform. Yet it has integration instructions for Azure CosmosDb Gremlin API. That one customer out there using EKS and Gremlin on CosmosDb is probably over t…

https://azure.microsoft.com/en-us/blog/drasi-microsofts-newe...

> "The Microsoft Azure Incubations team is excited to announce that Drasi is now available as an open-source project."

Post reply on HN