Ask HN: Dependency Graphs for Cloud Services? • Hacker News Board

Re: Ask HN: Dependency Graphs for Cloud Services?

#11

Post by scapecast » Sat, Dec 04, 2021, 9:36 PM UTC

this is pure blatant self-promotion on my end, but I think we built - at least directionally - what you’re asking for:

https://github.com/someengineering/cloudkeeper

I’ll reply more in depth since I’m on the run right now, but for now I hope the link is sufficient.

Re: Ask HN: Dependency Graphs for Cloud Services?

#12

Post by __debugger__ » Sun, Dec 05, 2021, 12:05 AM UTC

This information is confidential and only provided under NDA by cloud service providers. In the past, my employer was provided with detailed service dependency documents upon request. But unless you’re a major customer spending millions of dollar every month, you likely can’t request this information.

Re: Ask HN: Dependency Graphs for Cloud Services?

#13

Post by bradknowles » Mon, Dec 06, 2021, 8:22 AM UTC

kevinsundar wrote: post #8

chizhik-pyzhik wrote: post #2

I'm not sure even the cloud providers themselves could give you this information. In Nov 2020, AWS Kinesis Firehose went down for a few hours and took down a slew of other services that depended on each other (Cloudwatch depends on kinesis, ec2 autoscaling and lambda depend on cloudwatch, everyone depends on ec2 and lambda...) This was all sort of a large surprise internally that a "small" component like kinesis stre…

Im sure this must be documented somewhere internally. Whenever a new region is built for AWS, services must be deployed in topologically sorted order. So I'd imagine figuring out dependencies for each service is something that comes up quite often.

It’s a hard problem to solve.

Even when you think you’ve got it right, you will discover edge cases.

Re: Ask HN: Dependency Graphs for Cloud Services?

#14

Post by samspenc » Mon, Dec 06, 2021, 10:29 PM UTC

Microsoft Azure has a service called AppMap (Application Map) that does this for services running inside Azure : https://docs.microsoft.com/en-us/azure/azure-monitor/app/app...