Live data from Hacker News

Ask HN: Azure has run out of compute – anyone else affected?

news.ycombinator.com

41–50 of 359 posts

Re: Ask HN: Azure has run out of compute – anyone else affected?

#41

Yes it’s weird that you have to ask them for instances which some actual physical person looks at your request, thinks about it and says yes or no to. Instead of providing you with a list of the resources they do have, you have to play this weird game where you ask for specific instances in specific regions and then within several hours someone emails back to say yes or no. If it’s no, you have to guess again where y…

Is this a joke comment?

Re: Ask HN: Azure has run out of compute – anyone else affected?

#42

Earlier quoted context omitted.

I'll reply to my own comment in response to a since-deleted reply that went something to the effect of "this is terrible advice for a young startup trying to get to product market for": I'm totally on board with the idea of being scrappy and taking shortcuts in order to get to PMF as soon as possible. However, it seems the proof is in the pudding here. If you can't service customers due to lack of compute resources,…

GDPR might be a problem here. But this brings us to an important point: this is not your infrastructure, but someone elses.

Good point, I didn't think about that.

Re: Ask HN: Azure has run out of compute – anyone else affected?

#43
post #24

> We never thought our startup would be threatened by the unreliability of a company like Microsoft You will be threatened by your own unreliability of building something that's dependant on one region or one cloud.

This is an insidious argument to make. When building a startup you should choose 1 reliable cloud provider and use their best practices to support high availability.

No matter the provider, their best practices all say to be multi-region.

Re: Ask HN: Azure has run out of compute – anyone else affected?

#44
post #20

Earlier quoted context omitted.

Thanks a lot! You are totally right, it is for sure something we will find a solution for. But honestly, do I not want to. As a startup, you have very few resources and deliberately place some exact bets. Deprioritizing everything to work on something for a long time that was not prioritized, just to then end up again where you were before (a working cloud solution) is the last thing any startup should be forced to d…

I hear you. It's not a fun position to be in. And sometimes you're correct to take calculated risks and maybe the expected value was positive here, despite what ended up happening. Without knowing the details about your services and infrastructure, it's hard for me to know what's involved in going multi-region now. Are you sure it's such a a gargantuan effort? I would've thought one person working full-time on this f…

Thanks a lot, is really super nice of you and appreciated! Luckily we have somebody very knowledgeable on our team. Will tell him to reach out if he wants to have a peer to brain-storm some ideas.

Re: Ask HN: Azure has run out of compute – anyone else affected?

#45
post #26

EC2 us-east-1 is chronically stocked out, too. Black Friday is the worst day of the year for this. At work, we pre-allocated tons of EC2 machines we don't really need, to hedge against EC2 stockout coinciding with some kind of incident. Yes, we are part of the problem.

In a former role, I used EC2 in us-east-1 to host the front door e-commerce site for a consumer electronics company. AWS suggested that we go through the Infrastructure Event Mangaement process (https://aws.amazon.com/premiumsupport/programs/iem/) for Black Friday and Cyber Monday, so that staff on Amazon's side could guarantee that they'd have capacity to run our system at its forecasted peak.

The strategy they helped us arrive at was two-pronged:

1. Pre-launch all needed infrastructure. Yes, for all their "cloud scale", it was actually suggested that we preallocate all of our servers the week before, rather than rely on autoscaling.

2. Order capacity reservations for all of those instances (https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/ec2-capa...). This ensure that, if any of those instances go bad, we'd be able to relaunch them without going to the back of the line, and finding out that there was no more compute capacity available.

Re: Ask HN: Azure has run out of compute – anyone else affected?

#46

> We never thought our startup would be threatened by the unreliability of a company like Microsoft, or that they wouldn’t proactively inform us about this. Yikes, this is totally the first thing you need to come to expect when working with MSFT.

When Amazon S3 was a new thing, when I managed to convince my company move to it, when we just moved to serving some of our stuff from S3, first week, Amazon has an outage.

Re: Ask HN: Azure has run out of compute – anyone else affected?

#47

Yes it’s weird that you have to ask them for instances which some actual physical person looks at your request, thinks about it and says yes or no to. Instead of providing you with a list of the resources they do have, you have to play this weird game where you ask for specific instances in specific regions and then within several hours someone emails back to say yes or no. If it’s no, you have to guess again where y…

Is this a joke comment?

No, this is my actual experience using azure.

Re: Ask HN: Azure has run out of compute – anyone else affected?

#48

Azure Germany is a separate partition from the rest of Azure - presumably for compliance reasons. This is distinct from AWS, where Frankfurt is just another region, albeit one with high demand.

Yep, it's run by the Telekom entirely IIRC from my time back at MSFT. Microsoft "just deploys" Azure on it.

Re: Ask HN: Azure has run out of compute – anyone else affected?

#49
People saying "shame on you for not being multi-region" are missing the point: This is a German company with German customers subject to German data residency laws. For them to store German data in a region besides Germany requires getting informed consent from the "data subject", who must be "pre-informed about the potential risks involved in cross-border data transfer". [1] This is why Azure has a dedicated German partition, just as it has a dedicated Chinese partition.

Now, they could go the GDPR/Cookies route and prompt absolutely every user on pageload, but doing so would annihilate the purpose of the law into monotonous smithereens, just as it did with Cookies. Good on them for defaulting to the "more secure" mode, but yes this is a potential consequence.

Happy to hear from any German amigos present if I've got something wrong. (But watch out... you might be putting HN at risk - their servers aren't (likely) in Germany!)

[1]: https://incountry.com/blog/which-german-data-privacy-laws-yo...

Re: Ask HN: Azure has run out of compute – anyone else affected?

#50

Earlier quoted context omitted.

I'll reply to my own comment in response to a since-deleted reply that went something to the effect of "this is terrible advice for a young startup trying to get to product market for": I'm totally on board with the idea of being scrappy and taking shortcuts in order to get to PMF as soon as possible. However, it seems the proof is in the pudding here. If you can't service customers due to lack of compute resources,…

GDPR might be a problem here. But this brings us to an important point: this is not your infrastructure, but someone elses.

There are quite a few European regions, but we don't know how the others stand with their computing limits...
Post reply on HN