Live data from Hacker News

CrowdStrike Update: Windows Bluescreen and Boot Loops

old.reddit.com

241–250 of 1001 posts

Re: CrowdStrike Update: Windows Bluescreen and Boot Loops

#241

Naive question, if it’s a blue screen of death with a boot loop, how are they going to restore things? Don’t tell me the answer is going to every system manually.

Go to every system manually, boot to safe mode, rename the sys files, run a fix.

Easier to just rebuild from the image. For every windows machine your company has. lol.

Re: CrowdStrike Update: Windows Bluescreen and Boot Loops

#243

The details (the particular companies / systems etc) of this global incident don't really matter. When the entire society and economy are being digitized AND that digitisation is controlled and passes through a handful of choke points its an invitation to major disaster. It is risk management 101, never put all your digital eggs in one (or even a few) baskets. The love affair with oligopoly, cornered markets and powe…

> It is risk management 101, never put all your digital eggs in one (or even a few) baskets.

The fact it's widespread is because so many individual organisations individually chose to use CrowdStrike, not because they all got together and decided to crown CrowdStrike as king, surely?

I agree with you in principle, but the only solution I can think of would be to split up a company with reach like CrowdStrike's. The consequences of having to do that are up for debate.

Re: CrowdStrike Update: Windows Bluescreen and Boot Loops

#244
post #80

We are a major CS client, with 50k windows-based endpoints or so. All down. There exists a workaround but CS does not make it clear whether this means running without protection or not. (The workaround does get the windows boxes unstuck from the boot loop, but they do appear offline in the CS host management console - which of course may have many reasons).

A bunch of unprotected endpoints all at once on critical systems… what could possibly go wrong?

Hope they role out a proper fix soon…

Re: CrowdStrike Update: Windows Bluescreen and Boot Loops

#245

Chances if Microsoft or Crowdstrike will be held liable for financial losses caused by this outage?

Yes, SLA. No one gets held liable if the legal is done correctly and there were no guarantees, but on cloud there is 100% SLA so they will pay out.

Re: CrowdStrike Update: Windows Bluescreen and Boot Loops

#246

I've picked the perfect day to return from vacation. Being greeted by thousands of users being mad at you and people asking for your head on a plate makes me reconsider my career choice. Here's to 12 hours of task force meetings...

Huge sympathies to you. If it's any consolation, because the scale of the outage is SO massive and widely reported, it will quickly become apparent that this was beyond your control, and those demanding your 'head on a plate' are likely to appear rather foolish. Hang in there my friend.

Re: CrowdStrike Update: Windows Bluescreen and Boot Loops

#247
post #193

This is a manifestation of almost everything wrong about software development and marketing practices. I work in hardware development and such a failure is almost impossible to imagine. It has to work, always. It puzzles me why this isn't the casebfor software. My SWE colleagues often get mad at us HW guys because we want to see their test coverage for the firmware/drivers etc.. The focus is having something which co…

> It puzzles me why this isn't the case for software

In my anecdotal experience, its because corporate software projects are not typically run by people who are good at building safe things - but rather, just building things quickly.

There's a huge issue with the mentality of "it works, ship it" being propagated.

I build systems software for safety-critical and mission-critical markets, and I can say without a doubt that if there aren't at least two quality stages in your process workflow (and your workflow isn't waterfall), then you're going to be in for a rough time, rookies.

Always, always delay your releases, and always, always, eat your own dog food by testing your delayed releases in your own customer-like environment, which is to say, never release a developers build ..

Re: CrowdStrike Update: Windows Bluescreen and Boot Loops

#249

GLOBAL OUTAGES - Major banks, media and airlines affected by major IT outage - Significant disruption to some Microsoft services - 911 services disrupted in several US states - Services at London Stock Exchange disrupted - Sky News is off air - Flights in Berlin grounded - Reports the issue relates to problem at global cybersecurity firm Crowdstrike

Schipol (Amsterdam, europe's largest) and Melbourne Airport are down
Post reply on HN