[dead]
CrowdStrike Update: Windows Bluescreen and Boot Loops
821–830 of 1001 posts
Re: CrowdStrike Update: Windows Bluescreen and Boot Loops
#822It is interesting that operating systems exist for server applications at all.
What is the problem they are solving?
What is the difference between what an operating system contains and can do and what you need it to do?
Why would I want to rent a server to run a program that performs a task, and also have the same system performing extra tasks - like intrusion detection, intrusion detection software updates, etc.
I just don't understand why compiled program that has enough disk and memory would ever be asked to restart for a random fucking reason having nothing to do with the task at hand. It seems like the architecture of server software is not created intelligently.
Re: CrowdStrike Update: Windows Bluescreen and Boot Loops
#823This whole thing likely would have been averted had microkernel architectures caught on during the early days (with all drivers in user mode). Performance would have likely been a non-issue, not only due to the state of the art L4 designs that came later, but mostly because had it been adopted everything in the industry would have evolved with it (async I/O more prevalent, batched syscalls, etc.). I will admit we've…
Not disagreeing with you but we need operating systems with snapshots before updates and a trivial way to rollback the update.
Linux has some immutable OS versions and also btrfs snapshots and booting a specific snapshot from the GRUB bootloader
Re: CrowdStrike Update: Windows Bluescreen and Boot Loops
#824Took down our entire emergency department as we were treating a heart attack. 911 down for our state too. Nowhere for people to be diverted to because the other nearby hospitals are down. Hard to imagine how many millions of not billions of dollars this one bad update caused.
> Took down our entire emergency department
What does this mean? Did the power go down? Is all the equipment connected? Or is it the insurance software that can't run do nothing gets done? Maybe you can't access patient files anymore but is that taking down the whole thing?
Re: CrowdStrike Update: Windows Bluescreen and Boot Loops
#825Read on Mastodon: https://infosec.exchange/@littlealex/112813425122476301 The CEO of Crowdstrike, George Kurtz, was the CTO of McAfee back in 2010 when it sent out a bad update and caused similar issues worldwide. If at first you don't succeed, .... ;-) j/k
Eh. To be fair, the higher profile your job is, the more likely you'll be the face of one of these in your career.
Re: CrowdStrike Update: Windows Bluescreen and Boot Loops
#826AWS has posted some instructions for those affected by the issue using EC2. [AWS Health Dashboard]( https://health.aws.amazon.com/health/status ) "First, in some cases, a reboot of the instance may allow for the CrowdStrike Falcon agent to be updated to a previously healthy version, resolving the issue. Second, the following steps can be followed to delete the CrowdStrike Falcon agent file on the affected instance: 1…
That is a lot of steps. Can this not be scripted?
Re: CrowdStrike Update: Windows Bluescreen and Boot Loops
#827The IT security chief at my co (paraphrasing):
>talked to pres of Crowdstrike. His forthrightnes was refreshing. He said “We got it wrong.”
>They are working with Microsoft to understand why this happened.
Pretty much the message minus even more boilerplate talk.
Re: CrowdStrike Update: Windows Bluescreen and Boot Loops
#828Quick fix that worked for us, In safe mode: 1.enter in drive C: 2.system 32 folder 3. Drivers 4. Rename crowdstrike folder to something else doesent matter what.
Could you potentially do the same by just attaching the HDD to another computer as a secondary drive and renaming the folder if safe mode falls through?
Re: CrowdStrike Update: Windows Bluescreen and Boot Loops
#829Took down our entire emergency department as we were treating a heart attack. 911 down for our state too. Nowhere for people to be diverted to because the other nearby hospitals are down. Hard to imagine how many millions of not billions of dollars this one bad update caused.
Not to be that guy, but I often say software engineering as a field should have harsher standards of quality and certainly liability for things like these. You know like civil engineers, electrical engineers and most people whose work could kill people if done wrongly.
Usually when I write this devs get all defensive and ask me what the worst thing is that could happen.. I don't know.. Could you guarantee it doesn't involve people dying?
Dear colleagues, software is great because one persons work multiplies. But it is also a damn fucking huge responsibility to ensure you are not inserting bullshit into the multiplication.
Re: CrowdStrike Update: Windows Bluescreen and Boot Loops
#830Why Crowdstrike doesn't follow standard deployment strategies such as canary or rolling? Gradual update would uncover this bug before reaching critical mass. Doing all-at-once update is unacceptable to critical systems.