Global Microsoft outage hits airlines, banks and businesses

[photon]

Ugh finally got all my servers back up and running. Of course systems not on my team are still down and they probably haven't even figured out what to do about it. Pretty sad when we can fix 100 of them before another team can fix one.

[PaperBagger'14]

Somewhere out there an investor woke up to check their Crowdstrike share price on their banking app, and the app wouldn’t load and they thought nothing more of it before seeing the news.

[Khel]

Originally Posted by photon

Ugh finally got all my servers back up and running. Of course systems not on my team are still down and they probably haven't even figured out what to do about it. Pretty sad when we can fix 100 of them before another team can fix one.

Never underestimate people's ability to sit and wait for others to fix the problem for them.

[Slava]

Originally Posted by nfotiu

How is crowdstrike stock only down 10%? How do they come back from this?

Well it's not a security issue, it's a technical issue, so it seems like that would be surmountable?

[Fuzz]

Originally Posted by Slava

Well it's not a security issue, it's a technical issue, so it seems like that would be surmountable?

It's a massive failure in processes that is going to have a lot of customers second thinking about paying them more money.

[Fuzz]

Solarwinds stock was at ~$25 in 2020 before their incident. It's sitting at ~11.50 now. Pretty big loss in value over time, due to lost confidence in their software/services.

[I_H8_Crawford]

Originally Posted by Fuzz

It's a massive failure in processes that is going to have a lot of customers second thinking about paying them more money.

And this has likely killed any net-new pipeline that the sales team had lined up.

[KelVarnsen]

There are days I love working in IT.

Today is not one of those.

[bizaro86]

Originally Posted by Slava

Well it's not a security issue, it's a technical issue, so it seems like that would be surmountable?

I mean, the purpose of crowdstrike is to make your website/tech processes more secure/robust.

Them rolling out some big huge technical flaw doesn't do that. My understanding is that they're a relatively premium product that has been gaining market share, thus justifying the high valuation/growth.

But I have to think this will impair their ability to win new contracts going forward, at least for awhile. I doubt the market will be willing to overlook a big drop in their growth rate.

[Locke]

Originally Posted by KelVarnsen

There are days I love working in IT.

Today is not one of those.

Is this all your fault? Are you the guy who forget to hit 'Enter?'

[Bigtime]

I assume it's going to take time for systems that were down and back up again to work through all the kinks. Our point of sale is definitely glitchy right now.

RBC is kind of pooched, they can only accept cash deposits right now and can't post them yet either.

[KelVarnsen]

Originally Posted by Locke

Is this all your fault? Are you the guy who forget to hit 'Enter?'

Legally, I can't answer this question

[nfotiu]

Originally Posted by Fuzz

It's a massive failure in processes that is going to have a lot of customers second thinking about paying them more money.

Exactly, and also they caused an unfathomable amount of financial damage across the world that I'm sure they'll be facing lawsuits over.

[Fuzz]

Originally Posted by Bigtime

I assume it's going to take time for systems that were down and back up again to work through all the kinks. Our point of sale is definitely glitchy right now.

RBC is kind of pooched, they can only accept cash deposits right now and can't post them yet either.

A lot of cloud systems are down, and admins are scrambling. Apparently AWS(and presumably others) are getting sluggish to work on. Most of these systems are build with a lot of redundancy and self healing, and I'd imagine all those architectures really suffer when they can't heal themselves, may be stuck in loops, or just hammering traffic around getting no responses. Monitoring network activity and resource usage would be pretty wild right now. It will definitely take awhile for everything to calm down once the fixes are implemented.

[Slava]

Originally Posted by bizaro86

I mean, the purpose of crowdstrike is to make your website/tech processes more secure/robust.

Them rolling out some big huge technical flaw doesn't do that. My understanding is that they're a relatively premium product that has been gaining market share, thus justifying the high valuation/growth.

But I have to think this will impair their ability to win new contracts going forward, at least for awhile. I doubt the market will be willing to overlook a big drop in their growth rate.

Well yeah, that's why it's down ~10%. But I was just pointing out why it wasn't destroyed after this "issue".

[Locke]

Originally Posted by KelVarnsen

Legally, I can't answer this question

Alright. We know who's fault this. Everyone point at Kel until Pennypacker and Vandelay get here.

My God...whose hands have we put our lives into??

[nfotiu]

How did an update like this hit every server worldwide at the same time?

[Titan2]

Originally Posted by Bigtime

Spruce just came up for us Cedar, let's sell some wood.

[Bigtime]

Gotta push out those thicc timbers...

[Titan2]

Originally Posted by Bigtime

Gotta push out those thicc timbers...

Lana has entered the chat.