Calgarypuck Forums - The Unofficial Calgary Flames Fan Community
Old 10-04-2021, 01:36 PM   #1
Hemi-Cuda
wins 10 internets
 
Hemi-Cuda's Avatar
 
Join Date: Feb 2006
Location: slightly to the left
Exp:
Default Facebook outage

So Facebook, Instagram, and Whatsapp are all down today worldwide. What caused me to raise eyebrows through is that if you try to ping any of those domains nothing comes up, as if they were deleted from DNS completely. It'll be interesting to hear the details from this, as it's either a highly successful attack or one of the largest IT ####ups I've ever seen
Hemi-Cuda is offline   Reply With Quote
The Following 2 Users Say Thank You to Hemi-Cuda For This Useful Post:
Old 10-04-2021, 01:45 PM   #2
Minnie
Franchise Player
 
Minnie's Avatar
 
Join Date: Dec 2012
Location: On your last nerve...:D
Exp:
Default

It's been interesting to follow this story. It's been several hours now. Reading some different techy folk on twitter & according to them, it's not even just that it's down, it's that it does not currently exist in any way, shape or form.
Minnie is offline   Reply With Quote
The Following User Says Thank You to Minnie For This Useful Post:
Old 10-04-2021, 01:47 PM   #3
devo22
Franchise Player
 
devo22's Avatar
 
Join Date: Jun 2011
Location: Austria, NOT Australia
Exp:
Default

had a strange feeling these past few hours, as if the world were somehow a bit of a better place all of the sudden. This explains it.
devo22 is offline   Reply With Quote
The Following 11 Users Say Thank You to devo22 For This Useful Post:
Old 10-04-2021, 01:48 PM   #4
undercoverbrother
Franchise Player
 
Join Date: Mar 2012
Location: Sylvan Lake
Exp:
Default

But but my cat videos...........
__________________
Captain James P. DeCOSTE, CD, 18 Sep 1993

Corporal Jean-Marc H. BECHARD, 6 Aug 1993

Quote:
Originally Posted by Sliver View Post
Just ignore me...I'm in a mood today.
undercoverbrother is offline   Reply With Quote
Old 10-04-2021, 01:49 PM   #5
Ozy_Flame

Posted the 6 millionth post!
 
Ozy_Flame's Avatar
 
Join Date: Feb 2002
Exp:
Default

Yesterday: Whistleblower comes out with internal wheelings and dealings
Today: Facebook is down

Interesting start to the week.
Ozy_Flame is offline   Reply With Quote
Old 10-04-2021, 01:53 PM   #6
calumniate
Franchise Player
 
calumniate's Avatar
 
Join Date: Feb 2007
Location: A small painted room
Exp:
Default

First they hit east coast CP users, now the world!
calumniate is offline   Reply With Quote
The Following User Says Thank You to calumniate For This Useful Post:
Old 10-04-2021, 01:54 PM   #7
Firebot
First Line Centre
 
Join Date: Jul 2011
Exp:
Default

Relevant

Firebot is offline   Reply With Quote
Old 10-04-2021, 01:55 PM   #8
Swift
Not Taylor
 
Swift's Avatar
 
Join Date: Dec 2009
Location: Calgary SW
Exp:
Default

That explains why my whatsapp messages weren't going through earlier.

Hopefully it's unfixable.
Swift is offline   Reply With Quote
The Following 2 Users Say Thank You to Swift For This Useful Post:
Old 10-04-2021, 01:57 PM   #9
Fuzz
Franchise Player
 
Fuzz's Avatar
 
Join Date: Mar 2015
Exp:
Default

And nothing of value was lost.
Fuzz is offline   Reply With Quote
The Following 4 Users Say Thank You to Fuzz For This Useful Post:
Old 10-04-2021, 01:57 PM   #10
DownInFlames
Craig McTavish' Merkin
 
DownInFlames's Avatar
 
Join Date: Oct 2008
Exp:
Default

Best news I’ve heard today. Thankfully CP is still up so I don’t have to actually interact face-to-face with other people.
DownInFlames is offline   Reply With Quote
Old 10-04-2021, 01:59 PM   #11
kermitology
It's not easy being green!
 
kermitology's Avatar
 
Join Date: Oct 2001
Location: In the tubes to Vancouver Island
Exp:
Default

Sounds like internal systems are also having major issues. They can't even open doors because the doors are run through the same domain.

https://twitter.com/user/status/1445108187355566086

Pure chaos.

Edit.. jesus

https://twitter.com/user/status/1445099150316503057
__________________
Who is in charge of this product and why haven't they been fired yet?

Last edited by kermitology; 10-04-2021 at 02:04 PM.
kermitology is offline   Reply With Quote
Old 10-04-2021, 02:00 PM   #12
lambeburger
Powerplay Quarterback
 
lambeburger's Avatar
 
Join Date: Apr 2007
Location: Calgary, AB
Exp:
Default

If Twitter and Reddit can follow, then humanity has a chance.
lambeburger is offline   Reply With Quote
The Following User Says Thank You to lambeburger For This Useful Post:
Old 10-04-2021, 02:03 PM   #13
Hack&Lube
Atomic Nerd
 
Join Date: Jul 2004
Location: Calgary
Exp:
Default

It sounds like BGP peering with the Facebook peering routers is down and this happened due to a configuration change via some kind of automation. This would break all DNS and routing. This may have taken down the peering routers completely and since they can no-longer be accessed remotely, they need to be accessed physically inside the Facebook datacenters and this is causing further issues since datacenter access is severely restricted and staffing is all remote due to Covid-19.

Basically if their BGP routers withdrew their DNS records or are no-longer advertising FB as a valid route, nobody can get to their DNS records to route traffic to facebook. This seems to have propagated everywhere instantly. What's worse is their internal systems were also using this so nobody can access their buildings or facilities to actually fix the problem directly.

I found this cached article where Facebook engineering is lauding their peering automation. This sounds like the candidate for what broke: https://webcache.googleusercontent.c...&ct=clnk&gl=ca

Some tech friends were like "haha!" until they were like "nooo my stonks!"

Last edited by Hack&Lube; 10-04-2021 at 02:20 PM.
Hack&Lube is offline   Reply With Quote
Old 10-04-2021, 02:04 PM   #14
Firebot
First Line Centre
 
Join Date: Jul 2011
Exp:
Default

If Instagram influencers post without any viewers to see them, do they make a sound?
Firebot is offline   Reply With Quote
The Following 4 Users Say Thank You to Firebot For This Useful Post:
Old 10-04-2021, 02:11 PM   #15
Cheese
Franchise Player
 
Cheese's Avatar
 
Join Date: Mar 2002
Location: Waterloo, Ontario
Exp:
Default

Confirmed: The DNS records that tell systems how to find http://Facebook.com or http://Instagram.com got withdrawn this morning from the global routing tables. Can you imagine working at FB right now, when your email no longer works & all your internal FB-based tools fail?
Cheese is offline   Reply With Quote
Old 10-04-2021, 02:15 PM   #16
Fuzz
Franchise Player
 
Fuzz's Avatar
 
Join Date: Mar 2015
Exp:
Default

Quote:
Originally Posted by Cheese View Post
Confirmed: The DNS records that tell systems how to find http://Facebook.com or http://Instagram.com got withdrawn this morning from the global routing tables. Can you imagine working at FB right now, when your email no longer works & all your internal FB-based tools fail?
Ya, that's when you shrug your shoulders and head out for some fresh air. Unless you are one of the few able to address the disaster, no point in refreshing every 20 seconds.

And as an IT person, please don't contact me. I know it's broken. I knew before you. Yes, I'm worknig on it. No, I have no idea when it will be fixed. Go for a walk.
Fuzz is offline   Reply With Quote
The Following 2 Users Say Thank You to Fuzz For This Useful Post:
Old 10-04-2021, 02:15 PM   #17
Skaloper
First Line Centre
 
Skaloper's Avatar
 
Join Date: Oct 2008
Location: BC
Exp:
Default

This is going to make for some good podcast episodes
Skaloper is offline   Reply With Quote
Old 10-04-2021, 02:16 PM   #18
Skaloper
First Line Centre
 
Skaloper's Avatar
 
Join Date: Oct 2008
Location: BC
Exp:
Default

Quote:
Originally Posted by Fuzz View Post
Ya, that's when you shrug your shoulders and head out for some fresh air. Unless you are one of the few able to address the disaster, no point in refreshing every 20 seconds.

And as an IT person, please don't contact me. I know it's broken. I knew before you. Yes, I'm worknig on it. No, I have no idea when it will be fixed. Go for a walk.
Looks like everyone went to Twitter and Reddit instead of going for a walk. Maybe this is what MySpace needs to make a comeback.
Skaloper is offline   Reply With Quote
Old 10-04-2021, 02:16 PM   #19
TheIronMaiden
Franchise Player
 
TheIronMaiden's Avatar
 
Join Date: May 2016
Location: ATCO Field, Section 201
Exp:
Default

I can think of a few conspiracy theory spammers I know who must be bursting at the seams right now.
TheIronMaiden is offline   Reply With Quote
Old 10-04-2021, 02:18 PM   #20
burn_this_city
Franchise Player
 
burn_this_city's Avatar
 
Join Date: Mar 2007
Location: Calgary
Exp:
Default

IT version of an inside job to bring down the company?
burn_this_city is offline   Reply With Quote
Reply

Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump


All times are GMT -6. The time now is 05:19 PM.

Calgary Flames
2023-24




Powered by vBulletin® Version 3.8.4
Copyright ©2000 - 2024, Jelsoft Enterprises Ltd.
Copyright Calgarypuck 2021