Massive intenet outage in Western US

  • Thread starter Thread starter jim mcnamara
  • Start date Start date
Click For Summary
SUMMARY

The massive internet outage affecting the Western US on December 27, 2018, was primarily caused by a faulty networking card at CenturyLink in Colorado. This outage impacted multiple providers, including Verizon, due to line sharing. The incident drew comparisons to the 1987 AT&T outage, which was caused by a software bug and resulted in widespread service disruption. Additionally, a cyber attack occurred around the same time, raising questions about a potential connection, although no definitive cause has been established for the CenturyLink outage.

PREREQUISITES
  • Understanding of networking hardware, specifically networking cards
  • Familiarity with internet service provider operations and line sharing
  • Knowledge of historical internet outages and their causes
  • Basic awareness of cybersecurity threats and their implications
NEXT STEPS
  • Research the impact of networking hardware failures on service outages
  • Explore the history of major internet outages and their causes
  • Learn about cybersecurity measures and their importance in preventing service disruptions
  • Investigate the role of line sharing among internet service providers
USEFUL FOR

Network engineers, IT professionals, cybersecurity analysts, and anyone interested in understanding the complexities of internet service reliability and outage management.

jim mcnamara
Mentor
Messages
4,789
Reaction score
3,852
as of 16:48 MST
https://downdetector.com/status/centurylink/map/

Century link affected a large area. Verizon and other providers were also affected to to line sharing/piggy-backing.
 
Physics news on Phys.org
Santa took out some lines while heading back home.

The map shows it to be isolated to individual cities although I imagine its much bigger than that.

Kind of reminds me of the 1987 ATT outage which took out the whole East coast of the US. It was a software bug in a new OS update for ATT network machines. Two things happened:

1) The ATT phone server would overload, transfer phones to the next one in line and reboot.
2) During the reboot, if any call came in it would reboot again creating network fibrillation where servers were caught in an endless reboot cycle.

At least that's how I remembered it was presented at the time by a shamefaced AT&T.

However, this very long article suggested the initial cause was that the AT&T technicians were attending a class about power failures and how to handle them with no one manning the network room to hear the actual alarms that the system was running on emergency battery power.

http://www.mit.edu/hacker/part1.html
 
I just received notice that there was a cyber attack around the same time.
They also said that there was still no claimed cause for the phone/internet outage, but I checked, and it appears to have been "a network card"?
Is that possible?

Report: Huge CenturyLink outage caused by bad networking card in Colorado
BY TOM KRAZIT on December 29, 2018 at 3:44 pm

Outage Start: December 27, 2018 08:40 GMT [Thursday]​

Not sure if the cyber attack is related or not.

Foreign cyberattack hits Los Angeles Times, Tribune newspapers across the country, triggering delays and distribution problems
By TONY BARBOZA, MEG JAMES and EMILY ALPERT REYES
DEC 29, 2018 | 7:30 PM

The attack seemed to have begun late Thursday night...

Kind of suspicious though, being so close together.
 
An outage map as of December 28, 2018
181228-centurylink-outage-map-cs-1101a_3a6a4361edc1e9fdee433521a46b27ee.fit-760w.jpg

A CenturyLink outage map on Dec. 28, 2018.Downdetector.com

And, in the vein of "New and Shiny" ≠ "Best"

In Boston, a man tried to call 911 with his cell phone to report a house fire on Friday but it didn't work due to the outage, according to Boston fire spokesman Mark Sanders.

That man was quick to pull an alarm on one of the city's old-fashion, street-side alert boxes at 5:14 a.m. ET, officials said. That sent a Morse code to dispatchers, telling them help was needed near box 1212 at the corner of Cooper and Endicott Streets in the old, densely populated North End neighborhood.

Response to 94 Endicott St. North End at approx. 5:14 AM for a building fire. Smoke showing on arrival. Fire was quickly extinguished. Because of today’s 911 outage the resident pulled the fire box. Fortunately, our fire box system has been operational since 1852. No injuries. pic.twitter.com/Pg69ksPqDo

— Boston Fire Dept. (@BostonFire) December 28, 2018
"It was a small fire that we were able to put out, but it could have been much worse" had the man not reached for the manual alarm, Sanders said.

There are still 1,249 such boxes still operating in Boston, using battery power and copper wiring that's not dependent on any utility company.

"There are people new to Boston who don't realize those still work and assume they're just there for historical purposes," Sanders said. "Back in 1852 (when the first boxes were erected), this was high technology."


(above from https://www.nbcnews.com/news/us-new...enturylink-wake-nationwide-911-outage-n952681)

Cheers,
Tom
 

Attachments

  • 181228-centurylink-outage-map-cs-1101a_3a6a4361edc1e9fdee433521a46b27ee.fit-760w.jpg
    181228-centurylink-outage-map-cs-1101a_3a6a4361edc1e9fdee433521a46b27ee.fit-760w.jpg
    25.9 KB · Views: 347
  • Like
Likes   Reactions: OmCheeto

Similar threads

Replies
2
Views
794
  • · Replies 47 ·
2
Replies
47
Views
6K
  • · Replies 10 ·
Replies
10
Views
2K
  • · Replies 6 ·
Replies
6
Views
4K
  • · Replies 25 ·
Replies
25
Views
4K
Replies
9
Views
3K
Replies
5
Views
3K
  • · Replies 29 ·
Replies
29
Views
10K
  • · Replies 46 ·
2
Replies
46
Views
8K
  • · Replies 2 ·
Replies
2
Views
4K