|
FQuest Alert: The Truman Show (Network Outage)
Ever have one of those days that when you open your eyes from a peaceful slumber, that suddenly you are on a beach with rain falling *just* on your head and no one elses... Then as time passes by, rain is everywhere...
For those that have seen 'The Truman Show', you will know exactly what I mean...
Today has been a very interesting day, with NINE having problems with frozen pipes, and then later on in the day everything begin to unravel...
Earlier this evening, the area around the NOC, for which our servers reside, suffered a major power outage draining all of the reserve battery cells eventually taking down every piece of equipment located inside... About 2 hours later, after power restored, Times Warner Telco had lost their big OC-48 pipes and several DS-3's... Several large ISP's lost their POP connectivity, wreaking havoc and causing tears within the delicate fabric of the Internet...
With SIX finally starting to shine beyond her tainted colors, and with TAZ having phenominal uptime records - this had to happen and ruin the party...
Outages like this are common on the Internet at large, with those suffering are random targets... Today was our day (along with others) to bear the brunt that technology does and will break when least expected... No matter how strong you think your HA ability is, it is only as strong as the weakest link... For that today were sub-atomic electrons carrying the pulse of online persona, rudely severed from the umbilical, carrying the force to deliver content to those whom wish to seek it out...
Our sincerest apologies for the disruption in service to both your patrons and yourselves...
--
Andrew Gillespie
Systems Administrator
FutureQuest.net
|