FutureQuest, Inc. FutureQuest, Inc. FutureQuest, Inc.

FutureQuest, Inc.
Go Back   FutureQuest Community > FutureQuest Site Owners (All may read - Only Site Owners May Respond) > Notices & Alerts
User Name
Password  Lost PW

 
Thread Tools Search this Thread Display Modes
Old 08-11-1999, 12:32 AM   Postid: 24734
 Terra
CTO FutureQuest, Inc.
 
Terra's Avatar
 
Join Date: Jun 1998
Location: Z'ha'dum
Posts: 7,678
FQuest Alert: The Truman Show (Network Outage)

Ever have one of those days that when you open your eyes from a peaceful slumber, that suddenly you are on a beach with rain falling *just* on your head and no one elses...  Then as time passes by, rain is everywhere...

For those that have seen 'The Truman Show', you will know exactly what I mean...

Today has been a very interesting day, with NINE having problems with frozen pipes, and then later on in the day everything begin to unravel...

Earlier this evening, the area around the NOC, for which our servers reside, suffered a major power outage draining all of the reserve battery cells eventually taking down every piece of equipment located inside...  About 2 hours later, after power restored, Times Warner Telco had lost their big OC-48 pipes and several DS-3's...  Several large ISP's lost their POP connectivity, wreaking havoc and causing tears within the delicate fabric of the Internet...

With SIX finally starting to shine beyond her tainted colors, and with TAZ having phenominal uptime records - this had to happen and ruin the party...

Outages like this are common on the Internet at large, with those suffering are random targets...  Today was our day (along with others) to bear the brunt that technology does and will break when least expected...  No matter how strong you think your HA ability is, it is only as strong as the weakest link...  For that today were sub-atomic electrons carrying the pulse of online persona, rudely severed from the umbilical, carrying the force to deliver content to those whom wish to seek it out...

Our sincerest apologies for the disruption in service to both your patrons and yourselves...

--
Andrew Gillespie
Systems Administrator
FutureQuest.net
Terra is offline  
Old 08-11-1999, 12:54 AM   Postid: 24735
 Deb
FutureQuest, Inc.
 
Deb's Avatar
 
Join Date: Jun 1998
Location: Franktown Colorado
Posts: 6,781
--Sweet Dreams TeRRa--

I think you need some
Deb is offline  
Old 08-11-1999, 01:42 AM   Postid: 24736
JoeRT
Site Owner
 
JoeRT's Avatar

Forum Notability:
38 pts: User-friendly
[Post Feedback]
 
Join Date: Jul 1999
Location: Grants Pass, OR
Posts: 592
I guess this answers one question I've always had... just UPS backup, no generator?  I know there's certain security being in a hospital grid, but I thought everyone in hurricane alley had a generator (especially with Y2K coming on and my non-Y2K generator order is two months out).  

Still, for what you went through today, sounds like you did a great job getting the systems back up.  Being a tech myself, I know what kind of a day you had!
[This message has been edited by JoeRT (edited 08-11-99)]
JoeRT is offline  
Old 08-11-1999, 03:23 AM   Postid: 24737
tedloh
Registered User

Forum Notability:
10 pts: User-friendly
[Post Feedback]
 
Join Date: Jun 1999
Posts: 750
Yup.  Deb and Andrew are quick to respond as usual.  But who would've known that the NOC was going to go down afterwards!  Sheesh (fortunately I was in bed already).

Like I said before - do whatever you gotta do.  You two and Justin are tops


------------------
Ted (Chief Do-It-All)
Tygre Systems Co Ltd
Bangkok, Thailand, Land of Smiles
http://www.tygresystems.com (work in progress)
ted@tygresystems.com
tedloh is offline  
Old 08-11-1999, 10:04 AM   Postid: 24738
hearts
Visitor
 
hearts's Avatar

Forum Notability:
0 pts:
[Post Feedback]
 
Join Date: Dec 1998
Location: An isolated town in Georgia
Posts: 901
<font color=#FF0000>with this image that Deb posted</font>, I would say that she summoneded the internet evils and caused this all to happen! :รพ



[This message has been edited by hearts (edited 08-11-99)]
hearts is offline  


Currently Active Users Viewing This Thread: 1 (0 members and 1 visitors)
 
Thread Tools Search this Thread
Search this Thread:

Advanced Search
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Forum Jump


All times are GMT -4. The time now is 06:37 AM.


Running on vBulletin®
Copyright © 2000 - 2013, Jelsoft Enterprises Ltd.
Hosted & Administrated by FutureQuest, Inc.
Images & content copyright © 1998-2013 FutureQuest, Inc.
FutureQuest, Inc.