[FQuest Alert] PT06 (Mail server) Emergency Maintenance

[Bruce]

What: Emergency Disk Replacement
When: Today April 5, 2009
Window: 10:00-11:00PM ET
Duration: 30 minutes

PT06 has had repeated hard drive failures on one of its RAID ports. We will be shutting the server down so we can open it up to check the cables and adapter for that port and to install a replacement drive.

If your domain is assigned to the PT06 server all email services will be temporarily unavailable. To determine if your domain uses PT06, log in to your CNC (http://www.futurequest.net/GoToCNC/) and go to the Server Info link and check the POP Toaster assigned to your domain. No mail will be lost, either mail already stored on the server or mail delivered to your domain during the maintenance.

Thank you for your patience as we perform this preventive maintenance.

-Bruce

[Kevin]

We are going to postpone this work until 11pm-midnight ET. There is no change to the work but are rescheduling simply for better availability of team members.

[Kevin]

The work on PT06 has begun. We will post again when finished.

[Kevin]

The PT06 work is complete.

The connectors to the disks were tightened (one was pulled to a slight angle).
The firmware on the RAID controller was upgraded.
The Linux kernel was upgraded.

We have confirmed that both hard drives it claimed had failed actually didn't. If there are any further problems we will probably the next step would be to obtain a replacement RAID backplane from the manufacturer. Hopefully we have eliminated the problem tonight.