Server 120 Outage
-
Sunday, 26th October, 2014
-
06:25am
We are working on this now and will provide updates on this page. It will be helpful at this time if you do not open live chats or tickets and check this page. Our live chat technicians and helpdesk staff are busy working on this issue at this time and do not have any more information that is posted here.
Unfortunately Server 120 has gone read only again. This is the third time in five weeks so we are 100% going to replace this server today to ensure a stable service for these clients moving forward.
The old chassis is not picking up the RAID Array so we are going to do two things in parallel
- Have the data centre perform a chassis swap so they replace everything apart from the disks (there is spare hardware immediately available)
- Begin an emergency restore to our spare hardware
Whichever works first will be what we will use to bring the sites back on line. We are hopeful the chassis swap will work as this should being things on line more quickly as long as the new chassis sees the disk array. The server with the fault is brand new hardware and less than 2 months old. It will be returned for a refund under warranty.
6.50am: The failed server is not seeng the array we are working on it to see if we can bring it up for a short term
6.50am: The data restore is underway to our spare server - sites not on line yet as the IP still not swapped
7.15am: The restoration has started
7.15am: We are still waiting on a data centre admin to do a chassis swap (everything bar the drives) to see if we can get the server back
8.25am: Restoration to our spare server is continuing
8.25am: The data centre remote hands admins are performing a chassis swap at this time also on the old server
9.04am: The new chassis is in place (new everything apart from disks) - server is back on line
Management will be issuing a statement on this ongoing issue with this one server later today and this will be emailed to all clients on this box. But in summary we have had 5 weeks where we have had 3 random outages on this server. Today we have deployed brand new everything (apart from the disks) and the server is back on line. We are confident this will solve this issue.
