Server 26 Boot Failure
-
Friday, 25th December, 2015
-
08:25am
25 December 5.00pm
We're back! We have recovered the boot partition and the user data is 100% intact. We're going to continue with the restore to the spare server just to be 100% sure and have a fall back but everything we are seeing tells us this issue is resovled. The drives are all showing as healthy and the RAID array is healthy. Apologies this took so long. We're not making exuses but it's Christmas Day and our senior admins were off and had to be called, this took a little time. Our data centre remote hands only had one staff member covering the data centre causing significant delays in having servers rebooted, KVMs connected etc.
25 December 1.00pm
We are still having issues getting the server to boot. We have just connected a private gigE connection between the backup server and the spare server and are transferring over the backups in preparation for a restore. We anticipate the transfer taking about 4 hours. Once that happens sites will start to resolve again as they restore. We will update you on progress in 2 hours.
It's important to note at this time we have 2 techs working. One is still working on the old server with pririty and our aim is to still fix this. The restore is going on at the same time as a backup option. We're sorry for this blip.
25 December 11.30am
We're still working on this and are also currently restoring the server to a spare node. We'll have another update in 2 hours.
25 December 9.45am
The RAID array shows as optimal but the server is not booting indicating an issue with the boot partition. We have a recovery session active and are working to troubleshoot this server to ascertain why it is not booting. We are hopeful this is not needed but just as a precaution another technician is working at configuring one of our Hot Spare servers in prep for a restore. It must be stressed this is purely a precaution to save time should a restore be needed. We're hopeful with the recovery session we can get this server to boot.
25 December 8.30am
We are aware that server 26 will not current boot. We're currently cuecking into this and are giving this issue top priority. Our senior admin on call has been contacted and will be on line by 9.30am.
