This is a reminder for those clients on our shadow02 (Xen PV) node. We will begin the migration to shadow01 shortly. For more information, please check the e-mail we sent out on the 22nd of last month or view our Scheduled Maintenance Calendar. We will update this announcement when we finish tonight. Feel free to open a ticket with our Support department if you have any questions.
10PM EST - It appears we underestimated the length of each migration. The transfer is capping out at about 550Mbps instead of the full 1Gbps we were hoping.
3AM (9/2) - shadow01 needs to be rebooted to resolve a hung mount process causing migrated VPSs to not boot and SolusVM to stop responding to commands for all Xen PV VPSs.
4:30AM - We issued the reboot command an hour and a half ago with no results. We have performed a forceful reboot of the node and it should be back online shortly.
6:45AM - After a few hiccups, all of the VPSs that were migrated were back online. We only got through 1/4th of the VPSs on shadow02. We will continue at 9PM EST tonight.
9PM - Starting part 2 of the migrations.
11:50PM - Rebooting shadow01 to fix issue with pygrub kernels.
1AM (9/3) - Networking issues on shadow01 after the reboot.
2:45AM - shadow01 is back online with network connectivity and VPSs can now boot into pygrub kernels again after removing the NIC bonding and upgrading to a newer version of Xen (and multiple reboots). The migrations are continuing.
5AM - We have finished with the migrations for tonight. We will continue with them at 9PM each night until they are complete.
9PM - Resuming migrations.
1:15AM (9/4) - We are more than halfway done with the migrations. Tonight's batch went very smoothly and we hope the rest continue. We will continue tonight at 9PM again and should be done by Thursday morning. If you are having issues accessing your VPS, please follow the instructions here: https://my.securedragon.net/knowledgebase.php?action=displayarticle&id=56 If you need assistance, please open a ticket with our Support department with your root password. At this time all servers still on shadow02 will show "Offline" in SolusVM, once they are migrated they will appear online again.
9PM - Resuming migrations.
2AM (9/5) - Another smooth night of migrations. We will continue again tonight at 9PM.
9PM - Resuming migrations.
2:30AM (9/6) - 6 VPSs left to migrate. Will finish them up as time permits today.
9PM (9/7) - All of our Xen VPSs are now on shadow01. We have been monitoring the resource use and the CPU has been remaining steady at less than 25%. An e-mail will be sent out shortly for our Xen clients.
-The Secure Dragon Staff
Saturday, September 1, 2012
