We have some performance issues today (9th Feb 2014) with a server (charlie) which is causing slow loading of websites for some customers. We are doing a reboot of the server at the moment (2:30pm AEST) which will cause downtime for approximately 30 minutes. Hopefully normal service will be resumed shortly after that.
Further updates will be posted here.
UPDATE – 4:00PM – We are continuing to have server issues with this server, and as we don’t have a clear resolution from our server provider on the issue, we’re reverting to our backup plan and starting to move accounts to our other servers. This process will take a few hours, so please bear with us as this process occurs.
UPDATE – 7:00PM – All accounts are now moved to different servers. All websites should now be back online, and email should starting coming back online shortly. There will be some issues with your computer remembering the old server address and trying to retrieve email from there – rebooting your computer will hopefully fix this issue for you. Any further issues, please let us know.
UPDATE – 8:45PM – All services should be back to normal. All affected customers have been notified by email. If you have any issues, please let us know.
UPDATE – 10/02/2014 – We’ve reviewed our disaster recovery procedures after the server issues yesterday, and overall we’re happy with how they performed. We were able to get all client back up and running within 6 hours (most much sooner), and with no loss of data. Due to the issues experienced with this server, along with some business & technical reasons, we’ve decided that this server will not be brought back into the production environment. We have plenty of spare capacity and redundancy within our other servers for the clients who were hosted on this server.