XC-Host — Support Blog

At approximately 1:30am (EST -5) this morning I noticed a couple instant messages saying that there was extreme server load on the server. I took a look and had to wait a while as pages are taking much longer than usual to load. Everything is fine, server load is under 1, but pages do take considerably longer to load..

I pinged xc-host.com and got one timeout and ended up with 25% packet loss a traceroute confirms this. I’ve sent in a ticket and will have a cause / fix for this soon. I’ll edit this post when I have more information.

EDIT #1 @ 10:08am: “I can see a lot of packet loss to that server. I’m still looking into this problem and will update you shortly.”

EDIT #2 @ 10:50am: The server is down now. They tried doing a reboot but it’s not responding. From the data center: “I checked all the connections but couldn’t find any problem, and other servers in that rack aren’t having any problems.
I tried rebooting the server but I’m not getting any response from it now. We’re going to take it to the workbench now and see what the problem is.”

EDIT #3 @ 11:35am: “Unfortunately one of the two recently added backup drives has failed.
We’re trying to get the server back online asap without the failed drive but it’s giving a few errors we have to work past.”

EDIT #4 @ 2:01pm: It looks like both backup drive maybe corrupt. OR the main drives. It is uncertain at this time. A backup is being run right now so nothing is lost. I don’t have eta. But I’ll post here once I know more.

EDIT #5 @ 3:33pm: The data is okay thankfully, the data center has gone ahead and is building a new server for us. At first I said WHY?! But it is so that this doesn’t happen again. As you know when we got the first hard drive it failed almost instantly.. I hope this is resolved soon. Still no eta..

EDIT #6 @ 8:58pm: The servers back finally, just doing account restoration. Unfortunately the restores are from the 17th. But the old main hard drive is mounted and the files will be restored along with the databases and DNS entries. Also I suggest everyone read the post about XC-Host closing.

EDIT #7 @ 2:12am: It appears that the wrong /home hard drive was installed. As the data is old which also means that the raid hasn’t worked since August 17, 2009. I just spent 3 hours making cp-backups of old data. But XC-Host.com is up, it redirects here.

EDIT #8 @ 11:26am: Didn’t get xc-host.com up last night, as named and the dns weren’t working. But We are slowly restoring accounts. Still having problems with mysql and named but they should have that fixed asap. Please stay tuned to this blog for more updates as they come.

EDIT #9 @ 12:12pm: Named is up, mysql will stay down until restoring is complete. Accounts are being backed up using cPanels backup wizard right now so restoring will be easier. http://hidethe.info now loads fine. More soon!

EDIT #10 @ 2:52pm: Almost all the accounts have been backed up. Currently on a very large account in the w’s. There are 10 accounts left. Then the restores begin. Please note that mysql is not on yet so some of your sites will show mysql errors. We’re almost through this finally. Thank you all for your patience.

EDIT #11 @ 4:54pm: Restoring accounts. Should be another 2 or more hours before everything is 100% live!

FINAL EDIT #12 @7:53pm: We are back online 100%. I’ve restored the 190 or so accounts I have. No comes the hard part, figuring out whose staying and whose leaving. I’ll be sending out an email shortly.

– JoeM