I just was notified by Kevin that the server will go down for a bit as the new backup hard drives are installed. It’s happening at 7:00pm my time because it will be 11:00pm in Ireland.
Sorry for the short notice but I just learned about this myself! It is currently 5:15pm so in another hour and 45 minutes.
–JoeM
At approximately 1:30am (EST -5) this morning I noticed a couple instant messages saying that there was extreme server load on the server. I took a look and had to wait a while as pages are taking much longer than usual to load. Everything is fine, server load is under 1, but pages do take considerably longer to load..
I pinged xc-host.com and got one timeout and ended up with 25% packet loss a traceroute confirms this. I’ve sent in a ticket and will have a cause / fix for this soon. I’ll edit this post when I have more information.
EDIT #1 @ 10:08am: “I can see a lot of packet loss to that server. I’m still looking into this problem and will update you shortly.”
EDIT #2 @ 10:50am: The server is down now. They tried doing a reboot but it’s not responding. From the data center: “I checked all the connections but couldn’t find any problem, and other servers in that rack aren’t having any problems.
I tried rebooting the server but I’m not getting any response from it now. We’re going to take it to the workbench now and see what the problem is.”
EDIT #3 @ 11:35am: “Unfortunately one of the two recently added backup drives has failed.
We’re trying to get the server back online asap without the failed drive but it’s giving a few errors we have to work past.”
EDIT #4 @ 2:01pm: It looks like both backup drive maybe corrupt. OR the main drives. It is uncertain at this time. A backup is being run right now so nothing is lost. I don’t have eta. But I’ll post here once I know more.
EDIT #5 @ 3:33pm: The data is okay thankfully, the data center has gone ahead and is building a new server for us. At first I said WHY?! But it is so that this doesn’t happen again. As you know when we got the first hard drive it failed almost instantly.. I hope this is resolved soon. Still no eta..
EDIT #6 @ 8:58pm: The servers back finally, just doing account restoration. Unfortunately the restores are from the 17th. But the old main hard drive is mounted and the files will be restored along with the databases and DNS entries. Also I suggest everyone read the post about XC-Host closing.
EDIT #7 @ 2:12am: It appears that the wrong /home hard drive was installed. As the data is old which also means that the raid hasn’t worked since August 17, 2009. I just spent 3 hours making cp-backups of old data. But XC-Host.com is up, it redirects here.
EDIT #8 @ 11:26am: Didn’t get xc-host.com up last night, as named and the dns weren’t working. But We are slowly restoring accounts. Still having problems with mysql and named but they should have that fixed asap. Please stay tuned to this blog for more updates as they come.
EDIT #9 @ 12:12pm: Named is up, mysql will stay down until restoring is complete. Accounts are being backed up using cPanels backup wizard right now so restoring will be easier. http://hidethe.info now loads fine. More soon!
EDIT #10 @ 2:52pm: Almost all the accounts have been backed up. Currently on a very large account in the w’s. There are 10 accounts left. Then the restores begin. Please note that mysql is not on yet so some of your sites will show mysql errors. We’re almost through this finally. Thank you all for your patience.
EDIT #11 @ 4:54pm: Restoring accounts. Should be another 2 or more hours before everything is 100% live!
FINAL EDIT #12 @7:53pm: We are back online 100%. I’ve restored the 190 or so accounts I have. No comes the hard part, figuring out whose staying and whose leaving. I’ll be sending out an email shortly.
– JoeM
Before everyone goes “FUCK WHY”. Let me explain.
I’ve been saying this on and off ever since we left ayksolutions because it seems that something goes wrong every 3 months. I’ve been slowly losing customers ever since. Lost one today from this outage. Whose next?
Enough’s enough, the market is so saturated with hosting companies that I can’t compete. Trust me I’ve tried. Godaddy offers hosting for pennies.. The last sign up I had was September of 2008, and I just removed the account last week as he closed down his computer business..
I’m going to see if I can work out a deal with matt @ mjzhosting (aka mjz) so that I can bring any resellers that want to come with me.
To any shared account client, your welcome to stay until your account expires and possibly beyond. Not much will change, support will be directly through this domain. If I choose to continue the price won’t change, support wont change. I just won’t have a server.
For those resellers who’ve paid for one or two years, I’m willing to continue to host your accounts if I can work something out with mjz. Otherwise I can’t really offer refunds but I don’t mind paying for the first 2 months on your new host. It’s the least I can do and you won’t get that anywhere else.
The time line I’ve come up with for the closing is two months. It gives me time to hopefully work something out with mjz and time for anyone who wants to leave to find a new host. Personally I still like mjzhosting, but I know 80% of my clients came from a bad experience over there. I started XC-Host when one of mjz’s servers had a week of downtime because of a hard drive failure.
MJZ Hosting is running entirely new servers / hardware right now, and there hasn’t been a problem in a while. Matt the owner has been running MJZ Hosting way before I even paid for hosting! Take a look at his website: http://mjzhosting.net
Lastly, I want to thank all my customers who have been with me throughout this bumpy ride since March of 2006. I’ve enjoyed hosting you for all this time and wish you luck with your new host.
Sincerely,
JoeM
XC-Host
www.XC-Host.com
This just came to my attention thanks to @lorelleonwp. Attacks on past versions of wordpress are happening now! Article: http://twttr.it/wpattack
I keep all my wp installs up to date. I even have a shell script that updates them in seconds! As I have said in an earlier post feel free to send in a support request on this and I’ll add you to the script.
EDIT: If you are running a past version of wordpress it is now mandatory and you must upgrade within 48 hours of this post. The damage that the worm can do to your website will take a couple of hours to reverse. It includes installing a fresh copy of wordpress and importing all your old posts and etc.
This post was revised on September 8, 2009 @ 1:00pm (EST -5). Thank you all for understanding 
– JoeM
Landed @ 1am Toronto time this morning. Nice cab ride to the hotel and get a free continental breakfast from starbucks ftw. Grande Earl Grey Tazo Tea Latte.. mmm.. I get one everyday I’m here (4)!
If you have support requests please submit them the usual way via the support form above. Or via email..
Also trying out my new url shortening service (proudly running on yourls) twttr.it!
Off to enjoy San Fran
–JoeM
I got word from my provider that the new drive is in and will be installed 9pm GMT, which is 6pm EST (-5) my time. So in roughly 5 hours and 40 minutes the server goes down for a brief period of time.
Check this post for updates as I will be posting them.
UPDATE #1: Currently the 250gb hard drive we ordered is out of stock. So instead we are getting a 400gb drive for the same price!!
UPDATE #3: Under a tornado watch. So I won’t be on my computer. Power should be going out soon lol. Drive was apparently installed. My provider was talking to the server techs at the data center before I shutdown. I don’t see the drive in whm or ssh.
UPDATE #4: Tornato watch is over thankfully . Apparently instead of a 400gb hard drive the data center techs installed 2x200gb hard drives. So they will be setup in a raid 0 to give us 1 400gb drive. More updates soon.
–JoeM
It appears the new drive was faulty. The drive was tested in a couple machines and it wasn’t recognized. They should have another one tomorrow and will try again at 5pm EST.
Hopefully everything goes well tomorrow
UPDATE: Just got word that the hard drive didn’t arrive today. So it should be there tomorrow. More updates / email once I know the drive has arrived.
– JoeM
Just got an update from our provider. The drive has arrived and will be fitted in roughly 4 hours. There will be about 15 minutes of downtime while this is done.
My apologies for the downtime in advance but it is minimal and things will be better space wise once all this is done
UPDATE: Just so anyone reading this knows in 1 hour the server goes down for the backup hard drive addition. Since tweeting atm doesn’t work I’ll manually post this.
As many of you may notice we are running out of hard drive space. Why is this you ask? Well its simple.. We have 2x250gb hard drives setup in raid 1 to mirror the contents of the drives. And since I started doing backups on the one drive they take up a lot of space. Triple the space to be exact..
The new hard drive is 250gb just like the other two, and will be only for backups.
Just finished paying for the drive, will update you when it has arrived and is being installed. I apologize for any downtime that may occur.
One more thing you can follow xc-host on twitter. twitter.com/xchost
– Joe
I’ve given the link to some people. I’ve been using it since the inception of XC-Host because a friend (Matt) made it and let me use it. It’s always been good to have and has been in many screenshots.. A couple days ago I thought it was time I got with the times and find something that auto-updates and will actually email me when things go wrong. For security reasons some stuff has been removed / edited out.
This new script called status2k was originally introduced to me by mjz. Many, many years ago (pre xchost). I liked it but couldn’t afford the $20 or so it was to purchase it. I knew he had found it on wht (web hosting talk) so I eventually figured out his account name and spent a good 30 minutes going through every topic he ever posted in until I found it. Glad I did too because it’s changed A LOT since I last saw it 
Best money I’ve spent in a long time!!
For those of you completely lost check it out: http://xc-host.com/ss. It’s now a link in the navigation as well
– Joe